February 21, 2022
Reliability, Validity, Generalizability, Transferability
Source: Source: http://www.adolphus.me.uk/emx/empirical_research/reliability.htm”
Reliability: this is about the replicability of your reseach and the accuracy of the procedures and research techniques. Will the same results be repeated if the research is repeated? Are the measurements of the research methods accurate and consistent? Could they be used in other similar contexts with equivalent results? Would the same results be achieved by another researcher using the same instruments? Is the research free from error or bias on the part of the researcher, or the participants? (E.g. do the participants say what they believe the management, or the researcher, wants? For example, in a survey done on some course material, that on a mathematical module received glowing reports which led the researcher to wonder whether this was anything to do with the author being the Head of Department!)
Validity: how successfully has the research actually achieved what it set out to achieve? Can the results of the study be transferred to other situations? Does x really cause y, in other words is the researcher correct in maintaining a causal link between these two variables? Is the research design sufficiently rigorous, have alternative explanations been considered? Have the findings really be accurately interpreted? Have other events intervened which might impact on the study, e.g. a large scale redundancy programme? (For example, in an evaluation of the use of CDs for self study with a world-wide group of students, it was established that some groups had not had sufficient explanation from the tutors as to how to use the CD. This could have affected their rather negative views.)
Generalizability: Are the findings applicable in other research settings? Can a theory be developed that can apply to other populations? For example, can a particular study about dissatisfaction amongst lecturers in a particular university be applied generally? This is particularly applicable to research which has a relatively wide sample, as in a questionnaire, or which adopts a scientific technique, as with the experiment.
Transferability: Can the research be applied to other situations? Particularly relevant when applied to case studies.