What makes social research trustworthy, and how do reliability, validity, objectivity and ethics protect it?
Evaluating research quality: reliability and replicability, validity, objectivity versus bias, representativeness and generalisability, and research ethics (informed consent, confidentiality, harm).
How research quality is judged in SQA Advanced Higher Modern Studies. Covers reliability and replicability, validity, objectivity versus bias, representativeness and generalisability, and the ethics of social research including informed consent, confidentiality and avoiding harm.
Reviewed by: AI editorial process; not yet individually human-reviewed
Have a quick question? Jump to the Q&A page
Jump to a section
What this key area is asking
Once data is gathered, the researcher and the reader must judge whether it can be trusted. This dot point covers the criteria that decide research quality, reliability, validity, objectivity, representativeness and generalisability, and the ethics that govern research with people. At Advanced Higher you must define these terms precisely, distinguish them, and apply them to evaluate a study, which is exactly what the question paper asks and the project-dissertation demands.
Reliability and validity: the core pair
The distinction is examinable in its own right. A structured questionnaire is highly reliable, because anyone repeating it gets comparable results, but may have low validity if its closed questions miss the real meaning of what people think. An unstructured interview may be highly valid, capturing genuine attitudes, but low in reliability because it cannot be exactly repeated. Strong research seeks both, but the achievable balance depends on the method and aim.
Objectivity and bias
Total objectivity is hard, because researchers choose what to study and how, but the duty is to minimise and disclose bias so others can judge it. This is why transparency, documenting every decision, is itself a quality criterion: it lets a reader see where bias might have entered.
Representativeness and generalisability
Representativeness asks whether the sample mirrors the population in the characteristics that matter; generalisability asks whether the findings can therefore be extended to the whole population. The two are linked: only a representative sample (usually from probability sampling) supports confident generalisation. Qualitative studies with small, non-probability samples are often strong on validity but cannot be generalised, so their conclusions must be stated as insight rather than as population-wide fact.
Research ethics
Ethics is not a box-ticking formality. A study that deceives participants, exposes them to harm or breaches confidentiality may be both indefensible and invalid, because coerced or distressed responses are not trustworthy data. On sensitive issues, ethical care is also what makes honest data possible, so ethics and quality reinforce each other.
Worked example
Try this
Q1. State the difference between reliability and validity. [2 marks]
- Cue. Reliability is whether a method gives consistent, repeatable results; validity is whether it accurately measures what it claims to.
Q2. Name two ethical principles a researcher must follow when studying human participants. [2 marks]
- Cue. Any two of: informed consent, confidentiality and anonymity, avoidance of harm, the right to withdraw.
Exam-style practice questions
Practice questions written in the style of SQA exam questions on this dot point, with worked answer explainers. The year tag is the paper they imitate, not the source.
SQA AH (research methods)12 marksEvaluate the importance of reliability and validity in judging the quality of a piece of social research.Show worked answer →
A strong answer defines both terms precisely, distinguishes them, and judges why each matters and what happens when one is missing.
Reliability is consistency: a reliable method gives the same results if repeated, so it can be replicated and checked, which is why standardised methods (such as structured questionnaires) score well. Validity is accuracy: a valid measure actually captures what it claims to, so an in-depth interview may be highly valid even if hard to replicate. The two can pull apart: a method can be reliable but not valid (consistently measuring the wrong thing) or valid but not reliable (capturing reality in a one-off way that cannot be repeated). The judgement should conclude that strong research seeks both, but that the right balance depends on the aim, with quantitative methods favouring reliability and qualitative methods favouring validity.
SQA AH (research methods)8 marksExplain why ethical considerations are essential when carrying out primary research with human participants.Show worked answer →
The marks reward naming key ethical principles and explaining the protection each provides.
Informed consent ensures participants understand the study and agree freely, protecting their autonomy. Confidentiality and anonymity protect participants from harm by keeping their identity and data private. Avoiding harm, physical or psychological, is a duty of care, especially on sensitive issues. The right to withdraw lets participants leave at any time. Ethical practice is essential not only to protect people but to keep the research credible: a study that breaches ethics may be invalid and cannot be defended. A full answer links each principle to the participant it protects and to the trustworthiness of the findings.
Related dot points
- The social research process: framing a research question and aim, forming a hypothesis, choosing a method, gathering and analysing data, and reporting conclusions as a repeatable cycle.
How the social research process works in SQA Advanced Higher Modern Studies. Covers framing an aim and research question, hypotheses, choosing methods, gathering and analysing data, drawing conclusions, and why research is a structured, repeatable cycle that underpins both the question paper and the dissertation.
- Sampling: the population and sampling frame, probability sampling (random, systematic, stratified, cluster) and non-probability sampling (quota, snowball, convenience), sample size, and representativeness.
How sampling works in SQA Advanced Higher Modern Studies. Covers populations and sampling frames, probability methods (random, systematic, stratified, cluster), non-probability methods (quota, snowball, convenience), sample size, representativeness and the trade-offs that decide which method fits a study.
- Primary research methods: questionnaires and surveys, interviews (structured, semi-structured, unstructured), focus groups, observation and field research, with their strengths, limitations and the quantitative-qualitative distinction.
How primary research methods work in SQA Advanced Higher Modern Studies. Covers questionnaires and surveys, structured to unstructured interviews, focus groups, observation and field research, the quantitative-qualitative distinction, and how to justify a method against a research aim.
- Secondary research methods: official statistics, academic literature, media and online sources, content analysis, and critically evaluating secondary data for bias, accuracy and currency.
How secondary research works in SQA Advanced Higher Modern Studies. Covers official statistics, academic literature, media and online sources, content analysis, and how to evaluate secondary data critically for bias, accuracy, currency and the purpose behind it.
- Drawing conclusions: synthesising evidence to answer the research question, judging the hypothesis, supporting conclusions with data, acknowledging limitations, and the source-based conclusions question in the exam.
How to draw sound conclusions in SQA Advanced Higher Modern Studies. Covers synthesising evidence to answer the research question, judging the hypothesis, supporting each conclusion with data, acknowledging limitations, and the source-based draw-conclusions question in the exam.