Using Critical Appraisal Tools (Step-by-Step)
Before You Start
- Download the checklist that matches your study type (CASP, JBI, or CEBM).
- First pass: read the checklist once, then skim the article with a highlighter.
- Second pass: answer each checklist question with short notes in your own words.
A. Internal Validity (Risk of Bias) — Was the study done well?
- All studies: Is the research question clear and appropriate?
- Randomised Controlled Trials (RCTs): Randomisation used? Allocation concealed? Blinding described? Drop-outs handled properly?
- Cohort / Case–Control: Clear definitions of exposure and outcome? Groups comparable? Confounders identified and addressed?
- Qualitative: Appropriate methodology and sampling? Data collection and analysis described? Researcher reflexivity and credibility checks?
- Systematic Reviews: Comprehensive search? Explicit inclusion criteria? Study quality/risk-of-bias assessed? Transparent synthesis?
Use the prompts in your CASP or JBI checklist to structure these judgments.
B. Results — What did they find?
Report the main result using the study’s own metrics (for example, risk ratio, odds ratio, or mean difference). Include the 95% confidence interval (CI) if it is reported, as it shows how precise the estimate is.
C. Applicability — Does this help in my context?
- Are the participants, settings, and interventions similar to your context?
- Consider benefits versus harms, feasibility, and equity.
- CASP prompt: “Will the results help locally?”
Mini Template (Copy into Your Notes)
- Focused question: Restate the study question clearly. You can use the PICO framework if it fits (see Step 6 for a full refresher).
- Key methods (design + 2–3 quality points): […]
- Main result (with CI if reported): […]
- Applicability (local relevance, benefits/harms, feasibility): […]
Tip: Keep your answers short and in your own words. The checklist supports your essay discussion and helps you explain how trustworthy the study is.