JBI Critical Appraisal Checklist for Case-Control Studies
A 10-item critical-appraisal (risk-of-bias screening) checklist from JBI for judging the methodological trustworthiness of case-control and nested case-control studies during evidence synthesis of etiology and risk.
What it is
— The JBI Critical Appraisal Checklist for Case-Control Studies is a 10-item instrument maintained by JBI (formerly the Joanna Briggs Institute) as part of its suite of design-specific critical-appraisal tools. It belongs to the JBI methodology for systematic reviews of etiology and risk (Chapter 7 of the JBI Manual for Evidence Synthesis), where it is used by two independent reviewers to judge whether a case-control study's design, conduct, and analysis are methodologically sound enough to trust and to include in a synthesis. Each item is rated Yes / No / Unclear / Not applicable, and the appraisal informs an explicit, reviewer-documented include/exclude and weight-of-evidence decision — it is not a numeric scale. The tool's published statement is Moola et al. (2015); its currently maintained form lives in the open-access JBI Manual and on the JBI critical-appraisal-tools site.
When to use
— Reach for this checklist when you are appraising primary case-control or nested case-control studies inside a systematic review, scoping/CAT, or HTA evidence-synthesis workflow, most often for a peer-reviewed journal or an HTA/payer evidence assessment. The decision rule among siblings is by design and purpose: use the JBI Cohort checklist for cohort designs, JBI Prevalence for prevalence/cross-sectional burden studies, JBI Case Series / Case Reports for uncontrolled descriptive designs — and this Case-Control checklist only when the included study samples on outcome status (cases vs controls) and looks back at exposure. If your task is reporting your own study rather than appraising others', JBI is the wrong family entirely: use STROBE (and RECORD / RECORD-PE for routinely-collected health data), or HARPER for the protocol/structure of a pharmacoepidemiologic study. If you need a formal risk-of-bias instrument for a comparative observational effect estimate feeding a GRADE assessment, ROBINS-I is the more granular, domain-based tool; JBI appraisal is lighter-weight and synthesis-oriented.
What it requires
— The 10 items map onto the bias domains a case-control study lives or dies by, and each has a real-world-data analogue: - Comparable groups / appropriate matching — cases and controls drawn from the same source population so controls represent the population that produced the cases; matching done and accounted for in analysis. In claims/EHR work this is the risk-set / source-population question — see nested-case-control and case-control. - Same case/control identification criteria — a transparent, validated phenotype applied identically to both groups (diagnosis-phenotype-algorithm-1ip-2op-time-window-rwe, claims-outcome-algorithm-ppv-sensitivity-rwe, algorithm-validation). - Exposure measured in a standard, valid, reliable way, identically for cases and controls — guards against differential/recall misclassification; in RWD this is consistent exposure-episode construction and lookback definition (exposure-episode-construction-rwe, washout-clean-lookback-period-rwe, misclassification-bias-correction-rwe). - Confounders identified and handled — explicit confounder enumeration and a control strategy (matching, stratification, regression, or propensity/disease-risk scores); see dags-backdoor-criterion-drug-studies and high-dimensional-propensity-score-hdps-rwe. - Outcomes/cases assessed in a standard way; exposure period long enough; appropriate statistical analysis — covering case validity, biologically/clinically adequate induction-latency windows (exposure-lag-induction-latency-window-rwe), and analysis that respects matching and sparse-data behavior.
When NOT to use — limitations and common misapplications
— (1) It is an appraisal/RoB-screening tool, not a quality score. JBI explicitly warns against summing "Yes" answers into a total; a study with 8/10 is not "better" than one with 6/10 if the two failed items are fatal (e.g., controls from a different source population). Tallying scores is the single most common abuse. (2) It is not ROBINS-I. It does not decompose bias by domain with signalling questions, so for a comparative-effect estimate destined for GRADE, it under-resolves confounding and selection bias — use ROBINS-I. (3) It under-probes nested case-control–specific issues. Risk-set sampling, time-zero alignment, immortal-time, and incidence-density vs cumulative sampling are where nested designs fail, yet the JBI items don't interrogate them directly; pair the appraisal with time-zero-index-date-alignment-rwe and immortal-time-bias-handling. (4) Wrong tool for the job — using JBI Case-Control to appraise a cohort or prevalence study, or using it as your reporting checklist (STROBE/RECORD-PE territory). (5) Checklist-as-theater — completing the form without independent dual review, consensus, and a documented effect on inclusion/synthesis adds no validity; passing the checklist does not make an observational association causal.
How it maps to this catalog
— Treat each JBI item as a requirement and follow the implementing concept: case/control definition → case-control, nested-case-control, diagnosis-phenotype-algorithm-1ip-2op-time-window-rwe, claims-outcome-algorithm-ppv-sensitivity-rwe, algorithm-validation; comparable source population / selection → selection-bias-sensitivity-analysis-rwe; exposure measurement → exposure-episode-construction-rwe, washout-clean-lookback-period-rwe, exposure-lag-induction-latency-window-rwe, misclassification-bias-correction-rwe; confounder identification and control → dags-backdoor-criterion-drug-studies, high-dimensional-propensity-score-hdps-rwe, baseline-characteristics-and-covariate-balance-rwe; residual-bias quantification → e-value-sensitivity-analysis, quantitative-bias-analysis-toolkit-rwe, negative-control-outcomes-rwe; design data feasibility → fit-for-purpose-data-assessment-rwe.
Applied note (claims/EHR/registry RWE)
A nested case-control study inside a claims or EHR cohort will often look strong on the JBI checklist while harboring the biases the checklist barely touches. Use the appraisal as a floor — confirm a validated phenotype (PPV/sensitivity), an exposure window measured identically for cases and risk-set–sampled controls, and explicit confounding control — then go beyond JBI: document time-zero/risk-set sampling, run a negative-control-outcome or E-value sensitivity analysis, and state the estimand. JBI tells you whether the study is appraisable and roughly trustworthy; it does not certify it as fit for a regulatory or causal claim.