JBI Critical Appraisal Checklist for Qualitative Research
A 10-item critical-appraisal instrument from the Joanna Briggs Institute used to assess the methodological congruity and trustworthiness of primary qualitative studies (interviews, focus groups, ethnography) for inclusion in qualitative evidence syntheses and patient-experience evidence.
What it is
— The JBI Critical Appraisal Checklist for Qualitative Research is a 10-item methodological appraisal instrument maintained by the Joanna Briggs Institute (JBI) as part of the JBI Manual for Evidence Synthesis and the JBI suite of design-specific critical-appraisal tools. It is the qualitative counterpart to JBI's checklists for RCTs, cohort, case-control, and prevalence studies. Its purpose is to judge whether a primary qualitative study was conducted and reported with internal congruity and methodological trustworthiness — i.e., whether the stated philosophical position, methodology, research question, data collection, analysis, and interpretation hang together, and whether the researcher's influence and the participants' voices were handled defensibly. It is a critical-appraisal / risk-of-trustworthiness instrument, not a reporting checklist and not a numeric quality score; the canonical methodological articulation is Lockwood, Munn & Porritt (2015), with confidence in the synthesized findings graded separately via the ConQual approach (Munn et al., 2014).
When to use
— Use the JBI Qualitative checklist whenever you must appraise individual qualitative studies before pooling or interpreting them: (1) the appraisal stage of a JBI meta-aggregative qualitative systematic review or any qualitative evidence synthesis; (2) the qualitative arm of a mixed-methods systematic review or mixed-methods RWE study; (3) appraising patient-experience / concept-elicitation interviews that underpin PRO instrument development or content-validity arguments; and (4) building the qualitative evidence base in an HTA dossier where patient and caregiver perspectives inform value, acceptability, or unmet-need claims. Decision rule for picking the right tool: appraise primary qualitative studies with JBI Qualitative; report a qualitative study you are writing with COREQ (interviews/focus groups) or SRQR; report the synthesis with ENTREQ / PRISMA; and grade confidence in the pooled qualitative findings with GRADE-CERQual or JBI ConQual. JBI Qualitative appraises inputs; it does not report your own study and does not grade your synthesis output.
What it requires
— The instrument enforces ten methodological-congruity judgements (each scored yes / no / unclear / not applicable, never summed into a single quality number): (1) congruity between the stated philosophical perspective and the research methodology; (2) congruity between the methodology and the research question or objectives; (3) congruity between the methodology and the data-collection methods; (4) congruity between the methodology and the representation and analysis of data; (5) congruity between the methodology and the interpretation of results; (6) the researcher located culturally or theoretically (positionality/reflexivity); (7) the influence of the researcher on the research, and vice versa, addressed; (8) participants and their voices adequately represented; (9) ethical approval by an appropriate body documented; and (10) conclusions that flow from the analysis or interpretation of the data. In real-world evidence work the substantive analogues are not time-zero alignment or estimands but the qualitative-rigor parallels: an audit trail from raw transcript to theme (analytic transparency), member checking or independent double-coding (the qualitative cousin of adjudication), saturation justification, and explicit reflexivity so the analyst's framing is visible rather than smuggled in.
When NOT to use — limitations and common misapplications
— (a) It is a trustworthiness-appraisal tool, not a reporting checklist: do not hand it to authors as a writing template, and do not substitute it for COREQ/SRQR when the task is reporting your own qualitative study. (b) Do not sum the ten items into a quality score or a cut-off to include/exclude studies — JBI explicitly discourages numeric thresholds; meta-aggregation typically includes studies regardless and uses appraisal to contextualize, not to gate. (c) Do not apply it to quantitative or mixed-methods designs: appraise quantitative arms with the matching JBI/quantitative-RWE tools and reserve this checklist for the qualitative component only. (d) Completing the checklist does not make findings generalizable or causal — it speaks to dependability and credibility, not to transferability claims, which require their own argument. (e) Checklist-as-theater: marking items "yes" without quoting the evidence in the study (the reflexivity statement, the ethics approval number, the saturation rationale) defeats the purpose; appraisal must cite the text. (f) Confusing appraisal of inputs with confidence in outputs — that is ConQual/CERQual's job, downstream of this checklist.
How it maps to this catalog
— The instrument operationalizes the appraisal step for the catalog's qualitative design concepts: qualitative-interview and qualitative-ethnographic are the primary designs it is built to appraise, and qualitative-synthesis is the meta-aggregative review where appraised studies are pooled (with ConQual grading the pooled findings). It governs the qualitative component of mixed-methods RWE designs and is the rigor backbone for pro-development and pro-rwe content-validity / concept-elicitation interviews and for preference-study qualitative phases. Items 6–7 (reflexivity, researcher influence) and item 4 (analysis representation) connect to endpoint-adjudication-chart-review-rwe as the qualitative analogue of independent, documented double-coding; item 8 (voice representation) and contextual interpretation connect to sdoh-social-determinants-of-health where lived-experience context shapes the evidence. Applied note for claims/EHR/registry RWE: structured administrative data themselves are out of scope for this checklist, but qualitative substudies nested in RWE programs are squarely in scope — patient/clinician interviews that justify a phenotype's face validity, concept-elicitation work behind a PRO endpoint used in a registry, or caregiver-burden interviews in an HTA submission should each be appraised with JBI Qualitative before their findings are allowed to influence a regulatory or payer narrative (e.g., FDA Patient-Focused Drug Development / Voice-of-the-Patient evidence and EMA patient-experience inputs).