A systematic review finds, appraises, and synthesizes all evidence on a question, using a pre-specified, reproducible method. A meta-analysis is a statistical technique that pools numerical results into one effect estimate. It usually done inside a systematic review.
This article explains the differences between the two in detail, and when to choose to do a meta-analysis if you’re conducting a systematic review.
What Is a Systematic Review?
A systematic review is a form of secondary research that identifies, evaluates, and synthesizes all available evidence relevant to a specific, pre-defined research question. Unlike a traditional or narrative literature review, which may reflect the author’s familiarity with a subset of the literature, a systematic review follows a rigorous, transparent, and reproducible methodology that is defined before the search begins.
Key Characteristics of a Systematic Review
- A clearly stated, focused research question
- Pre-specified eligibility criteria (inclusion and exclusion criteria)
- A comprehensive, reproducible search strategy covering multiple databases
- Independent screening and selection of studies by at least two reviewers
- Critical appraisal of study quality and risk of bias
- Systematic data extraction
- Synthesis of findings (qualitative, quantitative, or both)
- Transparent reporting, typically following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines
What Is a Meta-Analysis?
A meta-analysis is a statistical technique that pools the quantitative results from two or more independent studies to generate a single, combined estimate of effect. It is not a standalone study design in the way a systematic review is. Rather, it is a statistical method that is frequently performed within the framework of a systematic review.
Why perform a meta-analysis?
The core purpose of a meta-analysis is to produce a more precise estimate of a treatment effect, risk factor, or association than any individual study could provide on its own. Many primary studies are too small to detect a true effect with confidence. By mathematically combining their data, a meta-analysis increases statistical power and reduces uncertainty around the estimate.
Results from a meta-analysis are typically displayed in a forest plot: a graphical representation showing the effect size from each included study alongside a summary diamond at the bottom representing the pooled estimate.
Key Characteristics of a Meta-Analysis
- Requires quantitative (numerical) data from multiple studies
- Calculates a pooled effect size (e.g., odds ratio, risk ratio, weighted mean difference, standardized mean difference)
- Assesses heterogeneity (the degree of variation in results across studies) to determine whether pooling is appropriate
- May use subgroup analysis or meta-regression to explore sources of variation
- Increases statistical power beyond what any single study can achieve
- Produces a single numerical estimate that can directly inform clinical or policy decisions
Systematic Review vs Meta-Analysis: The Core Differences
The most important distinction is this: a systematic review is a type of study; a meta-analysis is a statistical technique. A meta-analysis is often conducted as part of a systematic review, but the two are not the same thing, and neither requires the other.
| Feature | Systematic Review | Meta-Analysis |
| Type | Research methodology / study design | Statistical technique |
| Primary purpose | Comprehensively identify, appraise, and synthesize evidence | Quantitatively pool results to estimate overall effect |
| Data type | Qualitative or quantitative (or both) | Quantitative only |
| Output | Narrative or statistical synthesis; comprehensive overview | Single pooled effect size with confidence intervals |
| Requires statistics? | No, can use narrative synthesis | Yes, inherently statistical |
| Can stand alone? | Yes | Rarely, usually embedded in a systematic review |
| Addresses heterogeneity? | Descriptively | Statistically (e.g., I² statistic, Cochran’s Q) |
| Reporting guideline | PRISMA | PRISMA (with meta-analysis extensions) |
| Identifies evidence gaps? | Yes | Indirectly |
| Level of evidence | Highest (top of evidence pyramid) | High (when within a systematic review) |
The Relationship Between the Two: How They Work Together
The relationship between a systematic review and a meta-analysis is best understood as follows: all meta-analyses should be conducted within the framework of a systematic review, but not all systematic reviews will include a meta-analysis.
This means:
- A systematic review without meta-analysis is entirely valid. It synthesizes evidence through narrative synthesis, thematic analysis, or qualitative evidence synthesis.
- A meta-analysis without a systematic review is considered methodologically weak, because there is no guarantee that the underlying studies were comprehensively identified or that bias in study selection has been minimized.
- A systematic review with meta-analysis represents the most statistically powerful form of secondary evidence synthesis.
Why Don’t All Systematic Reviews Include a Meta-Analysis?
This is one of the most common questions researchers have, and the answer comes down to the nature of the data. Meta-analysis is only appropriate when the included studies are sufficiently homogeneous. In other words, they need to be similar enough in terms of population, intervention, comparator, and outcome to make pooling meaningful.
When studies are too different from one another (i.e., show high heterogeneity), combining their results statistically can produce a misleading average that does not accurately represent any real-world situation. In such cases, narrative synthesis is more honest and more informative.
Reasons a Systematic Review May Not Use Meta-Analysis
- High heterogeneity: significant variation in study populations, interventions, or outcomes makes pooling inappropriate
- Too few studies: an insufficient number of comparable studies to produce a meaningful estimate
- Poor methodological quality: low-quality primary studies with high risk of bias would distort the pooled result
- Qualitative data: some systematic reviews address questions best answered with qualitative evidence, for which statistical pooling is not applicable
When Should You Use a Systematic Review vs Meta-Analysis?
Choosing between a systematic review and a meta-analysis depends on the research question and the nature of the available evidence.
Opt for a systematic review when you want to:
- Comprehensively map all available evidence on a topic
- Identify trends or gaps in the literature
- Answer questions that involve qualitative or heterogeneous data
- Produce a rigorous, reproducible synthesis that informs guidelines or policy
- Answer questions about effectiveness, diagnosis, prognosis, or experiences
Add a meta-analysis when:
- The systematic review has identified multiple studies that are sufficiently similar
- The outcome data are quantitative and comparable
- You want to produce a precise numerical estimate of an effect
- You need to increase statistical power beyond any individual study
- You want to formally test for and explore sources of heterogeneity
Avoid meta-analysis when:
- Studies are clinically or methodologically too different to pool meaningfully
- There are too few included studies
- The quality of included studies is too low
- The data are primarily qualitative in nature
Systematic Review vs Meta-Analysis: A Quick-Reference Summary
| Systematic Review | Meta-Analysis | |
| Definition | Comprehensive synthesis of all evidence on a question | Statistical pooling of quantitative results across studies |
| Nature | Qualitative and/or quantitative | Quantitative only |
| Can include the other? | Yes, may include a meta-analysis | No, relies on a systematic review for study identification |
| Primary output | Narrative or statistical synthesis | Pooled effect size with confidence interval |
| Key tool | PRISMA flow diagram, risk of bias assessment | Forest plot, funnel plot, I² statistic |
| Used in | Medicine, social science, education, policy | Medicine, epidemiology, psychology, public health |
| Requires statistics? | Not necessarily | Always |
| Time to complete | Months to years | Weeks to months (when data are ready) |
| Best for | Mapping the evidence landscape | Quantifying the magnitude of an effect |
Frequently Asked Questions
Is a meta-analysis a type of systematic review?
Not exactly. A meta-analysis is a statistical method that is frequently used as part of a systematic review, but it is not itself a study design. A systematic review can exist without a meta-analysis, but a meta-analysis ideally should be embedded within a systematic review.
Which is stronger: a systematic review or a meta-analysis?
Both sit at the top of the evidence hierarchy. A well-conducted systematic review with meta-analysis is generally considered the highest level of evidence, but a rigorous systematic review without meta-analysis still provides more reliable evidence than individual studies or narrative reviews.
Can I do a meta-analysis without a systematic review?
Technically yes, but it is methodologically discouraged. Without a systematic, unbiased search, there is no guarantee that the studies included in the meta-analysis represent the full picture. Such analyses risk selection bias and are generally considered suboptimal.
How do I know if meta-analysis is appropriate for my systematic review?
The key question is whether your included studies are sufficiently similar in terms of population, intervention, comparator, and outcome. If they are, and if the data are quantitative and comparable, meta-analysis is likely appropriate. Consulting a statistician is strongly recommended before proceeding.
Comment