|
Getting your Trinity Audio player ready...
|
Contents
- Glossary of Key Terms
- Key Takeaways
- What Is Grey Literature?
- Why Is Grey Literature Important in Research?
- Grey Literature in Systematic and Scoping Reviews
- Grey Literature in Integrative Reviews
- How Do You Find Grey Literature Effectively?
- How Do You Evaluate Grey Literature?
- How Do You Cite Grey Literature?
- What Are the Challenges and Limitations of Using Grey Literature?
- Grey Literature Across Fields: Ecology, Public Health, and Social Science
- Recommended Resources for Grey Literature Searching
- Patents as Grey Literature
- Frequently Asked Questions
Glossary of Key Terms
The following terms are used throughout this guide. Familiarity with these definitions will support accurate application of concepts across review types and disciplines.
| Term | Definition |
| Publication Bias | The tendency for journals to publish studies with statistically significant or positive results, leaving null or negative findings unpublished. |
| Systematic Review | A structured synthesis of evidence that uses explicit, reproducible methods to identify, select, and appraise all relevant studies on a defined research question. |
| Scoping Review | A type of evidence synthesis used to map the breadth and nature of evidence on a topic, often prior to a full systematic review. |
| Integrative review | A highly comprehensive form of research review that simultaneously includes diverse methodologies, such as experimental (quantitative) and non-experimental (qualitative) research |
| PICO/PICOS | A framework for structuring clinical research questions: Population, Intervention, Comparison, Outcome, and Study design. |
| AACODS | An evaluation checklist for grey literature: Authority, Accuracy, Coverage, Objectivity, Date, and Significance. |
| File-Drawer Problem | The phenomenon whereby studies with null or negative findings go unpublished, remaining in researchers’ file drawers. |
| Institutional Repository | A digital archive maintained by an institution to store and share its research outputs, including theses, reports, and preprints. |
| HARKing | Hypothesizing After the Results are Known: a practice where researchers selectively report outcomes favoring their hypothesis. |
| Indexing | The process by which documents are catalogued and made searchable within a database or discovery platform. |
| R Discovery | An AI-powered research discovery platform that aggregates millions of papers, preprints, and grey literature sources for researchers across disciplines. |
Key Takeaways
- Grey literature fills critical evidence gaps left by peer-reviewed publishing, particularly for null findings, ongoing trials, and practice-based knowledge.
- Searching grey literature is a methodological requirement in systematic, integrative and scoping reviews to reduce publication bias and selection bias.
- Common types include government reports, policy briefs, theses, clinical trial registries, conference proceedings, and technical reports.
- Evaluation is essential: grey literature lacks peer review, so quality appraisal tools such as AACODS and DARTS must be applied before inclusion.
- Searches must be documented as rigorously as database searches, recording sources, dates, terms, and results at every stage.
- Platforms such as R Discovery (discovery.researcher.life) streamline grey literature discovery by aggregating millions of sources alongside peer-reviewed content in one AI-powered interface, with built-in saving and citation tools.
- Transparency is the cornerstone of reproducibility: every grey literature source included in a review should be traceable and accessible to future readers.
What Is Grey Literature?
Grey literature is research, evidence, and information produced and distributed outside traditional commercial and academic publishing channels. This means it is not published in peer-reviewed journals or commercial books, yet it constitutes a substantial and often indispensable body of knowledge across nearly every field of inquiry.
The Luxembourg Definition, widely adopted since the Fourth International Conference on Grey Literature (1999), describes grey literature as: information produced on all levels of government, academia, business and industry in print and electronic formats that is protected by intellectual property rights, of sufficient quality to be collected and preserved by library holdings or institutional repositories, but not controlled by commercial publishers.
In practical terms, grey literature includes any document produced by an organization or individual that has not passed through the commercial publishing pipeline, even if it has undergone internal review, editorial checking, or organizational approval.
What Are the Main Types of Grey Literature?
Grey literature spans dozens of document types. The major categories, their producers, and their relevance to research are summarized below.
| Category | Document Types | Typical Producers | Key Use Cases |
| Policy and Government | Policy briefs, white papers, legislative documents, regulatory reports | Government ministries, regulatory agencies, intergovernmental organizations | Evidence for policy reviews; legal and regulatory contexts |
| Technical and Scientific | Technical reports, standards, patents, laboratory notebooks | Research institutes, national labs, standards bodies (e.g., ISO, ANSI) | Engineering reviews; technology assessment |
| Health and Clinical | Clinical trial registries, public health bulletins, surveillance reports | WHO, CDC, NHS, health departments | Systematic reviews; clinical guideline development |
| Academic and Institutional | Theses, dissertations, preprints, conference papers, working papers | Universities, academic consortia, preprint servers (arXiv, SSRN) | Methodology development; emerging research tracking |
| Non-Governmental Organizations | Program evaluations, advocacy reports, statistical compilations | NGOs, think tanks, charities, foundations | Social policy research; global development reviews |
| Industry and Corporate | Annual reports, market research, internal evaluations, product assessments | Corporations, industry associations, consultancies | Economic analyses; technology landscape reviews |
| Environmental and Ecological | Environmental impact assessments, survey reports, conservation plans | Environmental agencies, conservation bodies, field stations | Ecological meta-analyses; conservation evidence reviews |
Why Does Grey Literature Exist?
Grey literature exists for reasons deeply embedded in how knowledge is produced outside academia. Organizations need to document activities, share findings with stakeholders, fulfill reporting obligations, or communicate rapidly with practitioners. Peer review and commercial publication introduce delays of months to years. By contrast, a government agency responding to a disease outbreak or a think tank commenting on a proposed regulation cannot wait 18 months for journal publication. Grey literature fills this temporal gap, capturing knowledge at the point of production.
There is also a structural dimension: many practitioners in fields such as public health, environmental management, conservation, and social policy produce valuable evidence that is never submitted to academic journals because it falls outside their professional norms or incentive structures. Grey literature is often the only record of this work.
Why Is Grey Literature Important in Research?
Grey literature is important because it addresses two of the most persistent threats to evidence integrity: publication bias and the file-drawer problem. Studies with statistically significant or positive results are approximately three times more likely to be published in peer-reviewed journals than studies with null or inconclusive findings. This asymmetry means that a review relying only on journal articles may systematically overestimate the effectiveness of an intervention.
A landmark illustration involves the antidepressant Agomelatine. When only published trials were analyzed, the drug appeared effective. When unpublished trials were identified through grey literature sources, the picture changed substantially, demonstrating the degree to which the evidence base can be shaped by what journals choose to publish.
What Unique Value Does Grey Literature Add?
- Currency: government and non-profit reports are often published months or years before equivalent academic literature appears.
- Breadth: grey literature covers populations, interventions, and settings that academic journals rarely prioritize, particularly in low-income countries and marginalized communities.
- Practice-based evidence: field practitioners document real-world implementation data that controlled research often misses.
- Policy relevance: policy briefs and regulatory documents reflect the translated, applied version of science, which is essential for reviews aiming to inform decision-making.
- Unpublished trials: clinical trial registries and conference abstracts may contain results from trials that were never submitted for publication, particularly when outcomes were unfavorable to a sponsor.
- Ecological and environmental data: survey reports, species inventories, and environmental impact assessments provide critical baselines for conservation and ecological meta-analyses.
Grey Literature in Systematic and Scoping Reviews
Both systematic reviews and scoping reviews require comprehensive searching that extends beyond academic databases. However, the purpose and extent of grey literature searching differs between these review types.
| Feature | Systematic Review | Scoping Review |
| Primary Purpose | Answer a defined clinical/policy question with high certainty | Map the extent and nature of evidence on a broad topic |
| Research Question | Narrow and specific (PICO format) | Broad and exploratory (PCC framework) |
| Quality Appraisal of Sources | Mandatory; articles excluded based on quality | Optional; all sources typically included regardless of quality |
| Grey Literature Inclusion | Strongly recommended to reduce publication bias | Standard practice to comprehensively map the evidence landscape |
| Volume of Grey Literature Searched | Targeted: trial registries, government reports | Expansive: all relevant source types across disciplines |
| Synthesis Method | Quantitative (meta-analysis) or qualitative synthesis | Descriptive mapping and narrative synthesis |
| Reporting Guideline | PRISMA 2020 | PRISMA-ScR (Scoping Review extension) |
Is Grey Literature Required in Systematic Reviews?
Yes: methodological guidance from Cochrane, PRISMA 2020, and the Joanna Briggs Institute (JBI) all recommend grey literature searching as a standard component of systematic reviews. Failing to search grey literature introduces selection bias and threatens the validity of any quantitative synthesis. Reviewers must document every grey literature source searched, regardless of whether it yielded included studies.
In practice, a systematic review of a pharmaceutical intervention should at minimum search relevant clinical trial registries, regulatory agency databases (such as the FDA or EMA), and conference proceedings from key specialty societies. A systematic review of a public health program should also include government evaluations, agency reports, and NGO documentation.
How Does Grey Literature Function in Scoping Reviews?
In scoping reviews, grey literature is even more central because the purpose is comprehensive mapping rather than causal inference. Scoping reviews explicitly aim to identify what types of evidence exist, which populations have been studied, and where gaps remain. Excluding grey literature in a scoping review would systematically underrepresent practice-based knowledge, organizational evidence, and evidence from settings that do not produce peer-reviewed publications.
The PRISMA-ScR extension and the JBI scoping review methodology both specify that grey literature sources should be searched as part of the standard scoping review protocol, with sources documented in an appendix.
Researchers conducting scoping reviews have found tools like R Discovery (discovery.researcher.life) particularly useful at this stage: its AI-powered discovery engine surfaces relevant grey literature, preprints, and institutional reports alongside academic papers in a unified search interface, reducing the fragmentation that typically comes from searching dozens of separate organizational websites.
Grey Literature in Integrative Reviews
Integrative reviews occupy a distinct methodological position among evidence synthesis approaches. Unlike systematic reviews, which restrict inclusion to studies meeting tightly defined design criteria, integrative reviews deliberately combine evidence from diverse sources: experimental and non-experimental studies, theoretical papers, clinical guidelines, and grey literature. This breadth is the defining strength of the integrative approach, and it makes grey literature not merely useful but structurally central to the method.
What Makes Integrative Reviews Different?
The integrative review, as defined by Whittemore and Knafl (2005) and subsequently developed in nursing and health sciences methodology, is designed to generate a comprehensive understanding of a phenomenon rather than answer a single focused clinical question. Because the goal is holistic synthesis rather than causal inference, the evidentiary net is cast wide. Grey literature fits naturally within this net: policy documents, practice guidelines, program evaluations, and theoretical frameworks produced outside academic journals all contribute to a fuller picture of how a phenomenon is understood, experienced, and addressed in practice.
This is in contrast to a Cochrane-style systematic review, where grey literature functions primarily as a safeguard against publication bias. In an integrative review, grey literature is an affirmative contributor to meaning, not simply a corrective for missing data.
What Types of Grey Literature Are Most Relevant?
The grey literature sources most commonly integrated into integrative reviews include:
- Professional and clinical practice guidelines, which represent synthesized expert consensus and directly shape the practice landscape under review
- Government policy documents and national strategy papers, which establish the legislative and regulatory context for a topic
- Program evaluation reports, which document real-world implementation outcomes absent from controlled trial literature
- Theoretical and conceptual papers from institutional working groups, which may inform the review’s framework without constituting empirical evidence
- Conference proceedings and abstracts, which capture emerging thinking not yet published in journals
How Should Grey Literature Be Handled in the Integrative Review Process?
Because integrative reviews include sources of varying design and epistemological origin, quality appraisal must be flexible and design-appropriate. Reviewers should not apply a single instrument uniformly across all source types. Instead, a tiered approach is recommended: empirical studies are appraised using design-specific checklists (JBI, CASP, or MMAT), while grey literature documents are evaluated using AACODS or a comparable framework that assesses authority, currency, objectivity, and relevance rather than methodological rigor in the experimental sense.
Critically, the decision about how much weight to assign grey literature findings during synthesis should be made explicit in the review protocol. A practice guideline from a national professional body carries different epistemic weight than an internal program report from a single clinic, and the narrative synthesis should reflect this distinction transparently.
A Note on Documentation
The same documentation standards that apply to grey literature in systematic and scoping reviews apply here: every source searched, every document screened, and every inclusion or exclusion decision must be recorded. Integrative reviews are sometimes perceived as methodologically looser than systematic reviews, but this perception should never translate into less rigorous audit trails. Reviewers should record grey literature searches with the same precision as database searches, noting source names, search dates, terms used, and results at each stage.
How Do You Find Grey Literature Effectively?
Finding grey literature requires a multi-pronged strategy. No single database or search engine indexes all grey literature, so a systematic approach must combine purpose-built databases, organizational website searches, general search engines, and citation tracking.
Key Sources and Platforms
| Source / Platform | Coverage | Best For |
| R Discovery (discovery.researcher.life) | Aggregates papers, preprints, reports across 250+ million items; AI-powered discovery with built-in citation tools | Broad grey literature discovery across disciplines; saving and citing reports directly within one workflow |
| Policy Commons | 20,000+ repositories: NGOs, think tanks, government agencies, research centers | Policy research; public health and social science reviews |
| OpenGrey (Europe) | European grey literature: science, technology, social science, humanities | European regional grey literature |
| PsycEXTRA | Psychology and behavioral science grey literature: newsletters, government reports, technical reports | Mental health, behavioral, and social science systematic reviews |
| WHO IRIS | WHO publications, reports, and technical documents | Global health policy and public health reviews |
| ClinicalTrials.gov / ISRCTN | Registered clinical trials, many with results posted | Identifying unpublished or ongoing trials for clinical systematic reviews |
| ProQuest Dissertations & Theses | Doctoral dissertations and master’s theses worldwide | Academic grey literature; methodology insights |
| OpenDOAR | Directory of academic open-access repositories | Locating institutional repositories by subject or geography |
| ERIC (Education Resources) | Unpublished reports, government education documents, conference papers | Education policy and pedagogy systematic reviews |
| Google / Google Scholar | Broad web-based grey literature; theses via Scholar | Supplementary searching; identifying organizational websites |
Search Strategies for Grey Literature
The following approaches are recommended for comprehensive grey literature searching:
- Organizational website searching: Identify organizations likely to produce relevant documents (government ministries, international agencies, professional associations, leading NGOs) and search their publication or document repositories directly.
- Domain-restricted searching: Use Google with site: operators to restrict results to specific domains (e.g., site:.gov or site:who.int) combined with your key terms.
- Handsearching: Browse the publications lists of key organizations, particularly where indexing is incomplete or where document metadata is unreliable.
- Citation tracking: Check references in included grey documents to identify additional grey sources. Also check which peer-reviewed papers cite key grey documents.
- Expert and author contact: Contact researchers or organizations working in the field to ask about unpublished reports, in-progress studies, or documents not yet posted online.
- Preprint servers: Search arXiv, bioRxiv, medRxiv, SSRN, and similar platforms for preprints that may never be formally published or whose published version appeared after your search date.
How Should Grey Literature Searches Be Documented?
Documentation of grey literature searching is a methodological requirement and a cornerstone of reproducibility. Every source searched, the terms used, the date of searching, the number of results, and the screening decisions must all be recorded.
| Element to Record | Example / Notes |
| Source name | Policy Commons; WHO IRIS; R Discovery |
| Date of search | 2025-03-15 |
| Search terms used | ‘mental health’ AND ‘adolescents’ AND ‘low income’ |
| Filters applied | Date: 2015 to present; Language: English |
| Number of results returned | 247 |
| Number screened for relevance | 38 |
| Number included after screening | 11 |
| Reason for exclusion (summarized) | Not relevant to population (n=18); no methods described (n=9) |
Platforms that centralize discovery, such as R Discovery can simplify documentation by allowing researchers to save and export search results with source metadata automatically attached, reducing the risk of incomplete records and supporting the audit trail that peer reviewers and editors expect.
How Do You Evaluate Grey Literature?
Because grey literature does not undergo peer review, quality varies widely and critical appraisal is essential before any grey document is included in a review. Evaluation serves two purposes: determining whether a document is reliable enough to include, and extracting information about potential bias that should be noted in the review.
The AACODS Framework
The AACODS checklist was developed specifically for critical appraisal of grey literature in health and social science contexts. It provides a structured, reproducible evaluation across six criteria.
| Criterion | Evaluation Questions | Score (0-2) | Notes |
| Authority | Is the producing organization identified? Is it recognized as credible in the field? Is author expertise indicated? | ||
| Accuracy | Is the methodology clear and reproducible? Are data sources identified? Are conclusions consistent with the evidence presented? | ||
| Coverage | Is the scope of the document clearly defined? Is the content sufficiently comprehensive for the review question? | ||
| Objectivity | Are potential conflicts of interest disclosed? Is the language balanced rather than promotional? Are limitations acknowledged? | ||
| Date | Is a publication or last-updated date provided? Is the content current enough for the review period? | ||
| Significance | Does this document add information not available in peer-reviewed literature? Is it cited by or referenced in other key works? |
Each criterion is typically scored on a two-point scale (0: criterion not met; 1: partially met; 2: fully met), producing a maximum score of 12. There is no universal cut-off, but reviewers should apply a consistent threshold agreed upon in the protocol.
The DARTS Tool
DARTS offers a complementary and simpler framework, well suited to quick screening of large volumes of grey literature. Its five criteria are: Date, Author, References, Type, and Sponsor. DARTS is easily adapted into a spreadsheet and is useful for systematic tracking when large numbers of grey documents must be appraised quickly.
QUEST: Evaluating Online Health Information
The QUality Evaluation Scoring Tool (QUEST) uses a 28-point system designed for health information published online. It assesses Authorship (0 to 2), Attribution of references (0 to 3), Conflict of interest (0 to 2), Currency (0 to 2), and the degree to which the content supports rather than replaces professional medical advice. QUEST is most useful for systematic reviews that include patient-facing or health promotion grey literature.
Comprehensive Grey Literature Evaluation Checklist
The following checklist synthesizes criteria from AACODS, DARTS, QUEST, and institutional guidance. It is designed to be applied to each grey document under consideration for inclusion in a review.
| Dimension | Checklist Item | Yes | No | N/A |
| Provenance | The producing organization or author is clearly identified | |||
| Provenance | The organization’s mandate or expertise is relevant to the topic | |||
| Provenance | Contact details or a verifiable institutional affiliation are provided | |||
| Methodology | The methods used to collect or analyze data are described | |||
| Methodology | The sample, data sources, or evidence base is described | |||
| Methodology | Limitations are acknowledged by the authors | |||
| Objectivity | Funding sources or potential conflicts of interest are declared | |||
| Objectivity | The tone of the document is balanced rather than advocacy-focused | |||
| Objectivity | Conclusions do not overstate the evidence presented | |||
| Currency | A publication date or last-reviewed date is stated | |||
| Currency | The information is current within the timeframe set for the review | |||
| Relevance | The document directly addresses the review population or topic | |||
| Relevance | The document provides data, findings, or perspectives absent from peer-reviewed sources | |||
| Transparency | References or source documents are listed | |||
| Transparency | The document can be located and accessed by other reviewers | |||
| Usability | The document is in a language accessible to the review team or can be translated | |||
| Usability | The document format allows data extraction (e.g., not purely images or video) |
Reviewers should apply this checklist independently, with discrepancies resolved by discussion or a third reviewer, in line with the same standards applied to peer-reviewed source appraisal.
How Do You Cite Grey Literature?
Citing grey literature follows the same general principles as citing any source: enough information must be provided for a reader to locate the original document. In practice, grey literature citations are more variable than journal article citations because the documents themselves vary enormously in format, provenance, and accessibility.
Core Elements of a Grey Literature Citation
- Author(s) or producing organization
- Year of publication or last update
- Title of the document
- Name of the producing institution or agency
- City and country of the institution, if relevant
- Persistent URL, DOI, or location of the document (including date accessed for online sources)
- Report number or series identifier, if applicable
Examples by Document Type
Government report (APA 7th):
World Health Organization. (2023). Global tuberculosis report 2023. World Health Organization.
Thesis (APA 7th):
Okonkwo, A. A. (2022). Barriers to maternal health service utilization in rural Nigeria [Doctoral dissertation, University of Lagos]. ProQuest Dissertations and Theses.
Clinical trial registration:
National Institute of Allergy and Infectious Diseases. (2021). A phase III trial of a novel mRNA influenza vaccine (NCT04896606). ClinicalTrials.gov.
When researchers use R Discovery to locate and save grey literature, the platform automatically captures source metadata for each saved item, which can be exported to reference management software such as Zotero or Mendeley, substantially reducing the manual effort of constructing accurate grey literature citations.
What Are the Challenges and Limitations of Using Grey Literature?
Grey literature provides important evidence, but its use introduces methodological challenges that reviewers must anticipate and manage.
Inconsistent Indexing and Discoverability
Grey literature is distributed across thousands of organizational websites, repositories, and platforms without consistent metadata or indexing. A single government report may exist in multiple versions on multiple pages without a stable URL. This makes comprehensive searching resource-intensive and difficult to replicate exactly.
Variable Quality and Reliability
Without peer review, grey literature quality ranges from rigorously conducted independent evaluations to marketing documents produced to support a commercial agenda. Reviewers must invest time in quality appraisal for every document, rather than relying on journal selection as a proxy for minimum quality standards.
Language Barriers
Grey literature is published in hundreds of languages, and search engines do not reliably surface non-English documents. Restricting a review to English-language grey literature introduces language bias, particularly for topics where major evidence is produced in French, Spanish, Arabic, Chinese, or Portuguese-language policy environments. Here is where a tool like R Discovery can help researchers quickly and accurately translate material in 30+ language pairs, so that you don’t ignore valuable data produced in languages other than English.
Link Rot and Inaccessibility
Grey literature documents are frequently moved, updated without version control, or removed entirely from websites. A report cited in 2020 may be inaccessible by 2025. Reviewers should archive documents at the point of retrieval (using tools such as the Internet Archive’s Wayback Machine) and note access dates in citations.
Practical Strategies for Managing These Challenges
- Set a defined search date and archive all retrieved documents on that date.
- Define inclusion and exclusion criteria for grey literature in the protocol before searching begins.
- Use persistent identifiers (DOIs, handle.net links) where available.
- Build a contact strategy: email organizations directly when key documents are unavailable online.
- Consult a librarian with systematic review experience to design the grey literature search strategy.
Grey Literature Across Fields: Ecology, Public Health, and Social Science
The role and nature of grey literature varies meaningfully across disciplines, and reviewers should tailor their approach accordingly.
Ecology and Conservation
Ecological research relies heavily on grey literature because much wildlife survey data, habitat assessments, and population monitoring reports are produced by government agencies, conservation organizations, and environmental consultancies rather than academic researchers. Conservation evidence reviews, such as those published in the Conservation Evidence journal, systematically integrate grey literature from monitoring reports, management plans, and field station records.
For ecological reviews, key grey sources include: environmental impact assessment reports, species recovery plans, national biodiversity strategies, reports from national parks and protected area authorities, and unpublished monitoring data held by conservation NGOs.
Public Health and Clinical Research
Grey literature has the longest tradition of systematic use in health research. Cochrane reviews and clinical practice guideline development both require comprehensive grey literature searching to identify unpublished trials, regulatory submissions, and surveillance data. Publication bias is particularly acute in pharmaceutical research, where sponsored trials with negative outcomes are less likely to be published.
Key grey sources for health reviews include: clinical trial registries (ClinicalTrials.gov, ISRCTN, WHO ICTRP), regulatory agency documents (FDA, EMA), health technology assessment reports, and surveillance bulletins from national and international public health agencies.
Social Science and Policy Research
Social policy research frequently draws on grey literature because government evaluations, program reports, and think tank analyses constitute primary evidence about the effectiveness of interventions in real-world settings. Academic journals rarely publish routine program evaluations, meaning that the grey literature base is proportionally larger relative to peer-reviewed evidence for many policy topics.
For social science and policy reviews, R Discovery (discovery.researcher.life) enables researchers to search across think tank outputs, institutional working papers, and government publications in the same search session as peer-reviewed sources, avoiding the fragmentation that typically characterizes grey literature searching in this domain.
Recommended Resources for Grey Literature Searching
| Resource | Purpose |
| R Discovery (discovery.researcher.life) | AI-powered discovery platform aggregating grey literature, preprints, and academic papers with citation export tools |
| AACODS Checklist | Structured quality appraisal tool for grey literature (Flinders University) |
| PRISMA 2020 Checklist | Reporting guideline for systematic reviews, with grey literature documentation requirements |
| PRISMA-ScR Extension | Scoping review reporting guideline, specifying grey literature source documentation |
| Grey Literature Report (NYAM) | Database of grey literature in public health from the New York Academy of Medicine |
| CADTH Grey Matters | A practical search tool for health technology assessment grey literature |
| Cochrane Handbook Chapter 4 | Guidance on searching for and managing grey literature in systematic reviews |
Patents as Grey Literature
Are patents considered grey literature?
Yes. Patents are a well-established category of grey literature. They are produced and published outside commercial academic journals, issued by government-affiliated patent offices, and distributed through specialized registries rather than conventional publishing channels. Despite being formal legal documents with a defined registration process, they sit firmly within the grey literature classification because they are not peer-reviewed in the academic sense and are not indexed in most bibliographic databases.
Why are patents relevant to academic and evidence synthesis research?
Patents document novel inventions, processes, and formulations at the point of creation, often years before equivalent findings appear in peer-reviewed journals. In fields such as pharmacology, biotechnology, materials science, and medical devices, the patent literature captures the cutting edge of applied research. A systematic or scoping review in these areas that excludes patents may miss foundational technical evidence about how an intervention works, how it was developed, or whether its underlying mechanism has been independently validated.
Where can patents be searched?
The major freely accessible patent databases include:
- Espacenet (European Patent Office): covers patents from over 100 countries
- Google Patents: broad international coverage with full-text search
- USPTO Patent Full-Text Database: US patents from 1976 onward
- WIPO PATENTSCOPE: international applications filed under the Patent Cooperation Treaty
- J-PlatPat: Japanese patents in English translation
Subscription platforms such as Derwent Innovation and PatSnap offer enhanced analytics and deduplication tools for large-scale patent searching in research contexts. R Discovery also covers more than 7.5 million patents, which makes it a convenient and reliable option for patent searching.
How do patents differ from other grey literature in terms of quality and reliability?
Patents occupy a unique position: they undergo formal examination by patent office examiners for novelty, inventive step, and industrial applicability, which provides a degree of technical scrutiny absent from many other grey literature types.
However, patent examination is not equivalent to scientific peer review. Claims may be broad, contested, or subsequently invalidated. The document reflects what an inventor or assignee sought to protect commercially, which may differ from what has been independently verified as scientifically accurate. Reviewers should treat patents as evidence of technical claims and prior art, not as confirmation of efficacy.
How should patents be evaluated when considering inclusion in a review?
Standard grey literature appraisal tools such as AACODS require adaptation for patents. The following criteria are most relevant:
- Authority: is the assignee a recognized research institution, established company, or independent inventor?
- Date: has the patent been granted, or is it only an application? What is the priority date versus the publication date?
- Scope of claims: do the claims directly relate to the review question, or only peripherally?
- Citation history: has the patent been cited by subsequent patents or academic literature, indicating its uptake in the field?
- Legal status: is the patent still active, expired, or withdrawn? An invalidated patent carries different evidentiary weight.
Should patents be included in the main evidence base or treated separately?
This depends on the review question. For reviews examining the landscape of technological development or innovation, patents may be core evidence. For clinical effectiveness reviews, patents are more appropriately treated as supplementary sources that contextualize mechanism and development history rather than contribute to outcome data. The decision should be stated explicitly in the review protocol, with a clear rationale for how patent evidence will be weighted and reported relative to other source types.
Is it practical to search patents in a time-limited review?
Patent searching can be time-intensive because patent language is highly technical and deliberately broad, and because deduplication across international registries requires care. For time-limited reviews, a pragmatic approach is to search one or two major registries (Espacenet and Google Patents as well as R Discovery) using core technical terms, document the search fully, and acknowledge remaining limitations. For comprehensive reviews in innovation-heavy fields, a patent information specialist or a librarian with patent search experience should be consulted at the protocol stage.
Frequently Asked Questions
Does grey literature count as a legitimate source in academic work?
Yes, grey literature is a legitimate and often essential source in academic research, particularly in evidence synthesis. Review methodologists, including Cochrane, JBI, and PRISMA, explicitly require it. What matters is transparent appraisal of quality and clear documentation of how the source was found and why it was included.
How much grey literature is too much in a systematic review?
There is no prescribed ratio of grey to peer-reviewed literature. Inclusion should be driven entirely by relevance and quality, not by volume. Some systematic reviews include dozens of grey documents; others include none after screening. What matters is that the search for grey literature was comprehensive and documented, regardless of how many documents were ultimately included.
Can I use Wikipedia as grey literature in a review?
Wikipedia is generally not considered an appropriate grey literature source for systematic or scoping reviews. It is an encyclopedic, community-edited source without authorial accountability, citable methods, or verifiable provenance. It may be useful for background orientation or identifying key terms, but should not be cited as evidence in an evidence synthesis.
Is a preprint the same as grey literature?
Preprints occupy a boundary between grey and peer-reviewed literature. They are full research manuscripts posted to servers such as arXiv, bioRxiv, or medRxiv before peer review. Many reviewers treat preprints as a separate category, noting their unreviewed status. Whether to include preprints should be decided prospectively in the review protocol and applied consistently.
How do I handle grey literature that is only available in a language I do not speak?
Language limitations should be acknowledged in the review limitations section. If resources allow, machine translation or professional translation is preferable to exclusion. For some topics, particularly global health and international policy, excluding non-English grey literature introduces a significant language bias that can skew conclusions. Some review teams specifically recruit multilingual reviewers to address this.
Do I need to do a grey literature search for a rapid review?
Rapid reviews involve deliberate scope restrictions to reduce time, and grey literature searching is often abbreviated. However, the decision to limit or omit grey literature searching must be explicitly stated and justified in the methods section. Readers and decision-makers need to know that the evidence base may be incomplete as a result of the rapid approach.
How do I report grey literature in my PRISMA flow diagram?
Grey literature sources are typically reported in the PRISMA flow diagram as separate streams from database searches. Each source (for example, Policy Commons, WHO IRIS, and organizational websites) should be listed with the number of records identified, screened, and included. The PRISMA 2020 update provides an updated flow diagram template that accommodates multiple sources.
My university library does not subscribe to Policy Commons or similar databases. How do I still search grey literature?
Comprehensive grey literature searching does not require paid subscriptions. Google Scholar, direct organizational website searches using domain-restricted Google queries, open-access repositories (OpenDOAR, CORE, BASE), clinical trial registries, and preprint servers are all freely accessible. A number of free aggregators, including the WHO IRIS and the ERIC database, also provide extensive grey literature. Consulting your institutional librarian can also reveal free alternatives or interlibrary loan options.
Comment