The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching

Summary

Google Scholar (GS), a commonly used web-based academic search engine, catalogues between 2 and 100 million records of both academic and grey literature (articles not formally published by commercial academic publishers). Google Scholar collates results from across the internet and is free to use. As a result it has received considerable attention as a method for searching for literature, particularly in searches for grey literature, as required by systematic reviews. The reliance on GS as a standalone resource has been greatly debated, however, and its efficacy in grey literature searching has not yet been investigated. Using systematic review case studies from environmental science, we investigated the utility of GS in systematic reviews and in searches for grey literature. Our findings show that GS results contain moderate amounts of grey literature, with the majority found on average at page 80. We also found that, when searched for specifically, the majority of literature identified using Web of Science was also found using GS. However, our findings showed moderate/poor overlap in results when similar search strings were used in Web of Science and GS (10–67%), and that GS missed some important literature in five of six case studies. Furthermore, a general GS search failed to find any grey literature from a case study that involved manual searching of organisations’ websites. If used in systematic reviews for grey literature, we recommend that searches of article titles focus on the first 200 to 300 results. We conclude that whilst Google Scholar can find much grey literature and specific, known studies, it should not be used alone for systematic review searches. Rather, it forms a powerful addition to other traditional search methods. In addition, we advocate the use of tools to transparently document and catalogue GS search results to maintain high levels of transparency and the ability to be updated, critical to systematic reviews.

Key Points

• 1Google Scholar contains moderate amounts of grey literature but often misses important references
• 2Searches should focus on the first 200-300 results for effective grey literature identification
• 3There is only moderate overlap between Google Scholar and Web of Science results
• 4Google Scholar is a valuable supplementary tool but not a replacement for traditional academic databases
• 5Search results can be improved by documenting and cataloguing Google Scholar searches transparently.

Related articles

• Absolutely. I based this on the 4th edition of Essentials of

  Absolutely. I based this on the 4th edition of Essentials of Nursing Informatics that you uploaded. The book identifies Chapter 17 as “Theories, Models, and Frameworks” and Chapter 32 as “The Nursing

• Anatomy and Physiology of the Respiratory System

  This document provides a detailed overview of the anatomy and functions of the respiratory system, including structures, gas exchange mechanisms, and respiratory physiology. It covers both upper and lower respiratory tract components, physiological processes involved in breathing, and the impacts of various factors on respiratory health.

• Blood Vessels and Circulatory System Functions

  This document provides an extensive overview of blood vessel functions, classifications, structures, and the circulatory system's physiology. It details systemic and pulmonary circulation, highlighting the anatomy and roles of various arteries and veins.

• Functions and Anatomy of the Lymphatic and Immune Systems

  This document provides an overview of the lymphatic system's functions, anatomy, and its role in immunity, detailing structures such as lymphatic vessels, nodes, and organs. It also covers innate and adaptive immunity, including responses to foreign substances and the production of immune cells.

• The Endocrine System

  This document provides a comprehensive overview of the Endocrine System, detailing the various glands, hormones they secrete, and their effects on bodily functions. It explores the roles of each gland, the hormones involved, and the feedback mechanisms that regulate hormone levels.