The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching

Summary

Google Scholar (GS), a commonly used web-based academic search engine, catalogues between 2 and 100 million records of both academic and grey literature (articles not formally published by commercial academic publishers). Google Scholar collates results from across the internet and is free to use. As a result it has received considerable attention as a method for searching for literature, particularly in searches for grey literature, as required by systematic reviews. The reliance on GS as a standalone resource has been greatly debated, however, and its efficacy in grey literature searching has not yet been investigated. Using systematic review case studies from environmental science, we investigated the utility of GS in systematic reviews and in searches for grey literature. Our findings show that GS results contain moderate amounts of grey literature, with the majority found on average at page 80. We also found that, when searched for specifically, the majority of literature identified using Web of Science was also found using GS. However, our findings showed moderate/poor overlap in results when similar search strings were used in Web of Science and GS (10–67%), and that GS missed some important literature in five of six case studies. Furthermore, a general GS search failed to find any grey literature from a case study that involved manual searching of organisations’ websites. If used in systematic reviews for grey literature, we recommend that searches of article titles focus on the first 200 to 300 results. We conclude that whilst Google Scholar can find much grey literature and specific, known studies, it should not be used alone for systematic review searches. Rather, it forms a powerful addition to other traditional search methods. In addition, we advocate the use of tools to transparently document and catalogue GS search results to maintain high levels of transparency and the ability to be updated, critical to systematic reviews.

Related articles

• Introduction to Applied Social Sciences

  This document is a lecture on applied social sciences that discusses its interdisciplinary nature, theories, and the application of various social science disciplines to address societal issues, including counseling, social work, and communication.

• INTRODUCTION: TĀ-VĀ (TIME-SPACE): THE BIRTH OF AN INDIGENOUS MOANA THEORY

  This article introduces the Tā-Vā (Time-Space) Theory of Reality, an indigenous Moana theory emerging from the Association of Social Anthropology in Oceania that critiques traditional Western notions of time and space through a cultural lens.

• Comparative Analysis of Taxonomic Classifications and Patent Law

  This document provides a comparative analysis of three papers spanning over two decades, discussing taxonomic classification approaches in biology and their implications for patent law, particularly in relation to evolutionary change and nomenclature instability.

• The Potential of Va Part 2: Theoretical Frameworks of the Va

  This article is part of a series exploring practice-led research and its significance through the lens of the Samoan concept of va, examining themes of identity, space, and cultural ideologies.

• Contemporary World Module Lesson 1: United Nations (UN)

  This document provides an overview of the United Nations, detailing its establishment, objectives, core mechanisms, and how it promotes peace, human rights, and economic development among nations.