Do Altmetrics Work? Twitter and Ten Other Social Web Services

Summary

Altmetric measurements derived from the social web are increasingly advocated and used as early indicators of article impact and usefulness. Nevertheless, there is a lack of systematic scientific evidence that altmetrics are valid proxies of either impact or utility although a few case studies have reported medium correlations between specific altmetrics and citation rates for individual journals or fields. To fill this gap, this study compares 11 altmetrics with Web of Science citations for 76 to 208,739 PubMed articles with at least one altmetric mention in each case and up to 1,891 journals per metric. It also introduces a simple sign test to overcome biases caused by different citation and usage windows. Statistically significant associations were found between higher metric scores and higher citations for articles with positive altmetric scores in all cases with sufficient evidence (Twitter, Facebook wall posts, research highlights, blogs, mainstream media and forums) except perhaps for Google+ posts. Evidence was insufficient for LinkedIn, Pinterest, question and answer sites, and Reddit, and no conclusions should be drawn about articles with zero altmetric scores or the strength of any correlation between altmetrics and citations. Nevertheless, comparisons between citations and metric values for articles published at different times, even within the same year, can remove or reverse this association and so publishers and scientometricians should consider the effect of time when using altmetrics to rank articles. Finally, the coverage of all the altmetrics except for Twitter seems to be low and so it is not clear if they are prevalent enough to be useful in practice.

Related articles

• Contemporary World Module Lesson 1: United Nations (UN)

  This document provides an overview of the United Nations, detailing its establishment, objectives, core mechanisms, and how it promotes peace, human rights, and economic development among nations.

• Comprehensive Overview of Rural Development, Environmental Issues, and Economic Planning

  This document provides a detailed analysis of various aspects of rural development, environmental concerns related to climate change, and the principles of economic planning. It discusses key terms and concepts relevant to agriculture, sustainability, and economic policy.

• What Is a Good Tomato? A Case of Valuing in Practice

  This article explores the complexities of valuing tomatoes through interviews with various stakeholders in the Netherlands, focusing on the multifaceted criteria used to determine what makes a 'good' tomato, and how these values are shaped by practices and experiences.

• Efficient Ontology-Mediated Query Answering: Extending DL-liteR and Linear & CH

  This paper proposes a language that extends DL-liteR and allows for query answering via rewriting into unions of conjunctive two-way regular path queries. It explores the expressive power of the new language while ensuring efficient query answering mechanisms.

• AQUILA PERPETUA The Eagle That Does Not Fall Volume One: Mare Nostrum, World

  This document presents a rich narrative exploring themes of ambition, legacy, and the intersection of history and fantasy as it follows Gaius Aurelius Varro, who grapples with his past life while navigating a new existence in a vibrant, alternate Roman world.