Altmetrics and Impact Assessment in the Funding Sector: The Wellcome Trust Perspective

Altmetrics and Impact Assessment in the Funding Sector: The Wellcome Trust Perspective
paly

This article discusses the important role of altmetrics in the funding sector and how the Wellcome Trust uses them for impact assessment. It provides an overview of the altmetrics ecosystem, highlighting the importance of consistency, transparency, and availability. The article also introduces the Wellcome Trust, its vision, mission, and research spending.

About Altmetrics and Impact Assessment in the Funding Sector: The Wellcome Trust Perspective

PowerPoint presentation about 'Altmetrics and Impact Assessment in the Funding Sector: The Wellcome Trust Perspective'. This presentation describes the topic on This article discusses the important role of altmetrics in the funding sector and how the Wellcome Trust uses them for impact assessment. It provides an overview of the altmetrics ecosystem, highlighting the importance of consistency, transparency, and availability. The article also introduces the Wellcome Trust, its vision, mission, and research spending.. The key topics included in this slideshow are Altmetrics, impact assessment, funding sector, Wellcome Trust, transparency,. Download this presentation absolutely free.

Presentation Transcript


1. Impact assessment in the funding sector: the role of altmetrics Adam Dinsmore a.dinsmore@wellcome.ac.uk

2. The Wellcome Trust Altmetrics Why they are important to us How we currently use them The altmetrics ecosystem Consistency, transparency, availability Outline

3. Set up in 1936 under the will of Sir Henry Wellcome. Our vision is to achieve extraordinary improvements in human and animal health. Our mission is to support the brightest minds in biomedical research and the medical humanities. We spent approx 538 million on research in FY 2012/13. The Wellcome Trust

4. Current grant portfolio

5. 5 Credit: Piggott et al 2014 (eLife; 10.7554/eLife.04395 ). CC-BY-4.0 Credit: Thomas Forth / Mobile Pie

6. Monitoring progress: WTs key indicators Outcomes Key indicators of progress Discoveries Applications Engagement Research leaders Research environment Influence 1. significant advances in the generation of new knowledge 2. contribute to discoveries with tangible impacts on health 3. contribute to the development of enabling technologies, products and devices 4. uptake of research into policy and practice 5. enhanced level of informed debate in biomedicine 6. significant engagement of key audiences & increased reach 7. develop a cadre of research leaders 8. evidence of significant career progression among those we support 9. key contributions to the creation, development and maintenance of major research resources 10. contributions to the growth of centres of excellence 11. significant impact on science funding & policy developments 12. significant impact on global research priorities and processes

7. The Wellcome Trust: OA Policy Supports unrestricted access to the published output of research as a fundamental part of its charitable mission. Expects authors to maximise the opportunities to make their results available for free. Requires papers be made available through PubMed Central within six months of publication. Provides additional funding to cover open access charges. Encourages Creative Commons Attribution licence (CC-BY). the intrinsic merit of the work, and not the title of the journal in which the authors work is published Affirms the principle that it is the intrinsic merit of the work, and not the title of the journal in which the authors work is published , that should be considered in making funding decisions.

9. o Cited 2904 times; o Normalised Citation Impact = 327; o Acta Crystal D JIF = 7.232 Article level metrics vs. Journal level metrics

10. Current use of altmetrics at Wellcome Engagement/Influence beyond citations

11. MEP Centre for Bioethics MEP Professor of EBM Journal editor Health journalist NGO Health, Population & Nutrition @ The World Bank Engagement/Influence beyond citations

12. Paper cited 9 times to year end 2012. However, tweeted about 164 times; among the highest ever for Nat. Neuroscience . Identity of tweeters possibly indicative of impact on policy, public debate. Science journalist, Author Editor, Medical History Intelligence Consultant Engagement/Influence beyond citations

13. 2012 Trust-associated paper in PLOS Neglected Tropical Diseases . Cited very few times, but discussed extensively on social media. However, likely due to funny title rather than genuine public engagement.

14. Monitoring progress: WTs key indicators Outcomes Key indicators of progress Discoveries Applications Engagement Research leaders Research environment Influence 1. significant advances in the generation of new knowledge 2. contribute to discoveries with tangible impacts on health 3. contribute to the development of enabling technologies, products and devices 4. uptake of research into policy and practice 5. enhanced level of informed debate in biomedicine 6. significant engagement of key audiences & increased reach 7. develop a cadre of research leaders 8. evidence of significant career progression among those we support 9. key contributions to the creation, development and maintenance of major research resources 10. contributions to the growth of centres of excellence 11. significant impact on science funding & policy developments 12. significant impact on global research priorities and processes

15. Monitoring progress: WTs key indicators Outcomes Key indicators of progress Discoveries Applications Engagement Research leaders Research environment Influence 1. significant advances in the generation of new knowledge 2. contribute to discoveries with tangible impacts on health 3. contribute to the development of enabling technologies, products and devices 4. uptake of research into policy and practice 5. enhanced level of informed debate in biomedicine 6. significant engagement of key audiences & increased reach 7. develop a cadre of research leaders 8. evidence of significant career progression among those we support 9. key contributions to the creation, development and maintenance of major research resources 10. contributions to the growth of centres of excellence 11. significant impact on science funding & policy developments 12. significant impact on global research priorities and processes

16. What were currently exploring Credit: Statistical Cybermetrics Research Group, University of Wolverhampton.

17. What were currently exploring Credit: Statistical Cybermetrics Research Group, University of Wolverhampton.

18. What were currently exploring

19. Altmetrics ecosystem Consistency (of definitions) Transparency Availability

20. Altmetrics ecosystem - Sources of data We need metrics data which is consistent in its source and meaning in order to enable sensible comparisons between outputs of different schemes Differences between publisher-provided data mean that, primarily, we use third-party data providers: Thomson Reuters Web of Knowledge Altmetric

21. Differences in citation data

22. For a sample of 358 Wellcome-associated papers, on average: WoS had 10 cites per paper Scopus 12 cites per paper Google Scholar 18 cites per paper Differences in citation data

23. Summary: The Wellcome Trust is interested in all of the different types of impact which arise from the work it supports (and numerous means of measuring it). Therefore delighted that helpful tools are being developed. Greater consistency , transparency , and availability would serve the Trusts requirements.

24. -Thank You- Adam Dinsmore Wellcome Trust Strategic Planning & Policy Unit a.dinsmore@wellcome.ac.uk

Related