I'm doing a presentation at this week's Ontario Library Association Super Conference on a case study of my Canadian War on Science work from an altmetrics perspective. In other words, looking at non-traditional ways of evaluating the scholarly and "real world" impact of a piece of research. Of course, in this case, the research output under examination is itself kind of non-traditional, but that just makes it more fun.
The Canadian War on Science post I'm using as the case study is here.
Here's the session description:
802F Altmetrics in Action: Documenting Cuts to Federal Government Science: An Altmetrics Case Study
The gold standard for measuring scholarly impact is journal article citations. In the online environment we can expand both the conception of scholarly output and how we measure their impact. Blog posts, downloads, page views, comments on blogs, Twitter or Reddit or Stumpleupon mentions, Facebook likes, Television, radio or newspaper interviews, online engagement from political leaders, speaking invitations: all are non-traditional measures of scholarly impact. This session will use a case study to explore the pros & cons of the new Altmetrics movement, taking a blog post documenting recent cuts in federal government science and analysing the various kinds of impact it has had beyond academia.
- Understand what Altmetrics are
- Understand what some pros and cons are of using Altmetrics to measure research impact
- Ways that academic librarians can use altmetrics to engage their campus communities.
Not surprisingly, I've been reading up on altmetrics and associated issues. Since it's something I already know a fair bit about, my reading hasn't perhaps been as systematic as it might be...but I still though it would be broadly helpful to share some of what I've been exploring.
- Altmetrics Wikipedia article
- Developing indicators of the impact of scholarly communication is a massive technical challenge – but it’s also much simpler than that
- Ten Things To Do After You Get Tenure
- Universities are confusing accountability with accountancy
- Why universities should care about Altmetrics
- Altmetrics are the central way of measuring communication in the digital age but what do they miss?
- Why you should not use the journal impact factor to evaluate research
- Ten reasons you should put altmetrics on your CV right now
- Altmetrics: Mistaking the Means for the End
- The 10 most popular academic papers of 2014
- Are 90% of academic papers really never cited? Reviewing the literature on academic citations.
- Exaggerated Claims — Has “Publish or Perish” Become “Publicize or Perish”?
- On “Kardashians” in science and the general relationship between achievement and fame
- A place for citation data
- The Imperative for Open Altmetrics
- The big grants, the big papers: are we missing something?
- How to Make More Published Research True
- Let Me Count the Ways: Top 20 PLOS ONE Articles Based on Article-Level Metrics for 2014
- Altmetrics: What, Why and Where? (ASIST Bulletin Special Section)
- The Right Metrics for Generation Open: a guide to getting credit for Open Science
- How to win citations and rise up the university rankings
- The R-Factor: A Measure of Scientific Veracity
- Proof over promise: Moving citation metric systems beyond journal impact towards a career impact approach.
- The Impact Factor and Its Discontents: Reading list on controversies and shortcomings of the Journal Impact Factor.
- Are research output measures more worthy than critical review?
- NISO Alternative Assessment Potential Action Items
- Do Highly Cited Researchers Successfully use the Social Web?
- Beyond citations: Scholars' visibility on the social Web
- Rise of the Rest: The Growing Impact of Non-Elite Journals
- It’s the Neoliberalism, Stupid: Why instrumentalist arguments for Open Access, Open Data, and Open Science are not enough.
- Sick of Impact Factors
- 4 things every librarian should do with altmetrics
- SPARC Article-Level Metrics
- Metrics market: Measures of research impact are improving, but universities should be wary of their limits.
- Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
- Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics
- A new framework for altmetrics
- Our 2014 predictions for altmetrics: what we nailed and what we missed
Some companies & organizations involved:
- Snowball Metrics
- NISO Alternative Assessment Metrics (Altmetrics) Initiative
- Impact Story
- Plum Analytics
And please do feel free to add any relevant items that I've missed in the comments.