Now on ScienceBlogs: Wuv, Twue Wuv

ScienceBlogs Book Club: Inside the Outbreaks

Christina's LIS Rant

This is my blog on library and information science.

Profile

Christina Pikas Christina K. Pikas is a science and engineering librarian in a special library as well as a doctoral student in information studies.
Any opinions expressed here may not even be her own and certainly do not represent those of any organization willing to be affiliated with her.

Search

Recent Posts

Recent Comments

Archives

Geography

Locations of visitors to this page

Where am I?

N 39 W 76

Research Blogging Awards 2010 Finalist

License

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0.

« NSF Workshop on Scholarly Evaluation Metrics – Afternoon 1 | Main | NSF Workshop on Scholarly Evaluation Metrics – Afternoon 3 »

NSF Workshop on Scholarly Evaluation Metrics – Afternoon 2

Category: Information Sciencebibliometricsscholarly communication
Posted on: December 17, 2009 8:28 AM, by Christina Pikas

Continuing stream of consciousness notes from this workshop held in DC, Wednesday December 16, 2009

Alexis-Michel Mugabushaka. (European Research Council) - intertwined research funding structures at national and European level.

At the national level two main funding modes - institutional (block research funding of higher ed institutions), and competitive.

Orgs structured at European level - like CERN or EMBL. Joint research funding ESF or bi or multilateral. Research Frameworks. ERC

ERC Scientific Council - 22 eminent scientists. Executive Agency (where he works). 2 programs: starting grants, advanced grants.

Evaluation activities of national funding agencies. ESF - 80 orgs, 20 countries. Venue to support members sharing info on evaluation methods. It's not whether or not to fund basic science - that's not on the table for them - they're interested in how to best fund it, what schemes, and what types of research in which areas.

challenge 1 - high quality data: get data without over burdening researchers - allow long term (post project) monitoring of effects

challenge 2 - ?

recent trends - metrics, broader contextual questions, other evaluation questions (societal impact)

wish list - things mentioned earlier, awards and recognition (best paper prizes), better metrics for patents (measuring patents influences universities to patent, but that costs a lot of money, pulling from other areas, and licenses don't always cover). How to reward communicating to a non-academic audience (over value publications over other contributions to the community - tools, software, teaching, public communication, etc).

audience q: also need to add "micro attribution" - how much data is being put in public repositories, how is that data reused.

 

Jan Velterop- Concept Web Alliance - semantic web - forging quality out of quantity. Why publish: record, transfer, credit.

"scientific egosystem" "acknowledgement economy" - all of the standard metrics are popularity contests - not really about quality at all. What does quality look like? An edifice with an ivory tower and a foundation of hard packed rubble (no citations, but support the entire edifice). What if your article has no citations but is heavily used in teaching? It's better quality if it's got more formulas? It's better if you can't understand it?

What about brownie points for commenters on plos1 or f1000.

Nano-publications - triples with attributes like author. what must a publication be? citable, valuable, convey knowledge, full length- no. One number for each concept (in any language). Link to concept wiki for attributes/definition - need browser. So maybe we can have metrics for first use and times reused. Brownie points for annotation. Whole datasets can be triplized. Can be cited. Benefit authors and publishers. see http://bit.ly/6B1XqK (reminds me of a project from Catherine Blake where she's doing text mining for knowledge claims to map them from article to article - but hers seems more sophisticated. Also, Jan doesn't mention if they are linking these concept wiki pages to community accepted naming schemes for genes, chemicals, stars, etc)

Share on Facebook
Share on StumbleUpon
Share on Facebook
Find more posts in: Information Science

TrackBacks

TrackBack URL for this entry: http://scienceblogs.com/mt/pings/127357

Comments

1

"Also, Jan doesn't mention if they are linking these concept wiki pages to community accepted naming schemes for genes, chemicals, stars, etc)"

Yep. We do. Extensively and we try to be comprehensive in that regard. Anyway, you can add accepted names, should you miss any.

Jan

Posted by: Jan Velterop | January 2, 2010 6:36 AM

ScienceBlogs

Search ScienceBlogs:

Go to:

Advertisement
Follow ScienceBlogs on Twitter

© 2006-2011 ScienceBlogs LLC. ScienceBlogs is a registered trademark of ScienceBlogs LLC. All rights reserved.