It takes a village

Submitted by Liz Allen on Fri, 2008-05-30 10:30.

In the 10 months since we launched Ratings, some folks have readily used them to score papers - we'd like them to be joined by more so that we can build a critical mass of opinion about the relative importance of papers, and allow ratings to highlight the ‘best’ papers. The opinion of one person, two peer reviewers or even a group of Board Members may not be as relevant as the opinion of a group of interested and motivated readers – and that is what we are seeking to encourage with this post.

All PLoS ONE articles are peer-reviewed using criteria which measure the technical merit not the perceived importance – therefore all PLoS ONE papers are worthy of being published, but clearly some are more ‘important’ than others. We believe that deciding how ‘important’ or ‘good’ an article really is should be done in public by as many of those using the work as possible through ratings (and comments).

Ratings are therefore the quickest and easiest way for users to indicate to the world where they believe a piece of work sits in the spectrum of importance. When you rate a paper, you score it on Insight (how thought provoking it is), Style (how elegant it is) and Reliability (how secure it is) - these combine into an "at a glance" feel for the importance of the work indicated by five stars. It takes less than two minutes to rate an article and if enough of us do it, the results will form a useful indication of whether the work is influential, saving time and effort down the line.

1. To help out your colleagues and yourself - if you've spent a considerable amount of time reading an article, it makes sense to spend two minutes rating it at the end. That way next time you are trying to figure out whether to spend time reading an article, hopefully someone you trust will have rated it and shared their opinion helping you to make a faster decision. It's the "what goes around comes around" philosophy.

2. To build a critical mass of opinion - the next time you see an article with one rating and you think that this is not enough information on which to decide its importance and you read it, add your rating to it.

3. To change the way science is done - if you believe in a fairer more open system where researchers decide the importance of what they read then please contribute to making this a success.

4. To build yourself a solid online reputation - in the interests of transparency, ratings are not anonymous (although it's worth knowing that it is only the ‘user name’, not the user’s real name or their email, that is publicly disclosed). and that's to the good for thoughtful contributors who should have the confidence to share their opinions (even if others publicly disagree there are rules of engagement on the site and a moderator to enforce them). In the future of scientific and medical publishing, where we hope open access is the gold standard, different ways of evaluating a person's contribution to science will emerge and this could become one of them.

Of course, it would be nice if rating brought money, power and prestige and maybe in time it will but for the time being we're asking you to rate for the same reason as many of you undertake peer-review, because a better future depends on it. 

Trackback URL for this post:

http://www.plos.org/cms/trackback/357
from Biology on Fri, 2008-09-19 01:32

Now that PLoS ONE is publishing daily (OK, not really, only on work-days, i.e., 5 times a week), I have

from A Blog Around The Clock on Tue, 2008-08-05 19:48

There are 69 new articles in PLoS ONE this week. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers. Here are my own picks for the week - you...

from A Blog Around The Clock on Thu, 2008-07-31 18:08

So, let's see what's new in PLoS Genetics, PLoS Computational Biology, PLoS Pathogens and PLoS Neglected Tropical Diseases this week. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers....

from A Blog Around The Clock on Wed, 2008-07-30 15:43

There are new articles in PLoS ONE this week. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers. Here are my own picks for the week - you go...

from A Blog Around The Clock on Tue, 2008-07-29 20:54

There are 62 new articles in PLoS ONE this week. As always, you should rate the articles, post notes and comments and send trackbacks when you blog about the papers. Here are my own picks for the week - you...

from A Blog Around The Clock on Sat, 2008-05-31 13:05

Bouphonia: The Conservatism to Come. SciCurious: Weird Science: it's Friday!. Since I do not have time and energy for my Friday Weird Sex Blogging series, I am glad that someone picked up on it. This post is about condoms and...

( categories: )

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
Submitted by home based business (not verified) on Fri, 2008-08-01 11:28.

It would help you get more people to rate the articles if there was an incentive of some sort. Maybe some way of indicating that they are an active member of the community like a star behind their name or some such thing.