Academic Publishing, Evaluating Academics, and Advising Students

Peter Lawrence has an opinion piece in Current Biology on the problems with evaluating scientists, amongst other things. He hits upon a few important points, including journal impact factors, the cost of high risk research, hyping up publications, and networking with the right people to improve your publications. One passage was quite salient given a private discussion I've been having with some folks:

Fourth, there is the way that science is done and papers are authored. These measures are pushing people into having larger groups. It is a simple matter of arithmetic. Since the group leader authors all the papers, the more people, the more papers. If a larger proportion of young scientists in a larger group fail, as I suspect, this is not recorded. And because no account is taken of wasted lives and broken dreams, these failures do not make a group leader look less productive. I believe the need to maximise publications is also causing students to be treated more like technicians. Thus, increasingly, students are told what to do, so they miss out on learning how to become researchers. Also, group leaders often write up their students' work: if the writer is not fully aware of the results or exactly how they were obtained this can conveniently permit a more adventurous interpretation of the data. Ignorance can be turned into bliss if the outcome is publication in a higher impact journal. The downside is that papers may be less truthful, not something that is easily measured. Certainly, the student does not get a proper education and may not find his or her PhD period enjoyable -- however, even this can be advantageous for the group leader, as that student is less likely to go on and become a competitor!

There's a lot covered in that one paragraph, but I've emphasized one point: the role of grad students. While I have noticed a lot of technician style grad-students, I'm happy to say that most of the grad students I know are not merely following directions. This is especially true in the fields of ecology and evolution, where one grad student or post-doc can design and carry out an independent research project in the span of a few years. In other fields, it seems like grad students are much more tied to the projects being carried out in their adviser's lab, to the point that they are given a small question to address that will somehow fit into a larger puzzle that the adviser is trying to work out.

Lawrence's main focus is on how institutions (funding agencies, universities, etc) evaluate academic performance. Because this relies heavily on publishing records (securing external funding is also important), he discusses the publishing industry quite extensively. I'm pleased that he spends a fair bit of text on giving appropriate credit to authors on scientific papers, but it would have also been nice to see some mention of open access publishing as a simple way to make one's research more visible (without employing some of the more deplorable maneuvers that Lawrence warns against). But, alas, Current Biology is a non-Open Access journal, so that's not their point of emphasis, although they did let Michael Ashburner shout out for the cause.

Kevin at The Other 95% offers his perspective as a taxono-systematic-ecologist.

Lawrence PA. 2007. The mismeasurement of science. Curr. Biol. 17: R583-R585. doi:10.1016/j.cub.2007.06.014

More like this

tags:, H-index, impact numbers, scientific journals A friend, Ian, emailed an opinion paper that lamented the state of scientific research and the effect this has had on science itself. In this paper, by Peter A. Lawrence, a Professor of Zoology at University of Cambridge, the…
This morning, I learned that congress wants to reverse the advances made by NIH and go back to restricting access to scientific publications. Congresswoman Carolyn Maloney (New York) and Congressman Darrell Issa (California) are co-sponsoring a bill to restore the limits on public access to NIH-…
The academic world has lots of dark nooks and crannies not usually seen by the general public. One of them is the order in which authors are listed on a publication. If you have six people from two or three laboratories collaborating on an important paper, who will be the "senior author." And what…
Over at Kevin Drum's blog, there is an interesting exchange between Drum and an unnamed college professor. In a post that was primarily about issues related to paying for a college education, Drum wrote: The fact is that UCLA provides undergraduates with an education that's just as good as…

I was introduced to this recently: I am an undergrad student and I participated in an REU program this summer. Although my funding purchased crucial equipment and software for our study, and I participated in every day of field data collection, and entered all the data into the computer (totaling over 30 hours of data entry per week) and wrote the manuscript for the paper, I was still listed as 4th author, behind the professor (understandable) and two other undergrads from the home institution. When I tenatively asked to be moved up, the professor said it was fine but one of the other students pitched a fit, sent an e-mail out to the entire lab about how insignificant I had been to the project and how he could have done it all just as well without me, etc etc. The professor, who has to deal with this guy even after I went home, cowed to him.

The role of students is an interesting point, and one, I feel, differs from department to department, and to a certain extent, form country to country.

Here in the UK, and maybe in my subject, there are fewer production line labs than else where, and North America in particular...

Cammy, if all is as you describe, you need to pursue this more and not accept a "cowed" PI decision. "I coulda done it" is not a reason for a superior authorship position in my view. Contributing to data generation via funds awarded to you, collecting data and drafting a manuscript are serious contributions.

On the other hand, you need to be realistic if you contributed to only a portion of the eventual study. Then it gets into the relative contribution of each part, of course.

Remember, PIs tend to hate confrontation and will take the easy way out where possible. Don't let you-getting-hosed be the easy way out if you really deserve more.

(came to your blog for the first time)
i read that article too, and it rings a lot of bells.