Official Comment Count: 1,035,033

Neurotopia (version 2.0)

Stronger. Faster. Bloggier. Now chock full of glial goodness. **Warning** contains neuro-nuts.

Profile

EVIL.jpg The Evil Monkey has a Ph.D. in Neuroscience from a southeastern university. After a postdoctoral nightmare of Inquisitorial proportions, he is currently working in a laboratory and teaching at a local community college. He is still not sure why he wrote this paragraph in the third person, and for that reason is beginning to doubt his sanity. How many freakin' people can fit into his head, anyway? No wait, my head. Oh crap.


Scicurious.jpg Scicurious is a graduate student wrestling with a PhD in Physiology and Pharmacology at a southern institution. She is a nerd, a geek, and also a dork, which takes up a lot of her free time. She sees nothing wrong with talking about herself in the third person, and wonders why Evil Monkey is so freaked out about it.

Disclaimer: The opinions on this blog do not represent any organization to which we may belong, or employers, or basically anybody but us. So there.

Currently Reading

On My Nightstand
cover

Up Next
cover

Search this blog

Recent Posts

Categories

Blogroll

Archives

Subscribe via Email

Stay abreast of your favorite bloggers' latest and greatest via e-mail -- select a daily digest or instant updates and never miss a post again.


Neurotopia See updates in real time with Neurotopia's RSS feed.

Other Junk

Locations of visitors to this page


Add this blog to my Technorati Favorites!

Steal This Button and Link Here!
neurobutton.png

« My first 5K | Main | Getting in over my head »

Worthless grant review comments

Category: Academia
Posted on: July 23, 2008 9:28 AM, by Evil Monkey

We've all had that R21 or R03 come back with completely useless comments. Months and months of work, hours or weeks spent in the lab collecting that preliminary data (which is supposedly unnecessary for those R21s). More time spent waiting and waiting. Revisions. Resubmissions. The same useless comments back to you.

Come on. We all know it's a racket. In a tight funding climate, nobody in charge of the purse strings wants to fund a competitor. But they gotta find a way to reject your grant in a way that is completely noncommittal. Hence, weasel words.

Here's my favorite: "The proposed studies are not unique". With this simple, vague statement, any hopes of funding a decent or important project are quashed. Think that study will fill in a crucial hole in the literature? Screw you. Your project isn't unique enough.

"Unique" or "innovative", or other similar words have pretty much whatever meaning the reviewer wants them to have. Or needs them to have. But what does uniqueness matter, really? Some of the most informative developmental neurobiology work, for example, still relies heavily on chick embryo limb bud removal; a technique developed about a century ago, requiring little more than a tungsten needle and a microscope. Apply some simple histochemical procedures (which date back even farther) and a few molecular biology techniques (which are about as ubiquitous as you can get), and you can potentially rewrite our understanding of the developing nervous system. Yet on the surface, standard fare. Sorry bud, your project just got pigeon-holed. I've seen some great grants go down in flames this way, grants that were either conceptual genius or exceedingly relevant to a health-related issue. The most egregious example I saw was an R01 dealing with the potential for soy phytoestrogens (as an unregulated dietary supplement) to affect behavior and pathology in a model of aging and dementia. This grant-- beautifully designed to address a number of questions relevant to the health of postmenopausal women-- scored right at the payline on the first review, just missing funding, but then subsequently triaged on both resubmissions. The payline shifted, the grant got rerouted to another, much more competitive study section, and suddenly the grant was "not innovative".

The best part? You revise and resubmit according to the reviewer's useless comments, and you get the exact same comments back again.

So what's your favorite useless grant criticism?

Comments

"The experiments are descriptive". I once took part in a PPG application that would have determined whether the sex chromosomal complement or the gonadal hormones contributed to a sex difference in hypertension. The grant was highly mechanistic to us, but it got the "the aims are descriptive in nature" kiss of death. What exactly does this criticism mean? Since when is descriptive science useless science??

Posted by: Darren | July 23, 2008 10:15 AM

Totally agree that "Too descriptive" is highly annoying. Unfortunately, it's a grant killer.

Posted by: Zen Faulkes | July 23, 2008 11:17 AM

hmm. I'm trying to decide if doing a little research project by going back through my vast collection of summary statements is going to raise my bloodpressure too high before I extract enough laffs...

in the meantime, a little advice on reading summary statement tea leaves....
http://drugmonkey.wordpress.com/2007/06/05/summary-statement-tea-leaves/

Posted by: DrugMonkey | July 23, 2008 12:23 PM

ahh, what the heck, I'll repost that baby over here and see if we can get some additional discussion....

http://scienceblogs.com/drugmonkey/2008/07/repost_summary_statement_tea_l.php

Posted by: DrugMonkey | July 23, 2008 12:47 PM

the grant got rerouted to another, much more competitive study section

How did this happen?

Posted by: whimple | July 23, 2008 1:12 PM

A study section from one institute got rolled into another.

Posted by: Evil Monkey | July 23, 2008 1:48 PM

From the frau's R01 renewal
Reviewer 1

Insights gleaned from these analyses will be important for understanding NOUN development, should inform the understanding of GENE2 gene function in other contexts as well. Overall significance is excellent.

Reviewer 2
That being said, however, the impact of this proposal is not especially high. How much do we care whether GENE1 acts upstream of GENE2 genes, as well as downstream? Analysis of the differential function of specific GENE1 genes is useful information, but not groundbreaking.

The only quibble here is that the prevailing paradigm is that the two genes are co-factors. If as the frau's data shows, GENE1 is actually a master regulator that controls GENE2, then this work is not only groundbreaking, it will change the way we look at development biology. If I left the magic letters in there, the uproar from the audience would be deafening. The researchers in GENE2 are notable and numerous; however, they cannot bear with the thought that their particular gene is controlled by another gene.
Despite Reader #1's enthusiastic response about this renewal, this did not make it past the second reviewer. Unfortunately, the politically connected and sophists control the direction of science.

Posted by: Onkel Bob | July 23, 2008 3:38 PM

1. Project is too narrow.
2. Project is too broad.
Surprisingly, you can hear both of these comments for THE SAME GRANT.

Also:

Reviewer #1: Techniques are highly innovative.
Reviewer #2: Techniques are not innovative.
Same grant, same review, same round.

Posted by: drdrA | July 23, 2008 5:15 PM

It occurs to me that this kind of disagreement is similar to what happened with Sizzle: different scientists have completely different takes on the same science. Except I'm guessing your grant was probably much better than Sizzle. ;)

Seriously. . . I know it's very, very frustrating. Sorry. :(

Posted by: bioephemera | July 23, 2008 6:57 PM

Is it common knowledge what this "Sizzle" thing is? Can someone please clue me in?

Posted by: whimple | July 23, 2008 9:15 PM

Is it common knowledge what this "Sizzle" thing is? Can someone please clue me in?

The first rule of Sizzle is: there is no Sizzle.

Posted by: cashmoney | July 23, 2008 10:23 PM

" The PI is studying a highly significant human pathogen, ****, and has exciting preliminary observations that suggest a novel vaccine strategy. This proposal will test the *** as vaccines in order to further describe the system. No mechanistic studies are planned as these are part of another application. The identification of the **** is high risk but high impact. Taken together, there is enthusiasm for the system and the investigators, but it is dampened by the likelihood that when it is all said and done, we will not have any better understanding of how this works or does not."

A quote from my recent A2 review. Maybe best described as sizzle to fizzle in under a single paragraph?

Posted by: TeaHag | July 23, 2008 11:56 PM

Maybe this is a stupid question, but is there an online resource that explains the entire grant review process (NIH, NSF, whatever)? I'm going into grad school and while I've helped two PIs with writing and revising their grants I don't really know what the process is like outside reading a few posts (like this and those on DrugMonkey). I figure learning about the process early will hopefully give me an edge over other students once in grad school.

Posted by: Steve | July 24, 2008 12:19 AM

Maybe this is a stupid question, but is there an online resource that explains the entire grant review process (NIH, NSF, whatever)
The NIH review - study section has been described to me as a clusterf*ck ala your worst nightmare's grading session. Usually a study section is assigned a pile of grants and asked to evaluate them. Two or three reviewers take a set, another two or three take another set, and so on. Depending on the study section anywhere from 4 to 15 reviewers participate. The selected reviewers study the ones they are assigned intently and draw a conclusion and skim the rest. They then all get together and "discuss." If a reviewer really likes a application and is charismatic, that person can get the rest to score the grant on the high side. The contrary is also true if the person dislikes the grant (or doesn't understand it) and is persuasive, that person can sink the grant. This all occurs over a couple of days. (The frau sat on study section for 4 days) The other wild card is the grant officer - that person can shepherd - push - guide a grant to a favorable conclusion by placing it in a friendly study section or one where they have some influence. Again, the reverse is also true, a grant officer that is a frustrated and jealous scientist (not uncommon) can be a real hinderance to getting funded. To paraphrase the Borg: "Existence is futile, your grant will be triaged."

Posted by: Onkel Bob | July 24, 2008 1:02 AM

Thank you very much Bob.

Posted by: Steve | July 24, 2008 9:43 AM

Steve,

NIAID has an excellent grants tutorial page:
http://www.niaid.nih.gov/ncn/grants/default.htm

You may find the annotated R01 (an actual grant that fared very well in review with detailed comments to explain what was good about it) and the mock study section video especially useful.

Posted by: BugDoc | July 24, 2008 10:52 AM

Post a Comment

(Email is required for authentication purposes only. Comments are moderated for spam, your comment may not appear immediately. Thanks for waiting.)





Having problems commenting? (UPDATED)

Blogs in the Network

Advertisement

Top Five: Most Active

  1. Those crazy Brits 10.13.2008 · PZ Myers
  2. Why Evolution is True 10.13.2008 · PZ Myers
  3. If McCain loses, God's Reputation Will Suffer 10.13.2008 · Ed Brayton
  4. Infinity is NOT a number 10.13.2008 · Mark C. Chu-Carroll
  5. McCain on Negative Attack Ads 10.13.2008 · Ed Brayton

Search All Blogs