Seed Media Group

Reality is always more complicated than you think.

Profile

jake-head-shot.jpgJake Young is a MD/PhD student at Mount Sinai School of Medicine focusing in Neuroscience. He is due to graduate in 2032. He received a BS and a MS in Biological Sciences from Stanford University -- where he spent most of his time drinking heavily and building vegetable catapults instead of learning information that would now be eminently useful. When he is not failing terrifically to perform his sworn duties, he enjoys watching bad movies, ethnic food, and running.

Pure Pedantry is a blog about science -- social sciences and otherwise -- as well as academic and scientific culture. No one can live on science alone, so I also like to dwell on pop culture, periodically explore the humanities, and indulge in other types of geeky goodness.

Jake is joined periodically by two wonderful guest bloggers: Kara Contreary and Kate Seip. See the About Page.

DISCLAIMERS: 1) Jake Young is not a licensed physician (yet). He is merely a medical student. The information published on this site is not intended for use in medical decision making. Please seek advice from a licensed, medical professional before making any health decisions. 2) The opinions expressed are my own or those of my co-bloggers. They do not represent the views of SEED magazine or the educational establishments we currently attend.

Search this blog

Archives

Blogroll


raptor.jpg

« Would you like a Simpsons avatar? | Main | How much do you get for each dollar spent on research? »

Equal time in science -and- distinguishing science from non-science

Category: Ethics
Posted on: July 11, 2007 10:23 AM, by Jake Young

Johnathan Wolff publishing in the Guardian cites the case of Naomi Oreskes as to why the equal time idea of journalism doesn't work for science:

I learned to shut my mouth on the topic after hearing a lecture from a San Diego philosopher of science, Naomi Oreskes, who reported the results of a review of the scientific literature on global warming. Not one peer-reviewed scientific article, of the hundreds she surveyed, denied that the earth was warming or that human action was at least partially responsible. The sceptics, she argued, were largely members of independent thinktanks, often sponsored by companies with vested interests, publishing their own reports without external review.
A little later, Oreskes published her findings in the leading journal Science, and was immediately shot down by bloggers, journalists and thinktankers, who mixed insults about her honesty with more plausible-sounding complaints about her methodology. Oreskes replied, with great restraint, that she would wait for the peer-reviewed criticisms.

But if Oreskes is right, why do so many people think there is an active scientific debate? One reason is that few people appreciate the difference between peer-reviewed journals and thinktank reports. But even worse, she argued, is the influence of the media: you knew that was coming, didn't you?

In fact, she makes an excellent point. Journalistic ethics require balance. In reporting political arguments, each claim must be countered so that a lively debate can take place and readers come to their own views (well, that's the theory). Oreskes suggests that journalists have mistakenly applied the same ethical code to scientific reporting. Whenever a story on climate change is produced, a maverick nay-sayer is rolled out for the sake of balance. But this misleads the public into thinking that a few lone voices have equal weight to the scientific orthodoxy.

The same thing happened when a scientific consensus was forming around the theory that HIV causes Aids. A small number of scientists questioned the hypothesis and received a disproportionate share of attention. The false appearance of wide scientific disagreement gave policy-makers in some countries an excuse to delay the introduction of prevention and treatment programmes, with tragic results.

How well equipped are we non-scientists to understand scientific discussions? We all study science for a few years, but learn - or at least remember - very little about methodology. Science is presented as a body of known truths. As adults, though, we need to know not the atomic number of chlorine, but how to assess evidence for or against a theory. (Emphasis mine.)

1) I agree with Wolff that science possesses no strong impulse to equal time, and that this is probably good. We don't do equal time because scientific debate is conducted through the screen of peer review. A system where all ideas would receive equal weight would lack such a filter.

Though some people would argue that this screen out dissonant views, this has not been my experience with the system in practice. What the system in practice screens out is views without evidence or views that require ad hominem attacks to make them sound reasonable. I have never heard of a paper that was denied access to a journal on the grounds that the evidence it showed was unfortunate -- most of those papers get fast-tracked to the best journals because everyone likes the publicity.

Someone might respond: what about papers denying evolution and advocating intelligent design? An argument based on the absence of evidence is not equivalent to an argument based on the presence of evidence. To get in a journal you have to propose counter-evidence, not just a counter-argument.

2) Non-scientists often seemed bewildered by the difference between scientific and journalistic discourse, but I have always found them very easy to distinguish. It is not done -- as some have suggested -- by looking at the origin of the information because some scientists do spout nonsense that isn't science from time to time and some journalists make scientific arguments. And, even though I noted above that the process is intrinsic to science, peer-review is not always a perfect guide to scientific validity (although it is a pretty good one)

From a practical point of view, here are two handy principles by which a scientific argument is identified:

  • 1) A scientific argument is based on evidence and only evidence. By evidence, I mean experiment, derivation of conclusions from experiments, or explication of mathematical or logical principles derived from experiment.
  • 2) A scientific argument is never based on evaluation of the merits of the speaker, the ideological background of the institution where the speaker works, or the social history of the field.

If you find an argument that violates either of those two principles, it is not a scientific one -- even if it is being spoken by a scientist.

(Incidentally, I have never read Oreskes article, so I cannot say anything about the validity of that particular example.)

Hat-tip: Peer-to-Peer

Comments

As far as newspapers are concerned, I just don't think journalistic integrity really comes into play anymore. I don't think they present opposing views to maintain ethical 'balance'. I think they do it to avoid pissing off the large number of scientifically ignorant readers who choose to believe various nonsense for political or religious reasons. If the newspaper stands to make more money catering to their ignorance than reporting honestly, I doubt they even think twice.

Posted by: No1Uno | July 11, 2007 11:17 AM

"A scientific argument is based on evidence and only evidence. By evidence, I mean experiment, derivation of conclusions from experiments, or explication of mathematical or logical principles derived from experiment."

I think I agree with the "sentiment" you express here, but in point of fact, there is no mathematical or logical principle that is "derived from experiment." For example, there is no need to refer to empirical data to utterly demolish a scientific argument that is illogical or that involves errors of calculation.

Posted by: bob koepp | July 11, 2007 11:40 AM

The Oreskes study is essentially a construct to try and re-inforce the idea of "consensus" and "beyond debate", when the opposite is the case. It has however been used time and time again, including by Al Gore, to try and deny any debate exists.

Dr Benny Peiser of Liverpool University, analysed all abstracts listed on the ISI databank for 1993 to 2003 using the same keywords ("global climate change") as the Oreskes study. Of the 1247 documents listed, only 1117 included abstracts (130 listed only titles, author(s)' details and keywords).

Peiser says, "Oreskes claims to have analysed 928 abstracts she found listed on the ISI database using the keywords "climate change". However, a search on the database using the keywords "climate change" for the years 1993 - 2003 reveals that almost 12,000 papers were published during the decade in question.

What happened to the countless research papers that show that global temperatures were similar or even higher during the Holocene Climate Optimum and the Medieval Warm Period when atmospheric CO2 levels were much lower than today; that solar variability is a key driver of recent climate change, and that climate modeling is highly uncertain?

He further says, "...it is beyond doubt that a sound and unbiased analysis of the full ISI databank will find hundreds of papers (many of which are written by the world's leading experts in the field) that have raised serious reservations and outright rejection of the concept of a "scientific consensus on climate change". The truth is, that there is no such thing!"

Posted by: Harbinger | July 12, 2007 2:54 AM

but in point of fact, there is no mathematical or logical principle that is "derived from experiment."

EVERY mathematical and logical principle is derived from experimental observations. The experiments usually take place inside the cranium, so many people find them easy to overlook, but they're no less real for that.

Posted by: Caledonian | July 14, 2007 9:25 PM

Caledonian: I think that needs a bit more explication than you've given it. The ontological status of mathematical truths is deep water and not amenable to blanket statements like that. What is the experiment that, say, algebraic geometry flows from?

Posted by: revere | September 14, 2007 9:42 PM

Post a Comment

(Email is required for authentication purposes only. Comments are moderated for spam, your comment may not appear immediately. Thanks for waiting.)





Having problems commenting? (UPDATED)

Blogs in the Network

Advertisement

Top Five: Readers' Picks

Search All Blogs