In science, there's data, and there's interpretation. It's really easy to collect data (usually), but interpretation is the hard part — it requires an understanding of context and theory, and an appreciation of the real complexity of the problem. It's tempting to simplify all your models — the spherical cow problem — but you also have to justify the reduction in complexity to show that it is reasonable. And that's where some papers blow a hole in their foot. This is particularly a problem when the interpretation of the science is used to argue for policy changes.
Here's a paper that's a beautiful example of the split. The data is pretty and clever, the interpretation is shit…and that it goes on to question how to deal with the issue is the toxic icing on top. It's about women's menstruation, and how it effects their performance on the job.
This is the first part of the abstract. I don't disagree with this at all.
In most Western countries illness-related absenteeism is higher among female workers than among male workers. Using the personnel dataset of a large Italian bank, we show that the probability of an absence due to illness increases for females, relative to males, approximately 28 days after a previous illness. This difference disappears for workers age 45 or older. We interpret this as evidence that the menstrual cycle raises female absenteeism. Absences with a 28-day cycle explain a significant fraction of the male-female absenteeism gap.
The interesting exercise in the paper was to see if they could mathematically identify a pattern in the absences. They had a very large data set — the payroll data for 2,965 women and 11,892 men who worked at an Italian bank — and they carried out some simple statistical operations that are familiar to me. I've done something similar before; I collected data on the positions of neurons in the spinal cord, and asked whether there was a repeating pattern in their distribution, and whether it was the same distance seen in the pattern of segmental muscle boundaries (it was). This is the same problem! Cool!
So they just asked if there were any periodic regularities in the aggregate absences all of the women working at the bank -- not whether there was any synchrony in the absences, but whether if, for example, person A had an absence on her record on one date, what was the likelihood that she'd have another absence at some interval later? When you plot out the data, the signal jumps out at you: women are more likely to have repeating absences at 28 day intervals.
Note that this plot is of women's absences relative to men's — this is necessary because I'm sure there were other periodicities in the data that weren't shown. For instance, the likelihood of someone taking a day off on Friday is higher than taking a day off on Wednesday, because we all like our 3-day weekends, so there ought to be a 7-day periodicity in the chart. But those absences are going to be roughly equally frequent for men or women, so by subtracting the two you get just the differential signal.
The results are totally unsurprising. Many women experience debilitating migraines or nausea at the onset of menstruation, so of course you're going to see that biological regularity expressed in behavior. The work also found that there was a disappearance of the regularity in post-menopausal women, exactly as expected — it does not address the fact that many women regulate their menstrual cycle with birth control, but then, that information wasn't in the data set. The authors should be emphasizing that their procedure detected a statistically consistent variation that does not apply to all women; you cannot assess one woman's performance by pointing to the aggregate data for 3,000 women.
But they do fall for a fallacy. The authors seem to be sucked down into a whirlpool of narrow-mindedness by the prettiness of their numbers. Here's the rest of their abstract, where they try to interpret their findings, and that's where I have problems with the paper.
To investigate the effect of absenteeism on earnings, we use a simple signaling model in which employers cannot directly observe workers' productivity, and therefore use observable characteristics – including absenteeism – to set wages. Since men are absent from work because of health and shirking reasons, while women face an additional exogenous source of health shocks due to menstruation, the signal extraction based on absenteeism is more informative about shirking for males than for females. Consistent with the predictions of the model, we find that the relationship between earnings and absenteeism is more negative for males than for females. Furthermore, this difference declines with seniority, as employers learn more about their workers' true productivity. Finally, we calculate the earnings cost for women associated with menstruation. We find that higher absenteeism induced by the 28-day cycle explains 11.8 percent of the earnings gender differential.
You should have been put on high alert by the phrase "simple signaling model". They're going to argue that wages and promotions are set rationally, by impartial observers looking at just a few simply quantifiable characteristics, like absenteeism. Has anyone in the history of humankind ever worked at a job like that? Punch in, punch out, zoom, you're climbing the ladder of success and no one ever looks at your work…or the color of your skin or the kind of genitals you keep in your pants…and all decisions might as well be made by a computer.
It's an excellent example of being blinkered by an over-simplified theory. I don't trust their "simple signaling model" at all — it's only virtue is that they can plug numbers into pages of mathematical formulae in their paper. But if it doesn't accurately describe how wages are set, what good is it?
Their own data has massive differences that they cannot account for with their equations either. Notice that they have 4 times as many men as women in their data sample; why is that? Does banking have a demand for greater upper body strength? Is the ability to grow a beard, which most of them will shave off, some kind of qualification for accounting?
And there's more. The authors say this about their data set:
Females are younger and slightly more educated, but have significantly more sick-days [In the US, men take on average 3 sick days/year; women take 5.2 --pzm]. They are also paid on average 20 percent less and are heavily under-represented in the managerial ranks.
This bank employs a quarter as many women, pays them 20% less, and doesn't promote them to management…are we seriously going to look at the fact that they menstruate as a significant factor in those differences? Yeah, they are: they're going to punch some numbers into their spreadsheets and announce that menstruation causes 11.8% of the discrimination…that it's a rational decision based purely on numbers in their account books.
This is bullshit. It's bullshit used to prop up odious arguments.
Our findings may have policy implications. Forcing employers, rather than women, to bear the monetary burden associated with menstruation may be counterproductive. Whether society should address this biological difference with a gender-based wage subsidy depends on voters’ tastes for redistribution. Clearly, this is not a case of market failure, and the rationale for the subsidy would be redistribution rather than efficiency. A gender-specific public subsidy financed out of general taxation would shift part of the costs of menstrual- related absenteeism from women to men.
That's beancounting thinking. Of course society and employers should subsidize biology: their employees are all biological organisms! Are we going to argue that perhaps companies should not be required to pay to maintain restrooms in the workplace because every minute spent pooping is one minute not spent assembling widgets? How dare workers demand 40 hour work weeks, simply because their bodies demand nightly periods of sleep, and their brains require other activities to maintain their mental health? And don't get me started on handicap access ramps and the need to maintain two kinds of restrooms or the whole ridiculous demands for lunch hours.
What this is is an argument that the standard for all employees is that they be an able-bodied man, and any difference from that represents a short-coming that should be penalized…and anyone who argues otherwise is promoting wealth "redistribution rather than efficiency". And as we all know, jobs are not for people, but for the company, and our sole criterion for efficiency is what works best for the corporate management. Not the worker.
I think that's the fundamental problem of this paper and many others like it. It looks at human beings as numbers in a spreadsheet, and assesses them statistically by their contribution to corporate "success", as measured entirely by short-term profit to the shareholders and management. The perspective used to interpret the data skews the meaning. And when your perspective is entirely based on over-simplified models and a purpose that ignores values other than profit, you get demeaning garbage.
This paper was published by the US's very own National Bureau of Economic Research. It is not some reactionary right-wing think tank — it has been summarized by Paul Krugman as:
The NBER is best described, I’d say, as the old-boy network of economics made flesh. There are a couple of NBER offices, but they’re small; what the organization mainly consists of is its associates and what they do. In many sub-fields of economics, just about anyone well-known in the profession is an NBER research associate (yes, me too); it’s normal for these associates to release new research as NBER working papers.
…
You can criticize the role the NBER plays, mainly because it privileges insiders. If you’re associated with the Bureau, you can get research out quickly in a place everyone will see, whereas if you aren’t in the magic circle, getting noticed can be much harder. I would say that economics blogs are starting to remedy this disparity, but there will never be a truly level playing field.
This is a problem, too. We aren't talking about far right-wing tea party crazies here — this is a smug economic establishment trapped in a rigid capitalistic worldview that can't see anything but tables of numbers. It's a nice way to plod along, getting incremental improvements in "efficiency", but it's all going to hell when the people rise up and scramble all their equations with a more human reality.
- Log in to post comments
PZ shows all the appreciation for econometric analysis that a drunk shows for a toilet before puking in it.
I particularly like the bit about how economists reduce people to numbers. PZ, stop looking through your microscope! You're reducing the beauty and integrity of nature to tiny, mindless, functional elements!
PZ shows all the appreciation for econometric analysis that a drunk shows for a toilet before puking in it.
I particularly like the bit about how economists reduce people to numbers. PZ, stop looking through your microscope! You’re reducing the beauty and integrity of nature to tiny, mindless, functional elements!
1. NBER doesn't PUBLISH papers. They're working papers, and if you're a member of NBER you can put whatever you want up there. There's no peer review or anything because they're working papers, not published papers. The paper was, however, published in an econ journal later, despite being ridiculous.
2. The paper that you cite has been thoroughly discredited in a published paper using the same data. The authors of the discrediting paper find cyclicality in MEN too and absence heaping at all multiples of 7 in other datasets as well. It isn't menstruation, it's some sort of heaping issue because weeks are 7 days long. I'm blanking on the names of the authors at the moment.
The reanalysis:
Does Menstruation Explain Gender Gaps in Work Absenteeism? Mariesa A. Herrmann and Jonah E. Rockoff
J. Human Resources Spring 2012 vol. 47 no. 2 493-508
http://jhr.uwpress.org/content/47/2/493.short
Thanks for the citation, EpiPete.
Too bad I can't post on the free-thought version of this post-- the one with 52 highly speculative comments.
But to answer PZ's comments on that post... the data AREN'T right, and yes there IS periodicity.
And yes, the authors were total assholes when presenting the paper-- they acted like the women who were questioning them (in the way that all economists question any other economist) were hysterical females who hated science. The men listening were afraid to ask questions because ick menstruation. It's bizarre that it got published in the AEJ, though I've heard some people think it's because AEJ was a new journal at the time and wanted big name authors for their early issues, which Morietti assuredly is.
As one of my (male) colleagues (a prof at Stanford) said during the Summers fiasco, male economists are all about the evidence until you start talking about gender. Then they put blinders on.
Registering is easy, just do it.
But I'll post the reanalysis.
Done.
Thanks.
Registering isn't actually easy-- it thinks I've already registered, though neither of us can remember having done so. We also have a hard time commenting on CPP's blog, as it thinks we're imposters when we use our regular information.
Huh. Is there a way to recover your apparently lost password?
I think something like that happened to me as well when I tried to register there. Unfortunately I don't remember how I solved the problem, nor do I remember what the exact details of the problem were. Something about having a Wordpress account that I couldn't use for commenting and being unable to create the FTB specific account that I needed because of already being registered. Do you have a Wordpress account?
Sorry I can't be of more help.
Hi, Nightjar! *jumps* *waves*
Hi, David! *waves back*
It's so quiet in here. I think maybe I'll stick around. :)
:-)
pleasant post, we certainly really like this website, carry on it
Good post. I find out something more demanding on different websites everyday. It usually is stimulating to learn content off their writers and exercise a little something there. I
Before looking in minute detail at the facts of the case I will say on a matter of character I am backing Myers on this rape matter.
I have my problems with Myers and he is not forgiven. But just on the superficial level of CHARACTER I would have the initial judgement that he is doing the right thing warning our girls and that Schermer has to be treated as highly suspect and not treated at all except at the end of a big stick.
I was very hurt by my treatment by Myers and so I searched around for character defects for the purpose of payback.
Myers is excessively anti-Christian. He is a belly-crawler for mainstream science. I hate these defects but I was really pissed off so I was on the hunt for other defects and I simply came out empty-handed.
Apart from the afformentioned deficiencies I find Myers to be a vigilante person and a person of good character. If he wants to put out the warning bells for our girls, against a protected sexual predator, then I am on his side on this one and I am with him.
But I'll be running him down tomorrow on other grounds.
Character Reference, it's good that you are on his side on this important matter and all, but... could you please not refer to adult women in general as "girls"? It's infantilizing and offensive. I bet you don't use "boys" like that to refer to adult men in general, so it's also sexist.
Keep that in mind next time, please.
Elabscience,ELISA Kits supplier,offering 20,000 kind of products,coving the following series:Cytokine, Signal transduction, CD & Adhesion molecules, Metabolism, Endocrinium, Innate immune, Infection immunity ,Tumor immune, Nervous system, Hematological system, Urinary system,
Any needs, pls contact:
karen.elabscience@foxmail.com , www.elabscience.com
Interesting take on economic theory builing that may help explain the "overly" symplistic "analysis"
Gilboa, I., Postlewaite, A., Samuelson, L., & Schmeidler, D. (2013). Economic Models as Analogies, Third Version. Retrieved from http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2209153
...which is a really bizarre thing to do, frankly. The argumentum ad hominem is, after all, a logical fallacy: "X said Y, and X is an asshole, so Y must be wrong"...
Also, "our girls"? Does somebody own them? Do you think PZ only wants to protect the women who agree with him on general godlessness but doesn't care if anyone else is raped???
You have made some respectable points presently there. I seen the internet for your issue and discovered most individuals should go along with along with your website.
Thank you for this excellent article, I only wish it was published before I handed over my forthcoming book.
www.sweeteningthepill.com