Now on ScienceBlogs: Q: How do you sex a Smilodon? (A: Very carefully)

Seed Media Group

Reality is always more complicated than you think.

Profile

jake-head-shot.jpgJake Young is a MD/PhD student at Mount Sinai School of Medicine in NYC getting a PhD in Behavioral Neuroscience. He holds a BS and MS in Biological Sciences from Stanford University. If a volcano were to erupt Pompei-style in Central Park, his body would be preserved in a scoliotic posture over his lab desk. Archeaologists would later conclude that he spent most of his day training rats to perform tricks, until he went blind building electrical equipment by hand using a dissecting microscope. But, still, he died happy...because science is cool.

Pure Pedantry is a blog about science -- social sciences and otherwise -- as well as academic and scientific culture. No one can live on science alone, so I also like to dwell on pop culture, periodically explore the humanities, and indulge in other types of geeky goodness.

DISCLAIMERS: 1) Jake Young is not a licensed physician (yet). He is merely a medical student. The information published on this site is not intended for use in medical decision-making. Please seek advice from a licensed, medical professional before making any health decisions. 2) The opinions expressed are my own. They do not represent the views of SEED magazine or the educational establishments I currently attend or attended in the past.

Search

Archives

Blogroll


The Daily Read Science News Science Blogs Medicine Blogs Econ Blogs Papers to Read Comics Links to Pure Pedantry via

« Psychobabble solicitaiton | Main | Elsewhere on the Interweb (6/24/08) »

Foreign-Born TAs and Undergraduate Performance

Category: Teaching
Posted on: June 24, 2008 10:51 AM, by Kara Contreary

This is a bit old, but in case you haven't seen it...

A few weeks ago, Jake wrote a post about the importance of teaching during grad school. I couldn't agree more--some of my best experiences in grad school to date have been in front of a classroom of keen undergrads, their young minds yearning to be filled with the minutiae of microeconomic theory (or so I have convinced myself). I find it absolutely true that having to teach a concept cements it in my mind, and it is my fervent hope that a few of my students will at least consider becoming economists.

There is also, of course, the question of what the students get out of classes. A while back, one of my classmates sent around an AER paper by George Borjas entitled "Foreign-Born Teaching Assistants and the Academic Performance of Undergraduates". The gist is that undergrads who have foreign TAs perform worse on their exams than their classmates with "native-born" TA's.

This raised a few eyebrows among grad students at the LSE, where just about everyone is foreign. I can think of one British grad student in the econ department. Presumably, the issue in question is one of fluency in English rather than actual "native-ness", so I should also count one Australian and a smattering of Irish and North Americans. That still leaves the vast majority of economics undergrads being taught by TA's for whom English is a second (or third, or fourth, or fifth--some of my classmates are amazing) language.

So just how bad is this for them, and why?

The difference Borjas found is small, but it is statistically significant. Students who have foreign-born TA's score roughly 0.2 points lower on the usual 4-point grading scale (A = 4, A- = 3.7, B+ = 3.3,...). And this result is robust to several specifications, including controlling for overall GPA, which serves as a proxy for general academic ability.

Borjas looked at an introductory-level course sequence in economics (micro and macro) at a large public university in the US. All students who pursue an economics major must take this sequence, which involves lectures and weekly sessions with TA's. They have different TA's for the micro and macro component. Borjas surveyed undergraduates enrolled in the micro component in three separate years, asking them whether their TA's in the component courses were foreign, their final grades, their GPAs, and other personal characteristics. He also asked them to comment on whether foreign-born TA's had better or worse communication skills than native-born TA's, and on whether foreign-born TA's were better or worse prepared for class. The students generally reported no difference in the level of preparation for class, but almost 80% of students said that foreign-born TA's have worse communication skills than native-born TA's.

Table 2 shows the results of Borjas's regressions:
foreign%20TAs.bmp

This is a fixed-effect regression (columns i, ii, v, vi, vii), which means that a dummy variable (1 if something is true, 0 otherwise) for each student was included. The individual student fixed effects control for any student-specific differences (such as ability or effort) that might affect their final grade but don't vary between the two components (micro and macro). So the coefficient you see on "Foreign-born TA" represents the isolated effect of having a foreign TA. Looking across specifications, the -0.2 coefficient doesn't change much depending on what other control variables are included, which indicates a pretty solid effect.

Look now at column (vii).

Column (vii) interacts the foreign-born TA dummy with the undergraduate's perception of the class-preparedness of foreign-born TA's. The evidence indicates that foreign-born TA's do not worsen the scholastic achievement of undergraduates if they are better prepared than native-born TA's. It seems as if additional class preparation may resolve the teaching difficulties encountered by foreign-born TA's.

So spending a bit more time preparing the week's lesson ahead of time ameliorates the communication problem.

Finally, Borjas checked to see if there was a differential effect on American versus foreign-born undergraduates. Looking at columns (i) and (ii), in which Borjas ran the primary regression separately for American and foreign students, it turns out that foreign-born TA's hurt the performance of their American students, but have no adverse effect on their foreign students. Borjas reckons that this is because most of the foreign undergrads were Asian, and so were most of the foreign-born grad students.

The evidence suggests that foreign-born graduate students do not have an adverse impact on the academic achievement of undergraduate students who are "like them" (perhaps both in terms of language and culture) but do have an adverse impact on undergraduates who are sufficiently different.

I have an additional hypothesis: even if foreign-born undergrads are being taught by TAs who are "like them", they are still being taught in English. They therefore may come into the course expecting to have to work a bit harder to understand the material as it's being presented and this added effort may compensate for a possible linguistic disadvantage. I wonder if exerting a little extra effort might not help American students lessen the adverse impact on their learning.

It's important to bring up the question of external validity of this study. Borjas looked at 309 economics students in a single university in the United States, so it's certainly not clear that this is a universal effect. However, given that more and more people are coming from all over the world to do their graduate work in the US (which we absolutely want!), it's worth looking at any unexpected results of this trend. My reading of the paper suggests that, if there is an effect, a little extra effort on both sides to improve understanding and communication can solve the problem.

Share this: Stumbleupon Reddit Email + More

Comments

1

i'm sure you'll get anecdotes, but

1) my friend who were international students made sure to do *all* the reading, over & over, because they weren't as quick to catch nuance in the lecture which might go a little fast for their english comprehension (fine if you are speaking sciencese, but the non-science sinews could leave them confused).

2) there were particular foreign born TAs whose english communications were bad enough that anyone who wanted to succeed in a class knew that that they had to pour over the packets and texts as if they were sacred.

Posted by: razib | June 24, 2008 12:54 PM

2

At my university, in later years, we had to certify competence in English before we could hire. On the other hand, a Chinese colleague, for whom English was clearly a second language, twice won student-generated great teacher awards.

Posted by: Jim Thomerson | June 24, 2008 1:16 PM

3

It would be interesting to find out whether the difference in effect between native-born and foreign-born students persists at places like LSE. If indeed the issue is the perceived "foreignness" of the TA, then this issue should go away at institutions where nearly everyone is from a different country.

I would also be curious to see what would happen at non-American schools. Perhaps this is a testament to American chauvinism, but it would be interesting to find out whether students from other countries learn better from people like them.

Posted by: Jake Young | June 24, 2008 1:43 PM

4

I'm just making a pure conjecture here:

There could also be the possibility that students simply give up when faced with a foreign-born TA, producing a self-fulfilling prophecy. So their lower scores may partly rest on their own expectations, and not just the performance of the TAs.

Posted by: gmcfly | June 24, 2008 1:43 PM

5

A Japanese professor, with poor English, taught one of my critical engineering courses, "Separations", back in the 60's. During my 35-year career as a Chemical Engineer, I never really understood McCabe-Thiel distillation theory, even though I worked with distillation separations from time to time.

Posted by: Al Ruskin | June 24, 2008 4:23 PM

6

Both my best and worst TAs were US natives (physics and computer science respectively -- the CS TA not only had poor communication skills and refused to learn the language at hand because "nobody uses it", but openly solicited dates from his female students). I'm quite certain my CS TA's section's grades skewed low compared to other sections (unfortunately it was a class without a supervising professor so I doubt anyone noticed or cared).

It was my experience that my non-native TAs had more absenteeism and more sleeping during section than my US native TAs. They were also less approachable for office hours. This probably had less to do with being foreign born and more to do with being married with small children, where most of my US-born TAs were not. On the plus side, I don't remember any of them pressuring me or my female classmates for dates.

Posted by: Kim | June 24, 2008 5:29 PM

7

On the plus side, I don't remember any of them pressuring me or my female classmates for dates.

well, mebee FOBs judged their chances low? ;0)

Posted by: razib | June 24, 2008 6:26 PM

8

students at my institution sometimes report having difficulty understanding one of our faculty members, a yeast geneticist from china. so much so that i was paid last summer to "facilitate" during his summer class.

it was embarrassing for him and uncomfortable for me, particularly after i realized that the students who had really instigated for outside assistance were the ones who wouldn't do well under any instructor. why? because they used the professor's difficulty with english (which was real, i admit) as an excuse to avoid the work. not every student, but a few.

i'll go with gmcfly's claim that many students doom themselves by throwing up their hands when they have initial difficulty understanding the instructor.

and i'll add that american chauvinism, however unconscious, definitely plays a role. if you're disdainful of a foreign instructor from the outset, your odds of doing well in his or her class decrease automatically.

Posted by: tvbaugh | June 26, 2008 3:23 PM

Post a Comment

(Email is required for authentication purposes only. On some blogs, comments are moderated for spam, so your comment may not appear immediately.)





ScienceBlogs

Search ScienceBlogs:

Go to:

Advertisement
Follow ScienceBlogs on Twitter
Visit the Collective Imagination blog
Advertisement

© 2006-2009 Seed Media Group LLC. ScienceBlogs is a registered trademark of Seed Media Group. All rights reserved.

Sites by Seed Media Group: Seed Media Group | ScienceBlogs | SEEDMAGAZINE.COM