Now on ScienceBlogs: Rhodes Secretary: Wall Street Megabonuses Draining Our Young Talent

Seed Media Group

Collective Imagination

Cognitive Daily

A new cognitive psychology article nearly every day

Profile

Dave and Greta Munger Cognitive Daily reports nearly every day on fascinating peer-reviewed developments in cognition from the most respected scientists in the field.

Greta Munger is Professor of Psychology at Davidson College whose works include The History of Psychology: Fundamental Questions. Dave Munger is co-founder and editor of ResearchBlogging.org and a columnist on SEEDMAGAZINE.COM. And yes, he is married to Greta.

Recent Posts

Recent Comments

Search

Categories

Archives

Blogs

Other links

Participate in research

Other Information

« Does faking amnesia permanently distort your memory? | Main | Casual Fridays: What does an emoticon do? »

Can we tell who's speaking based only on body movements? Depends on their emotion

Category: EmotionLanguagePerceptionResearch
Posted on: May 28, 2009 4:34 PM, by Dave Munger

Take a look at this video. Your job: decide which person speaks first:

Click to view Video 1 (QuickTime required)

Let's make this a poll:


Now, try another one. Once again, decide which person speaks first:

Click to view Video 2 (QuickTime required)

Make your response here:


ResearchBlogging.orgDavid Rose and Tanya Clark showed videos like this to 17 student volunteers, and asked the same question: who spoke first in each video? The videos are point-light displays, which show movements of particular points on an actor's body, but not the nuances of facial movements and expressions.

The videos were used in an earlier experiment about identifying emotion (which we've discussed on Cognitive Daily). That study showed that people are accurate in identifying emotions in point-light displays. Now they wanted to find out if people can determine who's talking in the same videos. Here are the results:

sun.gif

As you can see, accuracy depends on the emotion being portrayed. The videos depicted actors reading scripts while expressing one of several possible emotions. While in the previous study viewers were able to accurately identify the emotions, this experiment shows that people can't always accurately figure out who's speaking. While angry and joyful conversations were easy to parse, for conversations expressing fear and disgust, respondents didn't do better than chance.

If we duplicated these results in our example, accuracy should be much better for Video 1 (anger) than Video 2 (fear).

Rose, D., & Clarke, T. (2009). Look who's talking: Visual detection of speech from whole-body biological motion cues during emotive interpersonal conversation Perception, 38 (1), 153-156 DOI: 10.1068/p6279

Share this: Stumbleupon Reddit Email + More

Comments

1

I had a very hard time telling because the video jumps straight into someone speaking. If there was a second or two of no speech it would be easier to tell I think.

Posted by: Chris | May 28, 2009 8:08 PM

2

It seems like the difference is between larger and smaller movements. What about the quietly angry people, or people who gesture a lot when they talk, regardless of emotional state?

Posted by: Heather | May 28, 2009 8:38 PM

3

Video 2 is supposed to be fear? Perhaps it was that I was somehow thinking of it as a follow-up to 1, but I saw it as resignation. It seemed both participants had a bleak sense that nothing else they said would matter.

Posted by: Carlie | May 28, 2009 10:11 PM

4

It's good to see mime research is still getting published.

Posted by: bez | May 29, 2009 1:36 AM

5

What if what really made a difference was the performance itself, not the emotion they were trying to portray?

Posted by: Fernando | May 29, 2009 8:20 AM

6

They are both ambiguous to me.

I chose the one who dominates the conversation.

Posted by: ifan | May 29, 2009 2:00 PM

7

I'm actually kind of surprised that anyone put "left" on the first one. To me it seemed very obvious that it was the guy on the right.

Posted by: MTGAP | May 30, 2009 11:44 PM

8

They are both ambiguous to me.I chose the one who dominates the conversation.
Work From Home

Posted by: Nagesh | October 9, 2009 4:24 AM

Post a Comment

(Email is required for authentication purposes only. On some blogs, comments are moderated for spam, so your comment may not appear immediately.)





ScienceBlogs

Search ScienceBlogs:

Go to:

Advertisement
Enter to win a free copy of The Monty Hall Problem
Visit the Collective Imagination blog
Advertisement
Collective Imagination

© 2006-2009 Seed Media Group LLC. ScienceBlogs is a registered trademark of Seed Media Group. All rights reserved.

Sites by Seed Media Group: Seed Media Group | ScienceBlogs | SEEDMAGAZINE.COM