We can judge the emotional content of pictures in as little as 13 milliseconds (with more polls!)

i-eca0cf2af9fc3ac4445c7dff7d8aab70-research.gifTwo days ago, we discussed research suggesting that the emotional qualities of images affect short-term memory for those images. When you watch a movie depicting a rapid sequence of images, you're more likely to remember images that have strong emotional content -- especially images that are arousing, whether they depict positive or negative things. Most fascinating of all: when we see images for a very short time, we're more likely to remember positive images, but when we view them for a longer period, we're more likely to remember negative ones.

But our discussion didn't address some of the possible objections to the work. It's possible, for example, that something else about emotionally-laden pictures is different: maybe they're brighter than other pictures. Maljkovic and Martini analyzed the colors in the photos they used in their study and found that there was indeed a small correlation between brightness and valence: positive pictures tended to be slightly brighter than negative pictures. What's more, brighter pictures were better remembered than darker pictures. However, there was no indication, as in the emotion data, that there was a difference in how the pictures were remembered based on how long the pictures were viewed. Brightness alone couldn't explain their results.

Another possible objection might be that the test wasn't really about memory at all. Perhaps it simply takes longer to process an image as "negative," so for short viewing times these pictures are never perceived as "negative" at all. To address this concern, Maljkovic and Martini designed a new experiment. I'll show a couple examples of their displays below.

This movie (QuickTime required) will start with a grey screen. Then an image will quickly flash, and then get replaced by two random patterns. Your job is simply to classify the the emotion depicted in the image as positive, negative, or neutral.

Movie 1:

Now try another one:

Movie 2:

The researchers showed hundreds of such movies to volunteers and had them rate them on a 9-point scale where 5 was neutral, and found that they were able to reliably rate them, even when the exposure time to the image was just 13 milliseconds (our example above flashes the image for 1/30 of a second, or 33 milliseconds). Here's a graph of their results:

i-f8924e2de3910873bc279ba3e4e9554e-maljkovic4.gif

So clearly we are capable of classifying images as positive or negative even after seeing them very briefly. This leaves only one plausible explanation of the results: our memory, not our perception of images, is what varies depending on the emotional content of those pictures.

You can test our demo by manually scrolling through the movies to see what was portrayed. I think there'll be little dispute that the first image is negative, while the second one is positive.

Maljkovic, V., & Martini, P. (2005). Short-term memory for scenes with affective content. Journal of Vision, 5, 215-229.

More like this

What types of images are you more likely to remember over the short-term? Pleasant? Bright? Arousing? Disturbing? One method of testing short-term visual memory is to flash a rapid series of pictures, then ask viewers which ones they saw. The pictures are shown so quickly that it's impossible to…
Take a look at this picture I took last year when we went to Venice. Look at it fairly closely, because there will be a "test" at the end of this post. We have posted on boundary extension before: it's a simple phenomenon where our memory for a picture is consistently different from the actual…
[originally posted December 9, 2005] A few months ago, Jon Stewart opened the eyes of his Daily Show audience when he interviewed the author of the book On Bullshit. Viewers accustomed to hearing the familiar bleep when Stewart enters foul-mouth mode were surprised to find that the word came…
A few months ago, Jon Stewart opened the eyes of his Daily Show audience when he interviewed the author of the book On Bullshit. Viewers accustomed to hearing the familiar bleep when Stewart enters foul-mouth mode were surprised to find that the word came through completely uncensored. Stewart…

Whatever it means about our brain that we can detect emotional content in 13 msec, I'm glad nature usually gives us more time to explore a scene and make more complete associations to it. It's like a shooting range where the subject is supposed to shoot the threatening guys, but not the innocents. 13 msec wouldn't be much for that.

This makes sense if you consider how quickly we supposedly process microexpressions.

What does it mean that I easily knew the first was negative but was totally baffled by the second, even after repeat viewings? Does it mean I'm also blind to people's positive microexpressions? :)

Wild speculation on a Friday night. This blog is so much fun!