1. cognitivedaily
  2. The Pip and Pop Effect: Sound helps us find visual changes

The Pip and Pop Effect: Sound helps us find visual changes

By dmunger on August 25, 2009.

Take a look at the following picture:

i-ccbb5cd2bdf4ee8ea55fe115ff5c3efd-vanderburg1.gif

Your job is to look for the one line that's either perfectly horizontal or perfectly vertical. It took me about 25 seconds to find it. Can you do better?

How about now?

i-be41139dd3e4b95ea713c863bad2dda2-vanderburg2.gif

A little easier, right?

ResearchBlogging.orgBut the task can be made difficult again by randomly changing the colors of all the other lines in the picture, a few at a time. Now you don't know which flash to look at and the task is just as hard as it was before.

But a team led by Erik Van der Burg found an interesting way to make the task easy again: just add a clicking sound that plays only when the horizontal or vertical line is displayed. They call this the "Pip and Pop Effect." The question which then arises is, why does the sound help?

The researchers showed displays like this to six paid volunteers, who were instructed to focus on the central dot and try to identify as quickly as possible whether the key line in the picture was horizontal or vertical. Half the time a tone was played in sync with the horizontal/vertical line changing colors. This graph shows the results:

i-7312c67dd697f0cc110ff72c7a98e0b2-vanderburg3.gif

As you can see, viewers were dramatically -- and significantly -- faster when the sound was played. The sound seemed to help them correctly identify the line. But can only sound help? Perhaps some visual signal would also help viewers locate the change.

The researchers recruited six new volunteers to watch a different set of displays. This time, the central dot flashed when the horizontal/vertical line changed colors. Did this help viewers spot it? Here are the results:

i-937aa6b2b688a9d781275c9c33aa4b90-vanderburg4.gif

There was no significant difference between when the central dot changed along with the horizontal/vertical line and when it did not change at all. So while an audio cue helps viewers find the dot, a visual cue does not.

But how is the sound helping? Does it just motivate people to search a little harder, or are its effects automatic? In a new study, 16 new students participated in one of two experiments. The lines changed and were accompanied by clicking sounds, as before, but for one group of observers the click was relevant 80 percent of the time: it actually coincided with the horizontal/vertical line changing, while the other 20 percent of the time the clicks were irrelevant. For the other group of observers, relevance was reversed: the click was only relevant 20 percent of the time, while the other 80 percent of the time the clicks were irrelevant. Here are the results:

i-af39f2dc97a0ec7bedb6f0ff178126ad-vanderburg5.gif

Even when the clicks were relevant just 20 percent of the time, the students were still significantly faster at recognizing the horizontal/vertical line during relevant clicks.

The researchers say this suggests that the connection between the audio cue and visual search is automatic. Even though the sound has nothing to do with the location of the change, just hearing a sound while the relevant object changes helps viewers to spot it more quickly.

Van der Burg, E., Olivers, C., Bronkhorst, A., & Theeuwes, J. (2008). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34 (5), 1053-1065 DOI: 10.1037/0096-1523.34.5.1053

Tags
attention
Perception
Research

More like this

Is responding to sudden cues automatic?
Take a look at this short video clip (QuickTime required). It's called an RSVP (rapid serial visual presentation), meaning that it's a quick sequence of still images. In this case, it's a random sequence of letters. Your job is to look for a number among the letters. At some point during the clip,…
Watch that hybrid! Can sound help us spot objects?
Recently we took our hybrid car into the shop for its annual emissions test. In our state, the test is conducted while the car is idling. A hybrid doesn't actually idle -- it shuts the engine off completely. So our car's emissions were tested at 0 RPM. It may be time to rethink our state's…
Do unusual objects attract our attention faster?
It shouldn't take you long to notice what's wrong with this picture: Obviously Nora is defying gravity in this shot -- you can't help but notice it. But in your first glance at the photo, how quickly do you notice what's wrong? Do you spot the oddity faster than you'd notice Nora in the original…
Does seeing objects in a scene help us remember them? (Part 1)
Change blindness is a truly remarkable phenomenon. There are so many ways that the human perceptual system can be tricked into missing a change that appears right before our eyes, that it's sometimes astonishing that we aren't constantly running into walls or misplacing the basics of life -- our…

Obvious interpretation: a disembodied click primes the attention system (which is multimodal) at those particular times, making that particular blinking point stand out further. A visual blink - with a definite spatial position - also primes the system but distracts from the correct point. The clear follow-up experiment would be to play a click sound at a particular point in space separate from the correct line and see if the effect diminishes.

I found the line in the first display in a couple of seconds, but you did not say we were supposed to fixate the central dot. If I had done that, I very much doubt that I could have found the (unblinking) horizontal line at all.

Interesting -- I design e-Learning interfaces, and attention focus and managing cognitive load are constant issues. Using sound as a focusing device could be very helpful.