Casual Fridays: Can sound affect a visual illusion?

If you didn't participate in last week's Casual Friday study, you should definitely see what it's like to experience the flash-lag effect:

When the blue rectangle flashes, it's always precisely aligned with the gray bar, yet it appears to be behind the bar. Cool, isn't it? You can stop the movie and check for yourself that there's no funny business going on.

Another illusion we've discussed recently is a visual-sound illusion. Here, the dot flashes just once, but when it's accompanied by two beeps, it appears to flash twice:

Clearly sound can affect what we see. So can sound affect the flash-lag effect? That's what we were attempting to uncover with this week's study. The short answer is yes, but not in the way you might expect. Read on for the rest of the story:

We created six different versions of the flash-lag movie and showed them to over 300 people. One of the movies was silent, like the demo above. The other five movies had beeps at different times relative to the flash. In one movie, the beep occurred just as the blue rectangle flashed. In two movies, the beep was just before or just after the flash. Finally there were two movies with two beeps: one with the first beep before the flash, and one with the first beep aligned with the flash. In every case, the flashing rectangle was aligned with the bar.

In each case, we measured the flash-lag effect by asking viewers whether the rectangle appeared to be aligned, behind, or ahead of the gray bar. Did we find a flash-lag effect? Definitely: Although most of the time they said the bar and rectangle were aligned, viewers indicated that the rectangle was behind the bar about 30 percent more often than they said it was ahead of the bar.

Whether the beep occurred before, after, or aligned with the flash had no effect on the results. Neither did double-beeps, regardless of when they occurred. You might think that this was because viewers weren't experiencing the visual-sound illusion, but actually most viewers said that they did see the rectangle flash multiple times at least once during the study. Even when considering just these viewers, however, there was no difference in the flash-lag effect when comparing double- or single-beeps.

It's tempting to argue that sound doesn't affect the flash-lag effect in any way, but we did come away with one very curious finding. The movies were presented in three different orders -- a third of viewers saw the silent movie first, a third saw a single-beep movie first, and a third saw a double-beep movie first. Here's a graph of the flash-lag effect among these three groups:

i-4d3dafa96201b628cbeeedc074232df9-flashsound1.gif

When the single-beep movie was presented first, significantly more flash-lag was perceived than when the movies were presented in a different order. Sound has an influence on the flash-lag effect, but I'm baffled as to why it might be happening in this way. Do readers have any ideas?

More like this

Both in your experiment and in today's example, I only saw the flash-lag the first time I watched. Do you see this pattern in general? It could be that the single beep makes you more likely to see it, but the effect is overwhelmed by the effect of familiarity.

When I watch the demo, I see lag, both ways.

Rehana -

No, your results were atypical. The only consistent effect we observed is that when viewers saw the single-beep movie first, they saw more flash-lag throughout the experiment.

very interesting. I'm no expert, but I wonder if a potential problem with your study may be that many of the people reading your web site have some knowledge of flash-lag and/or visual illusions induced by sound. e.g., i just answered that the dot was aligned with the bar 'cos i know it is (same with the double flash). It may be the effects are more apparent when the context is manipulated - could you change the studies by embedding them within other experiments (such as attentional ones) that allow you to manipulate the responses more effectively?

Also, could there be some short term entrainment happening here where the beep is heard first? It may be that the simultaneously single beep engages attention so that visual discrimination is more difficult (multisensorialy). Also, it may matter where the beep was (i.e. behind/simultaneous/infront) the first time it was experienced by the anomolous group i.e. Where was the beep the first time? random?

I didn't notice the illusion effect in any of these animations. I think I saw the flash lag once when I was focusing on the point where the flash would come and willing myself to see it. I definetly only saw the dot flash once every time. Maybe I was anticipating the illusions too much. How strong is the effect in studies? Are the illusions observable by everyone?

Xander -- the flash lag was experienced about 30-50 percent of the time here, but most people saw it in at least one of the conditions. If you follow the link to the visual-sound illusion page, you'll see that somewhat fewer people experience that illusion.

However, in this most recent study, most people saw the double flash at least once.