How does the visual system learn?

Can you tell the difference between the images below?

i-d4bdd38c44fc895d95ca851b89762941-category1.jpg

At first, they just look like fuzzy diagonal lines -- there doesn't appear to be a significant difference between them. But if you look at them closely, you begin to notice that the images at the top of the picture (category A) tend to have single dark bands, while the images towards the bottom have dark bands that come in pairs. The "phase angle" refers to the technique used to generate the images, and based on this angle, the images can be divided into two categories.

With a lot of work, people can be trained to quickly distinguish between these categories. The training, on a computer, involves showing the images over and over again, requiring participants to place each image in category A or B. Then, if these trained "experts" at categorizing fuzzy lines (actually called compound gratings) are tested by showing them two gratings at the same time and asking if they are the same or different, a curious result occurs. People who've been trained to categorize the gratings are much better at distinguishing between gratings in different categories than they are when the gratings are in the same category. But if the images are rotated by 90 degrees (so they are slanted to the left, instead of the right), the training advantage disappears:

i-80f9b3ba26044d09c544e5fe4f737d55-category2.gif

These are the results of an experiment conducted by Leslie Notman, Paul Sowden, and Emre Ozgen, and illustrates a phenomenon called categorical perception. But why are we better at recognizing differences between categories we've learned only when the pictures are displayed in the same orientation? After all, at an abstract level -- for example, using language to describe the images -- the difference between the categories does not depend on the rotation of the images.

To get a better sense of the level of abstraction at which the categories are learned, the team performed a second experiment. As before, the task was to look at two gratings and determine if they were the same or different. This time, the gratings were rotated in very small increments compared to the trained gratings. Here are the results:

i-9258cb250d1b951da85400fe58cc4fe6-category3.gif

Notice that this graph charts the difference between pre- and post-training. As before, when the gratings were in the same category, training did not lead to an improvement. But when gratings were in different categories, training only led to a significant improvement within an extremely narrow range -- about plus or minus 3 degrees -- around the original orientation.

Other research has shown that the only portion of the visual system sensitive to such small differences in rotation is the V1 level: the lowest level of visual processing that occurs outside of the eye itself. Notman et al. reason that learning of categorical perception must be occurring at this low level of processing, before it's even a part of conscious thought.

Notman, L.A., Sowden, P.T., & Ozgen, E. (2005). The nature of learned categorical perception effects: A psychophysical approach. Cognition, 95, B1-B14.

More like this

I wonder what implications this might have for reading and distinguishing between letters as we often need to do with pre-literate adults in adult literacy programs and young children learning to read. I did some research 20 years ago on first graders' recognition of sight words and they recognized things equally well whether the word was right side up or upside down.

Just pondering...
Jean

My first thought would be to what extent this result is specific to compound gratings, and in particular to compound gratings presented for training in only a single orientation. If the process of visual training is parsimonious (and there would be reasons to expect it to be, albeit not necessarily valid ones) then the job of distinguishing any given category will be pushed as far down the image-processing hierarchy as it can be.

In the real world, training sets are almost never presented in such a carefully-fixed orientation, so people are unlikely to get conditioned that way. Perhaps what's interesting is that we _can_ be conditioned that way.

I wonder if you could do useful natural experiments of this nature on uncorrected astigmatic children (or adults), whose worlds do have strong orientation filters.

Hmm. In my case, the "phase" labeling was enough for me to figure out the construction pattern and see the cyclic variations. Thanks to those big framing arrows, I didn't even notice the category separation until after I figured out what was changing phase!

By David Harmon (not verified) on 17 Feb 2006 #permalink