Perceived reality is not at all reality; it’s a stitched up patchwork of selected impressions and guesswork. Take our visual impressions. In the centre of our retina we have a small patch of densely crowded photoreceptors called the fovea. This spot is the only part of the eye capable of seeing with the rich detail and full colour we take for granted. To get an idea of its size: it covers an area of our visual field that is no bigger than the spot the moon takes up in the sky - yet it feeds our visual system with almost all of its raw information.
So how do our eyes build up a picture? Not by continuously scanning our environment but by darting around, by fixating a certain spot for a fraction of a second and then moving on. These jerky movements between fixations are called saccades, and we make about three per second, each lasting between 20 and 200 microseconds. During those saccades we are effectively blind; the brain does not process the information picked up in between because the eyes move too rapidly.
Despite their short duration we can actually capture saccades visually. One way is to look in a mirror and flick our focus from side to side; however hard we might try though, we cannot see our eyes move; because the saccade is motion, our brain does not pay attention to it. Another way to catch saccades is the so-called frozen-time illusion: it’s the sensation we get when looking at a clock, the second hand appears to freeze for a brief moment before moving on.
This particular effect is quite interesting because some scientists believe that it partially explains how vision works: to compensate for the temporary shut-down, our brain makes a guess at what it would have seen, and it does so retrospectively. In other words, the 100 or so milliseconds of blindness gets back-filled with the image that appears after the saccade is over; the “second” then lasts about 10 per cent longer than normal, which is enough for us to notice. But it’s not only guesswork that is used to justify the idea of backfilling; short-term and long-term visual memories retaining information from previous fixations are also suggested as ways of filling gaps and creating a continuous here-and-now visual experience (Andrew Hollingworth, Visual Cognition, vol 14, p 781).
It is not only vision though that is affected by discontinuity of experience; our auditory system is also full of gaps and glitches that the brain cleans up so we can make sense of the world. This is especially true of speech. “Phonemic restoration” is the a term to describe how our brain pastes in the sounds that obscured or distorted people’s voices in everyday situations.
A good demonstration of this effect was published last year by Makio Kashino of NTT Communication Science Laboratories in Atsugi, Japan. He recorded a voice saying “Do you understand what I’m trying to say?” then removed short chunks and replaced them with silence. This made the sentence virtually unintelligible. But when he filled the gaps with loud white noise or parts of the sentence being played reverse, the sentence miraculously becomes understandable (Acoustic Science and Technology, vol 27, p 318); the brain replaces the distortion based on the information in the remaining speech signal (Kashino’s sound files are available here).
It seems that the presence of this speech signal is of prime importance; the brain might not switch to possible speech responding circuits unless it detects spoken language (Hearing Research, vol 229, p 132). Another demonstration for this ability to detect meaning from distorted speech signals is a form of synthesised speech called sine-wave speech. Hearing it first it sound unintelligible, a bit like whistling or birdsongs; but if you listen to the same sentence in normal speech and then return to the sine-wave version, it suddenly snaps into auditory focus. Try as you might, you cannot “unhear” the words that you didn’t even realise were words the first time you heard them (listen to demos below by clicking on the yellow triangles to download the associated wav files; more examples can be found here).
|
Sine-Wave Speech
|
Clear Speech
|
|

|

|
|

|

|
|

|

|
|

|

|
What happens when the two gap filing mechanisms come together? Sometimes the visual and other times the auditory system wins out. Take the McGurk effect, in which listening to a series of identical syllables such as “ba ba ba ba” while watching somebody mouth “ba da la va” makes you hear “ba da la va“. Try it for yourself here. On the other hand, when a team of psychologists showed volunteers on a screen a single flash accompanied by two short beeps, those volunteers saw two flashes (Nature, vol 408, p 788). See the illusion here.
The next post will look at the way the brain creates a body image.
[source: New Scientist]