McGurk effect
-
What is the McGurk effect?
The McGurk effect is an audiovisual speech illusion that shows how visual cues impact speech perception, especially in spoken syllables. Cognitive psychologists Harry McGurk and John MacDonald discovered it while studying language perception in infants. In their experiment, a video showed a person articulating the syllable gah dubbed with audio of the syllable bah. Both psychologists perceived the syllable dah upon playback. They found that visual input played a role in speech perception and reported their findings in the paper "Hearing Lips and Seeing Voices" (1976). When the brain receives conflicting sensory input, it makes a best guess to construct reality. With the McGurk effect, the brain perceives a third sound that blends the visual and auditory cues.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How does the McGurk effect happen?
The McGurk effect is an illusion that occurs when the brain attempts to integrate conflicting sensory information, specifically visual cues and auditory input, during speech perception.
When the visual information from observing mouth movements doesn't match the auditory information from spoken sounds, the brain tries to resolve the conflict by creating a new perception. This "best guess" is a combination of the sounds perceived from both visual and auditory cues.
Not everyone experiences the McGurk effect to the same degree. Factors such as gender, age, language, and familiarity with the speaker can influence susceptibility to the illusion.
2 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
What senses are involved in the McGurk effect?
The McGurk effect is an audiovisual speech illusion that reveals how visual cues impact speech perception, especially in spoken syllables. It occurs when the brain tries to make sense of conflicting information from the senses. When the visual input of a person articulating a syllable doesn't match the audio, the brain combines these inputs, resulting in the perception of a different, blended sound.
The senses of hearing and sight are both involved in the McGurk effect.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
Why does seeing someone's mouth change what we hear?
The McGurk effect is an illusion that occurs when the brain attempts to integrate conflicting sensory information, such as visual cues from lip movements and auditory information from spoken sounds.
When the visual information from mouth movements doesn't match the auditory information, the brain makes a guess by creating a third sound that combines both visual and auditory cues. For example, a video showing a person articulating "gah" dubbed with audio of "bah" may be perceived as "dah". Not everyone is equally susceptible to the McGurk effect. Lip reading involves understanding speech by watching lip and facial movements without hearing the voice.
2 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How does the McGurk effect show that hearing and seeing work together in speech perception?
The McGurk effect demonstrates how visual cues impact speech perception, showing that hearing and seeing collaborate in perceiving speech.
Discovered by cognitive psychologists Harry McGurk and John MacDonald, the effect occurs when there's conflict between auditory and visual information. For example, if a video shows a person articulating "gah" while the audio plays "bah," the viewer may perceive "dah." In this instance, the brain integrates the conflicting visual and auditory inputs, creating a new, blended perception.
Not everyone experiences the McGurk effect to the same degree. Factors such as age, gender, language, and familiarity with the speaker can influence susceptibility. The McGurk effect is a tool in neuroscience, helping researchers study how senses interact and how certain conditions affect audiovisual speech integration.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How do scientists use the McGurk effect to learn more about the brain and language?
The McGurk effect is a tool in neuroscience research that explores how senses interact, especially in audiovisual speech integration. It shows how visual cues impact speech perception. During the McGurk effect, the brain attempts to reconcile mismatched auditory and visual inputs, often perceiving a blended sound.
Researchers use the McGurk effect to study audiovisual speech integration in individuals with conditions like Alzheimer's disease, aphasia, autism, dyslexia, schizophrenia, and specific language impairments. It has also been applied to research on individuals with brain damage to see how the location of damage, handedness, and visual stimuli affect their perception.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles.
McGurk effect, an audiovisual speech illusion that demonstrates the impact of visual cues on speech perception, particularly the identification of spoken syllables.
The effect was named after cognitive psychologist Harry McGurk, who, along with cognitive psychologist John MacDonald, discovered the phenomenon when they were studying the perception of language by infants. They created a video showing a person articulating the syllable gah dubbed with audio of the syllable bah. Upon playback, they both perceived the syllable dah. They then designed a new study to investigate the phenomenon and found that visual input played a role in speech perception. McGurk and MacDonald reported their findings in the paper āHearing Lips and Seeing Voicesā (1976), which was published in the scientific journal Nature.
When the brain is given incomplete or incongruent input from the senses, it fills in the blanks or makes best guesses to construct reality. In terms of the McGurk effect, when the visual information received from mouth movement does not correspond to auditory information received from spoken sounds, the brain makes a best guess by perceiving a third sound. This third sound consists of a blend of the sounds perceived from visual and auditory cues.
" height="20" alt="HEW Logo">
According to research, not everyone is susceptible to the McGurk effect, and the range of susceptibility varies. Studies have shown that women generally experience it more often than men, because visual influences play a bigger role in their speech perception, which also makes them better at understanding speech. Older adults are also more likely to experience the effect because they too are heavily influenced by visual cues when interpreting speech. Children younger than 10 are not as likely to experience the effect because they do not rely as much on the visual aspects of speech perception.
Susceptibility to the McGurk effect also varies from language to language. Research indicates that German, Dutch, Spanish, Italian, and Turkish speakers experience levels of the effect comparable to those of English speakers, whereas Japanese and Chinese speakers are not as prone to experiencing the effect. Cultural and linguistic differences, including the preference for indirect eye contact and simple syllable structures, may account for reduced susceptibility.
When there is a visual distraction, such as a leaf moving across the speakerās face, the listener is less likely to experience the effect. A listenerās familiarity or unfamiliarity with the speaker also influences the effect. Listeners are less likely to experience the effect when they are familiar with the speakerās face and are more likely to experience the effect when they are unfamiliar with the speakerās face. When a listener has clear visibility of the right side of the speakerās mouth, the listener is more likely to experience the effect, because the right side of the mouth moves more during speech than does the left.
Since its discovery, the McGurk effect has become a useful neuroscience research tool in studies on how the different senses work together, and it has been used to examine audiovisual speech integration among people with certain diseases and disorders. There is less likelihood for individuals with Alzheimer disease, aphasia, autism, dyslexia, schizophrenia, and specific language impairment to experience the effect.
The trusted destination for professionals, college students, and lifelong learners.
SUBSCRIBE
The McGurk effect has also been used to examine the audiovisual speech integration of people with brain damage. Multiple variables determine whether individuals with brain damage experience the effect and, if they do, to what extent. Some variables include the hemisphere in which the damage is located, the handedness of the individual, and whether visual stimuli are used.