Chapter title |
Audio Visual Integration with Competing Sources in the Framework of Audio Visual Speech Scene Analysis
|
---|---|
Chapter number | 42 |
Book title |
Physiology, Psychoacoustics and Cognition in Normal and Impaired Hearing
|
Published in |
Advances in experimental medicine and biology, April 2016
|
DOI | 10.1007/978-3-319-25474-6_42 |
Pubmed ID | |
Book ISBNs |
978-3-31-925472-2, 978-3-31-925474-6
|
Authors |
Attigodu Chandrashekara Ganesh, Frédéric Berthommier, Jean-Luc Schwartz |
Editors |
Pim van Dijk, Deniz Başkent, Etienne Gaudrain, Emile de Kleine, Anita Wagner, Cris Lanting |
Abstract |
We introduce "Audio-Visual Speech Scene Analysis" (AVSSA) as an extension of the two-stage Auditory Scene Analysis model towards audiovisual scenes made of mixtures of speakers. AVSSA assumes that a coherence index between the auditory and the visual input is computed prior to audiovisual fusion, enabling to determine whether the sensory inputs should be bound together. Previous experiments on the modulation of the McGurk effect by audiovisual coherent vs. incoherent contexts presented before the McGurk target have provided experimental evidence supporting AVSSA. Indeed, incoherent contexts appear to decrease the McGurk effect, suggesting that they produce lower audiovisual coherence hence less audiovisual fusion. The present experiments extend the AVSSA paradigm by creating contexts made of competing audiovisual sources and measuring their effect on McGurk targets. The competing audiovisual sources have respectively a high and a low audiovisual coherence (that is, large vs. small audiovisual comodulations in time). The first experiment involves contexts made of two auditory sources and one video source associated to either the first or the second audio source. It appears that the McGurk effect is smaller after the context made of the visual source associated to the auditory source with less audiovisual coherence. In the second experiment with the same stimuli, the participants are asked to attend to either one or the other source. The data show that the modulation of fusion depends on the attentional focus. Altogether, these two experiments shed light on audiovisual binding, the AVSSA process and the role of attention. |
X Demographics
As of 1 July 2024, you may notice a temporary increase in the numbers of X profiles with Unknown location. Click here to learn more.
Geographical breakdown
Country | Count | As % |
---|---|---|
Ireland | 1 | 50% |
Unknown | 1 | 50% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 1 | 50% |
Scientists | 1 | 50% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 14 | 100% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Master | 4 | 29% |
Student > Ph. D. Student | 2 | 14% |
Student > Doctoral Student | 2 | 14% |
Researcher | 1 | 7% |
Unknown | 5 | 36% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 3 | 21% |
Linguistics | 1 | 7% |
Agricultural and Biological Sciences | 1 | 7% |
Nursing and Health Professions | 1 | 7% |
Computer Science | 1 | 7% |
Other | 1 | 7% |
Unknown | 6 | 43% |