Sound and vision: Visual cortex processes auditory information too
They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.
Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: “Sounds create visual imagery, mental images, and automatic projections.
“So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised.”
The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early visual cortex in 10 volunteer subjects.
In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.
Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.
A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.
Lars Muckli said: “This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.
“In future we will test how this auditory information supports visual processing, but the assumption is it provides predictions to help the visual system to focus on surprising events which would confer a survival advantage.
“This might provide insights into mental health conditions such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals.”
The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.
The researchers will explore more sounds to find out how precise predictive coding in the brain can be.
Related links
- Research paper: 'Decoding sound and imagery content in early visual cortex', Current Biology
- Professor Lars Muckli: researcher profile
- Institute of Neuroscience and Psychology research page
Media enquiries: stuart.forsyth@glasgow.ac.uk / +447854 034 342 / +44141 330 3535
Media Contact
More Information:
http://www.glasgow.ac.ukAll latest news from the category: Studies and Analyses
innovations-report maintains a wealth of in-depth studies and analyses from a variety of subject areas including business and finance, medicine and pharmacology, ecology and the environment, energy, communications and media, transportation, work, family and leisure.
Newest articles
Compact LCOS Microdisplay with Fast CMOS Backplane
…for High-Speed Light Modulation. Researchers from the Fraunhofer Institute for Photonic Microsystems IPMS, in collaboration with HOLOEYE Photonics AG, have developed a compact LCOS microdisplay with high refresh rates that…
New perspectives for material detection
CRC MARIE enters third funding period: A major success for terahertz research: Scientists at the University of Duisburg-Essen and the Ruhr University Bochum have been researching mobile material detection since…
CD Laboratory at TU Graz Researches New Semiconductor Materials
Using energy- and resource-saving methods, a research team at the Institute of Inorganic Chemistry at TU Graz aims to produce high-quality doped silicon layers for the electronics and solar industries….