University of Sussex selected by The European Research Council (ERC) for a Synergy Grant, with CNRS and Université Jean Monnet Saint-Étienne, for a research projet that makes seeing sounds possible
Birdsong, a baby's cry, music, an ambulance siren: sounds constantly inform us about our surroundings and about other people, yet they remain largely out of reach for the more than 400 million people worldwide who live with disabling hearing loss, which represents more than 400 million people worldwide. ViSONIC aims to turn environmental sounds into images that anyone can understand intuitively, without training. Funded by a €6.8M ERC Synergy Grant over six years (start date no later than April 1, 2027, with the exact date currently being determined in coordination with ERC), ViSONIC brings together bioacoustics (ENES Bioacoustics Lab, CRNL, CNRS UMR, Inserm, Université Jean Monnet, Saint-Étienne), developmental psychology (National Centre for Scientific Research – CNRS - Grenoble) and multisensory science (University of Sussex, UK).
When the brain links vision and hearing
The project builds on associations we all make spontaneously between the senses: a high-pitched sound brings to mind a light colour, a small object or an upward movement. Combining acoustic analysis, artificial intelligence and perception experiments, the team (David Reby, ENES-CRNL-UJM, Olivier Pascalis, CNRS, et Julia Simner, University of Sussex) will build a library of about 1,000 "sonic visuals". It will then study how these visuals are understood by adults, children and infants, by hearing and deaf people, by synaesthetes and by people who are hypersensitive to sound. This work will show how the brain links vision and hearing, when this ability emerges in development, and whether it depends on auditory experience.

Concrete applications in everyday life
The project will also lead to practical tools: a visual baby monitor that lets deaf parents "see" their baby's cries, silent gaming interfaces for people distressed by certain sounds, and a virtual-reality cultural event bringing deaf and hearing audiences together.

An ERC (European Research Council) Synergy Grant is a prestigious and highly selective funding program from the European Commission. It is designed for small groups of 2 to 4 principal investigators (PIs) who combine their skills, knowledge, and resources to propose ambitious, transformative, and groundbreaking research programs. This year, 48 projects were selected from 957 applications, with 14 French laboratories involved.

Université Jean Monnet