Scientists in the United Kingdom have developed AI-powered glasses capable of giving wearers extraordinary hearing abilities by merging visual and audio processing. The project is a collaboration between researchers at Heriot-Watt University, Edinburgh Napier University, and the University of Stirling, who set out to build a wearable device that could enhance communication in noisy environments. The glasses are equipped with a camera that interprets lip movements and translates them into clear speech, which is then transmitted as enhanced audio to the user. This advancement is being positioned as a valuable aid for individuals with hearing impairments while also having applications in high-noise work environments.
The glasses operate by training their AI model on a wide range of background noise samples, including traffic sounds, household appliances, and crowded public spaces. When a user looks directly at someone speaking, the system isolates the voice of that individual using lip-reading data combined with audio cues, even in situations where multiple people are talking at once. This selective hearing ability gives wearers a distinct advantage, allowing them to follow conversations without struggling against background noise. Unlike conventional hearing aids, which amplify all sounds indiscriminately, the AI system delivers targeted listening tailored to the user’s focus of attention.
One of the unique aspects of the technology is its reliance on cloud-based processing. The data collected from the glasses is transmitted to servers located in Sweden, where advanced algorithms handle the speech recognition and sound enhancement tasks before sending results back to the user in real time. This functionality depends on high-speed internet connectivity, making it compatible with modern broadband and 5G networks. While primarily envisioned as an assistive device for individuals who are both hearing and visually impaired, the glasses are also being highlighted as useful in professional environments such as oil rigs, busy construction sites, or entertainment venues where noise levels typically interfere with communication.
According to Professor Mathini Sellathurai of Heriot-Watt University, one of the leading researchers on the project, the goal is not to replace traditional hearing aids but to expand their potential. “Our aim isn’t to reinvent hearing aids but to give them superpowers,” she said. The research team has initiated discussions with hearing aid manufacturers to explore pathways for collaboration, with the expectation of having a working version of the AI-powered glasses ready by 2026. Once refined, the system is planned to be made available to the public as a cloud-based solution, compatible with a wide range of wearable devices. Experts note that this innovation could redefine how wearable technologies assist human senses, bridging the gap between assistive healthcare tools and everyday smart gadgets.
Follow the SPIN IDG WhatsApp Channel for updates across the Smart Pakistan Insights Network covering all of Pakistan’s technology ecosystem.
