ADAPT Radio: Breaking Barriers with Sign Language Translation

02 September 2024

In terms of society, we have to remember that it’s very audio dependent. Everything is based on sound. Think of the TV, radio, emergency announcements in a train station or at an airport. Often audio Tannoy based information. It’s very rarely considered to put it in a visual medium, and that’s an issue for Deaf community members. – Davy Van Landuyt

In our increasingly digital world, accessing online information has become an essential part of everyday life. However, for minority communities like the deaf and hard of hearing, this access is often hindered by significant barriers. In the latest episode of ADAPT Radio, our experts discuss the challenges this community faces in the digital world and barriers that exist in sign language translation. This month’s podcast features an in-depth discussion with experts from the SignON Project, a European initiative dedicated to improving digital accessibility for the deaf and hard of hearing (DHH). The project aims to create a more inclusive online experience through innovative technology that translates between sign and oral languages.

Dr. Dimitar Shterionov, Assistant Professor in Cognitive Science and Artificial Intelligence at Tilburg University and scientific lead on the SignON Project, shares insights into the groundbreaking AI technology at the heart of the project. The AI leverages deep learning and computer vision to provide culturally sensitive and contextually accurate translations, addressing the critical communication needs of over 205,000 sign language users across the project’s target regions.

Davy Van Landuyt, Project Officer with the European Union of the Deaf and a deaf end-user of the project, also provides his perspective on the real-world challenges faced by the DHH community. With the support of interpreter Romy O’Callaghan, Davy highlights how society often overlooks the needs of those who rely on visual rather than audio information, such as in emergency announcements or public transport systems. He emphasizes the importance of ensuring that the deaf community has equal access to information, on par with their hearing peers.

The SignON Project’s commitment to co-creation, involving deaf professionals from the start, has been crucial to its success. By actively engaging with the deaf community throughout the development process, the project ensures that the solutions it offers are both practical and impactful, avoiding the pitfalls of past innovations that failed to consider the true needs of the community. Tune in to this enlightening episode of ADAPT Radio: HumanAIse, where our experts discuss the future of AI, digital accessibility, and the importance of inclusive design. Listen here or wherever you get your podcasts. This podcast is also available with international sign language and closed captions on YouTube.

The SignON EU consortium includes 17 European partners led by Prof. Andy Way, Professor of Computing at Dublin City University, Ireland (coordinator), and Dr. Dimitar Shterionov Assistant Professor in Cognitive Science and Artificial Intelligence at Tilburg University, The Netherlands (scientific lead).  The Irish team included in the work included:

  • DCU School of Computing / ADAPT: Aoife Brady, Andy Way, Emma Clarke, Jane Dunne
  • DCU School of Inclusion: Shaun O’Boyle, Elizabeth Matthews
  • TCD: Lorraine Leeson, Rachel Moiselle, Lianne Quigley, David Loughrey, Anthony Ventresque, Ellen Rushe, Ruth Holmes
  • TUD: Irene Murtagh and Zaid Mohammed

Societal Partners include:

European Union of the Deaf: Davy Van Landuyt, Frankie Picron, Mark Wheatley, Rehana Omardeen
Vlaams GebarentaalCentrum: Hannes de Durpel, Jorn Rijckaert, Caro Brosens, Sam Verstraete, Jaron Garitte