Categories
All Lab News

AI for Inclusion: Demonstrating HKSL Handshape Detection at InnoCarnival 2026

Our lab was thrilled to take part in InnoCarnival 2026, held from 24 October to 1 November at Hong Kong Science Park. Organised by the Innovation and Technology Commission, the Carnival celebrates innovation and technology across the community through interactive exhibitions, workshops, games, and showcases of local research achievements.

At our booth, “A Helping Hand for the Deaf Elderly by Recognizing Handshapes,” we created an interactive, technology-led experience that brought Hong Kong Sign Language (HKSL) research to life in an accessible, engaging, and enjoyable way for visitors of all ages and backgrounds.

The highlight was our Real-Time Handshape Detection Interactive Session. Visitors stepped in front of a camera and performed simple handshapes or basic signs. Our machine-learning HKSL handshape detection model recognised each handshape instantly, displayed the result on a large screen, and linked it to the corresponding entry in our HKSL database. Each entry included an authentic citation sign video, English and Cantonese translations, and handshape annotations.

It was genuinely inspiring to see young children, elderly visitors, students, families, and curious members of the public experiencing AI-powered sign language technology together. Children enjoyed trying playful handshapes, while adults explored more complex signs, creating a quick, rewarding, hands-on experience that showed how AI can help support and preserve an endangered language.

Looking ahead, we hope this work will contribute to broader HKSL access across healthcare, transport, digital finance, family learning, and professional interpreting pathways in Hong Kong.

InnoCarnival 2026 reminded us that innovation is at its most powerful when it brings people closer together. Through AI and HKSL research, we are proud to take another step towards a more inclusive and accessible future.

Categories
All Lab News

A helping hand for the Deaf elderly by recognizing handshapes

Our lab will showcase our project at InnoCarnival 2026, focusing on supporting Hong Kong’s elderly Deaf community through advanced technology. This initiative employs cutting-edge AI-powered real-time handshape recognition to assist in preserving Hong Kong Sign Language (HKSL), a vital element of our city’s cultural heritage.

Designed with elderly users in mind, the system allows individuals to form signs in front of a camera and receive immediate feedback: accurately identifying handshapes, displaying authentic video examples, and providing translations in both English and Cantonese, sourced from a comprehensive database of HKSL.

This project not only helps preserve an endangered language but also promotes greater inclusion for elderly members of the Deaf community, many of whom have limited access to spoken and written languages. By making advanced technology accessible, educational, and engaging for seniors, it fosters intergenerational understanding and strengthens community bonds. Ultimately, it exemplifies how AI can serve both cultural preservation and social empowerment, ensuring that no one is left behind.