Title | Machine Learning for Enhancing Dementia Screening in Ageing Deaf Signers of British Sign Language |
---|
Authors | Xing Liang, Bencie Woll, Kapetanios, E., Angelopoulou, A. and Reda Al batat |
---|
Type | Conference paper |
---|
Abstract | Real-time hand movement trajectory tracking based on machine learning approaches may assist the early identification of dementia in ageing deaf individuals who are users of British Sign Language (BSL), since there are few clinicians with appropriate communication skills, and a shortage of sign language interpreters. In this paper, we introduce an automatic dementia screening system for ageing Deaf signers of BSL, using a Convolutional Neural Network (CNN) to analyse the sign space envelope and facial expression of BSL signers recorded in normal 2D videos from the BSL corpus. Our approach involves the introduction of a sub-network (the multi-modal feature extractor) which includes an accurate real-time hand trajectory tracking model and a real-time landmark facial motion analysis model. The experiments show the effectiveness of our deep learning based approach in terms of sign space tracking, facial motion tracking and early stage dementia performance assessment tasks. |
---|
Keywords | Real-Time Hand Tracking |
---|
| Facial Analysis |
---|
| British Sign Language |
---|
| Dementia |
---|
| Convolutional Neural Network |
---|
Year | 2020 |
---|
Conference | LREC 2020, 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives |
---|
Publisher | European Language Resources Association (ELRA) |
---|
Publisher's version | License CC BY-NC 4.0 File Access Level Open (open metadata and files) |
---|
Publication dates |
---|
Published | 11 May 2020 |
---|
Journal citation | pp. 135-138 |
---|
Book title | Proceedings of the 9th Workshop on the Representation and Processing of Sign Languages |
---|
ISBN | 9791095546542 |
---|
Funder | Dunhill Medical Trust |
---|
Web address (URL) of conference proceedings | https://lrec2020.lrec-conf.org/media/proceedings/Workshops/Books/SIGN2020book.pdf |
---|
Web address (URL) | https://www.sign-lang.uni-hamburg.de/lrec2020/cfp.html |
---|
File | File Access Level Open (open metadata and files) |
---|