Emotions play an important role for our experience of the world and ourselves as they color experience and influence our decisions and their execution. Furthermore, the expression of emotions and perception of emotions are highly relevant for social interaction. Emotions manifest normally in a number of carriers such as facial expression, movement, prosody in spoken language, explicitly by the choice of spoken works. Yet for children who suffer from Autism Spectrum Disorder (ASD), the perception, processing and manifestation of emotional signals is hindered. In this research, we target at helping ASD children with difficulties in expressing emotion especially via vocalisation. We develop an auditory-based interface which aims to provide an artificial way of vocalisation through simple interaction with a smartphone app. The system could bypass cognitive processing steps and facilitate the expression of emotion in a direct way. We also look into the difference in ASD children’s emotional category in comparison to typically developed person.

Involved People

• Thomas Hermann
• Jiajun Yang
• Yukie Nagai

Publication

Supplementary material