Stream 2: Attentional mechanisms in language processing and communication: from humans to virtual agents

Module 1 & 2: Introduction 
This module will provide a theoretical introduction to the stream, focussing on visual attention in language processing and face-to-face communication. This will be followed by a practical session, gathering experimental data with the Eyelink 1000 eyetracker.


Module 3 & 4: Eye-tracking data analysis
In this module, we will continue collecting data and discuss how to analyse fixation patterns using SR DataViewer. This includes an introduction to statistical analysis methods.


Module 5 & 6: Applying eye-tracking to interactive system
In this module we will model user gaze in human–agent interaction. We will track the user’s gaze while interacting with the virtual conversational agent “Billie”. We will also analyse it in real-time and let Billie react to it.


Module 7 & 8: Beyond eye-tracking & Final discussion
In the final module we will look at markers of user attention that go beyond gaze behaviour (e.g., vocal-verbal feedback, head gestures and facial expressions). We will conclude this stream with a discussion of current research results and future research perspectives, including thoughts on modelling visual attention at the interface between communicative and non-communicative situations.