Multimodal Dementia Tests with Embodied Conversational Agents in VR

Published by Alexander Prange on

Embodied conversational agents will be used for exploring multimodal approaches of active input in virtual reality (combination of speech and pen input) to determine the cognitive status of the user.

Contact

Fabrizio Nunnari

Categories: Multimodality

Related Posts

Multimodality

EyeLogin – Calibration-free Authentication Method For Public Displays Using Eye Gaze

Motivation The usage of interactive public displays has increased including the number of sensitive applications and, hence, the demand for user authentication methods. We implement a calibration-free authentication method for situated displays based on saccadic Read more…

Multimodality

Digital Pens in Education

Digital pen signals were shown to be predictive for cognitive states, cognitive load and emotion in educational settings. We investigate whether low-level pen-based features can predict the difficulty of tasks in a cognitive test and Read more…

Multimodality

Multimodal Interactive Knowledge Exploration

In this project, we consider scenarios which include one or more expert users that interact with a multimodal-multisensor interface. In particular, we focus on applications of eye tracking and speech-based input for semantic search applications, Read more…