The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the Read more…
DFKI presents a Multimodal Speech-based Dialogue for the Mini-Mental State Examination at the CHI 2019 conference in Glasgow.
In this project, we consider scenarios which include one or more expert users that interact with a multimodal-multisensor interface. In particular, we focus on applications of eye tracking and speech-based input for semantic search applications, e.g., interactive knowledge exploration. We aim at developing interaction techniques for individual modalities, combinations thereof Read more…
Learning through Human-Robot Dialogues Today, robots are present in our lives and they will be even more ubiquitous in the future. This advance of robotic technologies also poses the question how humans can guide the behavior of a robot and, in particular, how non-specialists can advise robots to learn new Read more…