TRR 318 - Monitoring the understanding of explanations (Subproject A02)

Overview

When something is being explained to someone, the explainee signals their understanding – or lack thereof – to the explainer with verbal expressions and other non-verbal means of communication, such as gestures and facial expressions. By nodding, the explainee can signal that they have understood. Nodding, however, can also be meant as a request to continue with the explanation. This has to be determined from the context of the conversation. In Project A02, linguists and computational linguists are investigating how people (and later, artificial agents) recognize that the person they’re explaining something to is understanding – or not. For this, the research team will be looking at 80 dialogues in which one person explains a social game to another, examining these for communicative feedback signals that indicate varying degrees of comprehension in the process of understanding. The findings from these analyses will be incorporated into an intelligent system that will be able to detect feedback signals such as head nods and interpret them in terms of signaled level of understanding.

Key Facts

Grant Number:
438445824
Project type:
Forschung
Project duration:
07/2021 - 06/2025
Funded by:
Deutsche Forschungsgemeinschaft (DFG)
Website:
Homepage

More Information

Principal Investigators

contact-box image

Dr. Angela Grimminger

Germanistische und Allgemeine Sprachwissenschaft

About the person
contact-box image

Hendrik Buschmeier

Universit?t Bielefeld

About the person (Orcid.org)
contact-box image

Petra Wagner

Universit?t Bielefeld

About the person (Orcid.org)

Associated project members

contact-box image

Stefan Lazarov, M.A.

Transregional Collaborative Research Centre 318

About the person

Cooperating Institutions

Universit?t Bielefeld

Cooperating Institution

Publications

Characteristics of nonverbal behavior
S.T. Lazarov, I. Tchappi, A. Grimminger, in: K.J. Rohlfing, K. Fr?mling, S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, n.d.
Theoretical aspects of multimodal processing
A. Grimminger, H. Buschmeier, in: K.J. Rohlfing, K. Fr?mling, S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, n.d.
Timing and synchronization of multimodal signals in explanations
P. Wagner, S. Kopp, in: K.J. Rohlfing, K. Fr?mling, S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, n.d.
Components of an explanation for co-constructive sXAI
A.-L. Vollmer, H.M. Buhl, R. Alami, K. Fr?mling, A. Grimminger, M. Booshehri, A.-C. Ngonga Ngomo, in: K.J. Rohlfing, K. Fr?mling, S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, n.d.
Incremental communication
B. Wrede, H. Buschmeier, K.J. Rohlfing, M. Booshehri, A. Grimminger, in: K.J. Rohlfing, K. Fr?mling, S. Alpsancar, K. Thommes, B.Y. Lim (Eds.), Social Explainable AI, Springer, n.d.
Show all publications