Multimodal expressive embodied conversational agents

Catherine Pélachaud

2005 · 122 citations · 17 references

Concepts

TL;DR

The Affective Presentation Markup Language (APML) was defined to drive animation of the agent based on a communicative function taxonomy. The study presents the development of a multimodal expressive Embodied Conversational Agent (ECA) named Greta. The agent’s behavior is specified using Isabella Poggi’s communicative function taxonomy, with individual characteristics encoded through a set of parameters that adjust gesture and facial expressivity. Greta demonstrates speech‑synchronized nonverbal behaviors, with six expressivity parameters implemented and validated through perceptual studies.

Abstract

In this paper we present our work toward the creation of a multimodal expressive Embodied Conversational Agent (ECA). Our agent, called Greta, exhibits nonverbal behaviors synchronized with speech. We are using the taxonomy of communicative functions developed by Isabella Poggi [22] to specify the behavior of the agent. Based on this taxonomy a representation language, Affective Presentation Markup Language, APML has been defined to drive the animation of the agent [4]. Lately, we have been working on creating no longer a generic agent but an agent with individual characteristics. We have been concentrated on the behavior specification for an individual agent. In particular we have defined a set of parameters to change the expressivity of the agent's behaviors. Six parameters have been defined and implemented to encode gesture and face expressivity. We have performed perceptual studies of our expressivity model.

References

17