2005 · 122 citations · 17 references
ComputingAutonomous SystemsInteraction DesignNatural Language ProcessingNonverbal CommunicationAffective ComputingEmbodied InteractionFacial ExpressionMultimodal CommunicationMultimodal InteractionSpeech InteractionAffective LanguageBehavioral SpecificationLanguage Representation Systems
The Affective Presentation Markup Language (APML) was defined to drive animation of the agent based on a communicative function taxonomy. The study presents the development of a multimodal expressive Embodied Conversational Agent (ECA) named Greta. The agent’s behavior is specified using Isabella Poggi’s communicative function taxonomy, with individual characteristics encoded through a set of parameters that adjust gesture and facial expressivity. Greta demonstrates speech‑synchronized nonverbal behaviors, with six expressivity parameters implemented and validated through perceptual studies.
In this paper we present our work toward the creation of a multimodal expressive Embodied Conversational Agent (ECA). Our agent, called Greta, exhibits nonverbal behaviors synchronized with speech. We are using the taxonomy of communicative functions developed by Isabella Poggi [22] to specify the behavior of the agent. Based on this taxonomy a representation language, Affective Presentation Markup Language, APML has been defined to drive the animation of the agent [4]. Lately, we have been working on creating no longer a generic agent but an agent with individual characteristics. We have been concentrated on the behavior specification for an individual agent. In particular we have defined a set of parameters to change the expressivity of the agent's behaviors. Six parameters have been defined and implemented to encode gesture and face expressivity. We have performed perceptual studies of our expressivity model.
17
Hand and mind: what gestures reveal about thought
Choice Reviews Online · 1993 · 5.1K citations
Candace L. Sidner, Cory D. Kidd, Christopher Lee et al. · 2004 · 324 citations