Digital systems for live multimodal performance in Death and the Powers

Abstract

ABSTRACTThe opera Death and the Powers by Tod Machover tells the story of a man, Simon Powers, who evades death by transferring his essence into his environment as his corporeal body dies. To realize the effect of the theatrical environment coming alive as the main character, the Opera of the Future research group at the MIT Media Lab developed new technologies and control systems for interactive robotics, sound and visuals in live theatre. A core component of this work is the technique of Disembodied Performance, a method and associated technological infrastructure that translates the live performance of the offstage opera singer into multimodal representations onstage. The author was principally responsible for the control architecture and Disembodied Performance software implementation, as well as the design of the visual language used to represent Simon Powers. These digitally-enabled elements were created in order to support the story of the opera and facilitate the process of crafting and rehearsing...