A multimodal interaction component for digital television

Diogo Pedrosa, José Augusto Costa Martins, Erick Lazaro Melo, César A. C. Teixeira

2011 · 14 citations · 13 references

Concepts

Abstract

In most current digital TV applications the user interaction takes place by pressing keys on a remote control. For simple applications this type of interaction is sufficient --- however, as interactive applications become more popular new input devices are demanded. After discussing motivating scenarios, this paper presents an architecture that offers to applications running on a set-top-box the possibility of receiving multimodal data (audio, video, image, ink, accelerometer, text, voice and customized data) from multiple devices (such as mobile phones, PDAs, tablet PCs, notebooks or even desktops). We validated the architecture by implementing a corresponding multimodal interaction component which extends the Brazilian Digital TV middleware, and by building applications which use the component.

References

13