Augmenting real-world objects

Lisa Stifelman

1996 · 90 citations · 3 references

Concepts

TL;DR

The Audio Notebook records lectures or meetings and synchronizes the audio with handwritten notes, automatically scanning to page starts and allowing access via pen pointing or a scrollbar. The study aims to automatically segment recorded speech using acoustic cues combined with user activity to structure the audio. A small observational study of users in real settings was conducted, and future work will integrate acoustic cue segmentation with user activity to organize the audio. The prototype did not interfere with normal interactions and reassured users that key ideas could be accessed later.

Abstract

The Audio Notebook allows a user to capture and access an audio recording of a lecture or meeting in conjunction with notes written on paper. The audio recording is synchronized with the user’s handwritten notes and page turns. As a user flips through physical pages of notes, the audio scans to the start of each page. Audio is also accessed by pointing with a pen to a location in the notes or using an audio scrollbar. A small observational study of users in real settings was performed. The prototype did not interfere with the user’s normal interactions yet gave reassurance that key ideas could be accessed later. In future work, automatic segmentation of the recorded speech using acoustic cues will be combined with user activity to structure the audio.

References

3