ACM Transactions on Graphics · 2015 · 42 citations · 34 references
ComputingComputer ScienceEducational TechnologyInformation RetrievalNatural Language ProcessingVisual RepresentationMultimedia Instructional ContentMultimedia LearningMultimedia RetrievalMultimodal InteractionText VisualizationEducational Content UnderstandingLearning With VideoLecture Video AnalysisTranscript AnnotationTranscriptsUser Study Evaluation
Blackboard-style lecture videos are popular, but learning using existing video player interfaces can be challenging. Viewers cannot consume the lecture material at their own pace, and the content is also difficult to search or skim. For these reasons, some people prefer lecture notes to videos. To address these limitations, we present Visual Transcripts , a readable representation of lecture videos that combines visual information with transcript text. To generate a Visual Transcript, we first segment the visual content of a lecture into discrete visual entities that correspond to equations, figures, or lines of text. Then, we analyze the temporal correspondence between the transcript and visuals to determine how sentences relate to visual entities. Finally, we arrange the text and visuals in a linear layout based on these relationships. We compare our result with a standard video player, and a state-of-the-art interface designed specifically for blackboard-style lecture videos. User evaluation suggests that users prefer our interface for learning and that our interface is effective in helping them browse or search through lecture videos.
34
Story-Driven Summarization for Egocentric Video
Zheng Lu, Kristen Grauman · 2013 · 520 citations
Shingo Uchihashi, Jonathan Foote, Andreas Girgensohn et al. · 1999 · 289 citations · Full text