2019 · 52 citations · 26 references
ComputingComputer ScienceHuman-computer InteractionInteraction DesignProgramming LanguagesApplication Programming InterfacesGesture-based InteractionInteraction Design PrinciplesInterface DesignMultimodal InteractionTouch BehaviorGesture ConstructionGesture InterpretationMulti-touch GesturesMulti-touch InteractionMultimodal Gesture InteractionMultimodal User InterfacesTouch Interaction
Multi-touch gestures can be very difficult to program correctly because they require that developers build high-level abstractions from low-level touch events. In this paper, we introduce programming primitives that enable programmers to implement multi-touch gestures in a more understandable way by helping them build these abstractions. Our design of these primitives was guided by a formative study, in which we observed developers' natural implementations of custom gestures. Touch groups provide summaries of multiple fingers rather than requiring that programmers track them manually. Cross events allow programmers to summarize the movement of one or a group of fingers. We implemented these two primitives in two environments: a declarative programming system and in a standard imperative programming language. We found that these primitives are capable of defining nuanced multi-touch gestures, which we illustrate through a series of examples. Further, in two user evaluations of these programming primitives, we found that multi-touch behaviors implemented in these programming primitives are more understandable than those implemented with standard touch events.
26
User-defined gestures for surface computing
Jacob O. Wobbrock, Meredith Ringel Morris, Andrew D. Wilson · 2009 · 1.3K citations
Computing, Computer Science, Design +17
Memorability of pre-designed and user-defined gesture sets
Miguel A. Nacenta, Yemliha Kamber, Yizhou Qiang et al. · 2013 · 277 citations · Full text
Natural programming languages and environments
Brad A. Myers, John F. Pane, Amy J. Ko · Communications of the ACM · 2004 · 241 citations