The Leap Motion controller

Leigh Ellen Potter, Jake Araullo, Lewis Carter

2013 · 277 citations · 3 references

DOIFull text

Open access

Concepts

TL;DR

The study explores the suitability of the Leap Motion controller for recognizing Australian Sign Language. The authors used the Leap Motion controller to track hand and finger movements, noting reduced accuracy when the hand blocks the sensor or when fingers touch. Testing demonstrated accurate hand and finger tracking, but performance degrades in obstructed or finger‑touching positions, indicating potential for Auslan recognition pending further API development.

Abstract

This paper presents an early exploration of the suitability of the Leap Motion controller for Australian Sign Language (Auslan) recognition. Testing showed that the controller is able to provide accurate tracking of hands and fingers, and to track movement. This detection loses accuracy when the hand moves into a position that obstructs the controller's ability to view, such as when the hand rotates and is perpendicular to the controller. The detection also fails when individual elements of the hands are brought together, such as finger to finger. In both of these circumstances, the controller is unable to read or track the hand. There is potential for the use of this technology for recognising Auslan, however further development of the Leap Motion API is required.

References

3