Quick menu selection using eye blink for eye-slaved nonverbal communicator with video-based eye-gaze detection

Abstract

The blink was used for quick menu selection on the communicator developed for the physically disabled. The menu option selected by the eye-gaze was emphasized in color. The determination (input) of the selected menu was executed using the pupil area, which were obtained from the custom-made image processor for eye-gaze detection. An automatic threshold setting method was designed to detect a blink independent of environmental lighting conditions. The subject blinked voluntarily as if he clicked the computer mouse after fixing his gaze on a menu option. The voluntary and involuntary blinks were distinguished by the difference of their duration. The moving average method for precise eye gaze detection produced the shift of the emphasized option near the blink in time, making the subject feel uncomfortable. To prevent this, the eye-gaze points during and near the blink in time were compensated using a simple technique in real time. Four Japanese letter menus were designed. Using these, the efficiency of the quick menu selection method using the blink and eye-gaze was confirmed.