Automatic eye state recognition and closed-eye photo correction

Abstract

In this paper, we present an approach for eye state recognition and closed-eye photo correction. For eye state recognition, AdaBoosted cascade open-eye detectors of different scales are trained. For closed-eye photo correction, a PCA generative model of concatenated corresponding closed-eye and open-eye texture patterns is built, and given a closed-eye texture pattern, an algorithm is proposed to recover its corresponding open-eye one for closed-eye replacement. Experiments on popular consumer images show our open-eye detectors achieved 94.71% correct recognition rate, and the closed-eye photo correction looks very natural.