Virtual laboratory—Using a hand movement recognition system to improve the quality of chemical education

Abstract

Abstract The rapid development of information and communication technologies has enabled the development of interfaces, which allow the recognition of the gestures and movements of the user. These interfaces, due to their affordable prices, are available to a wide range of users. They are called natural user interfaces (NUI). NUI are commonly used in game consoles and electronic devices, such as smartphones and tablets. We used the Kinect sensor from Microsoft in our studies to identify the movements and gestures of the user. This interface was used by us in teaching Chemistry in a Middle School and High School by developing a virtual chemical laboratory, which is based on a system of hand movements. We have analyzed the gestures and movements of the virtual chemical laboratory user to determine how they raise the effectiveness in chemical education. The results show how much better students work with a virtual laboratory, when studied by us in chemical areas, that concerned remembering information, understanding information, applying their experience in situations familiar to them from school and in solving chemical problems.