An Activity Simulation Game of the Put the Balls into the Boxes for Arm and Hand Movement Rehabilitation using Depth Sensor Camera

Abstract

This research is the development of a game to support arm and hand movement recovery for patients who require rehabilitation due to stroke. The game is a simulation of an activity that is the “Put the balls into the boxes” activity. It is the occupational therapy activity normally performed in the rehabilitation process. In this research, it is designed as a computer game to increase motivation of the patients. To play the game, the user has to move his hand to grasp the balls that were shown on the computer screen and put them by releasing his hand at the boxes with corresponding color that are located at the center of the screen. The balls and the boxes are in two different colors that are red and yellow. The user has to control movement of his arm to keep away from the poles that are stationary obstacles on the screen. If hitting occurs, it will simulate collision by showing bounce effect of the ball. The position and state of the hand and the arm are inputted to computer by using depth sensor camera. The experiments were performed by non-patient and patient subjects. The subject with hemiparesis could play until the end of the game. The subject that is still in working-age population tried to play until the end of the game because he wanted to recover as soon as possible. This showed the game promoted positive motivation in the patients.