This paper proposes an immersive training system for patients with hand dysfunction who can perform rehabilitation training independently. The system uses Leap Motion binocular vision sensors to collect human hand information, and uses the improved PCA
(Principal Component Analysis) to perform data fusion on the real-time data collected by the sensor to obtain more hands with fewer principal components, and improve the stability and accuracy of the data. Immediately, the use of improved SVM
(Support Vector Machine) and KNN
(K-Nearest Neighbor Algorithm) for gesture recognition and classification is proposed to enable patients to perform rehabilitation training more effectively. Finally, the effective evaluation results of the rehabilitation effect of patients by the idea of AHP
(Analytic Hierarchy Process) are taken as necessary reference factors for doctors to follow up treatment. Various experimental results show that the system has achieved the expected results and has a good application prospect.