Submit Manuscript  

Article Details


Gesture Interaction for Coronary Heart Diseases Based on Wavelet Transform and Semi-Continuous Hidden Markov Model in Augmented Reality

[ Vol. 10 , Issue. 2 ]

Author(s):

Mingke Gao, Yimin Chen*, Dianhua Zhang, Zeyu Li, Siyu Jiang, Shengqing Lv, Rongrong Lu, Jiahui Lu and Chen Huang   Pages 150 - 165 ( 16 )

Abstract:


Background: Most doctors are used to locate the vascular stenosis position first then clinically estimate vascular stenosis by the CAG images instead of using mouse, keyboard and computer during the preoperative diagnosis. Therefore, it is necessary to have an effective, intuitive and natural method to replace the existing preoperative diagnosis mode for diagnosing the coronary heart disease.

Methods: This work presents the gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. Firstly, the dynamic gesture trajectory is analyzed by using K-means cluster algorithm to determine the gesture trajectory plane. Secondly, the integrity of the trajectory is preserved on the sensor plane by employing trajectory projection and space rotation transformation. Thirdly, the features include the azimuth of gesture trajectory and the changes of hand shape are extracted. Meanwhile, the azimuth of gesture trajectory is analyzed by utilizing wavelet transform and the singularity of the trajectory is detected to compute the state number of SCHMM for all the dynamic gestures. The gesture training is completed by employing Baum-Welch algorithm with multi-features and multi-observation sequences. Ultimately, gesture recognition is realized by using Viterbi algorithm based on self-learning mechanism. It is then applied into the gesture interactive diagnosis of coronary heart disease and the diagnosis of the vascular stenosis are intuitively and naturally realized with augmented reality and gesture interactive techniques.

Results: The number of states of dynamic gesture is determined by using wavelet transform which precisely detect singular points of gesture trajectory. The recognition rate of dynamic gesture is average of 96.1% and the semi-dynamic gesture is average of 92.6%, the total recognition rate is average of 95.6%. The dynamic gesture recognition rate of the proposed method is 7% higher than the traditional method. The intuitive and natural gesture interactive experiments and the affirmed measuring results are approved by surgeons.

Conclusions: The proposed method is a feasible, usable and reliable gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. The results demonstrate that the proposed method could improve the gesture recognition rate, extend the gesture manipulation space and expand the diagnostic method for coronary heart diseases.

Keywords:

Augmented reality, coronary heart disease, gesture interaction, gesture recognition, semi-continuous hidden markov model, wavelet transform.

Affiliation:

School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, P.O. Box: 200444, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai, School of Computer Engineering and Science, Shanghai University, Shanghai

Graphical Abstract:



Read Full-Text article