CURVELET TRANSFORM AND HMM CLASSIFIER BASED SIGN LANGUAGE RECOGNITION SYSTEM
A communication tool in the form of sign language is required for deaf and dump persons as there is no oral communication possible between them. They perform the conversion of sign languages into voice/text. Recently, many algorithms are developed for this purpose. An Indian Sign Language Recognition (ISLR) system is presented in this paper. It uses curvelet transform based entropy features for the recognition, and the transform is applied only to the segmented hand region. Then, the features of each sign of English alphabets are modelled by a classier network called Hidden Markov Models (HMM). The system gives an average accuracy of 82.95% using 3rd level features which can help to reduce the communication gap between deaf-dumb and normal people in the world.
T. Starner and A. Pentland, â€œReal-time American Sign Language recognition from video using hidden Markov modelsâ€, In Motion-Based Recognition, Springer Netherlands, 1997, pp. 227-243.
Y. Li, X. Chen, X. Zhang, K. Wang and Z.J. Wang, â€œA sign-component-based framework for Chinese sign language recognition using accelerometer and sEMG dataâ€, IEEE transactions on biomedical engineering, Vol. 59, No. 10, 2012, pp. 2695-2704.
C.M. Capek, D. Waters, B. Woll, M. MacSweeney, M.J. Brammer, P.K. McGuire and R. Campbell, â€œHand and mouth: Cortical correlates of lexical processing in British Sign Language and speech reading Englishâ€, Journal of Cognitive Neuroscience, Vol. 20, No. 7, 2008, pp. 1220-1234.
N. Tubaiz, T. Shanableh and K. Assaleh, â€œGlove-based continuous Arabic sign language recognition in user dependent modeâ€, IEEE Transactions on Human-Machine Systems, Vol. 45, No. 4, 2015, pp. 526-533.
J. Han, G. Awad, and A. Sutherland, â€œBoosted subunits: a framework for recognising sign language from videosâ€, IET Image Processing, Vol. 7, No. 1, 2013, pp. 70-80.
D. Kelly, J. Mc Donald, and C. Markham, â€œWeakly supervised training of a sign language recognition system using multiple instance learning density matricesâ€, IEEE Transactions on Systems, Man, and Cybernetics, Vol. 41, No. 2, 2011, pp. 526-541.
P.C. Badhe, and V. Kulkarni, â€œIndian sign language translator using gesture recognition algorithmâ€, IEEE International Conference on Computer Graphics, Vision and Information Security, 2015, pp. 195-200.
D. Barberis, N. Garazzino, P. Prinetto, G. Tiotto, A. Savino, U. Shoaib, and N. Ahmad, â€œLanguage resources for computer assisted translation from Italian to Italian sign language of deaf peopleâ€, In Proceedings of Accessibility Reaching Everywhere AEGIS Workshop and International Conference, Brussels, 2011, Belgium.
L.C. Wang, R. Wang, D.H. Kong, and B.C. Yin, â€œSimilarity assessment model for Chinese sign language videosâ€, IEEE Transactions on Multimedia, Vol. 16, No. 3, 2014, pp. 751-761.
P.S. Rajam, and G. Balakrishnan, â€œReal time Indian sign language recognition system to aid deaf-dumb peopleâ€, IEEE 13th International Conference on Communication Technology, 2011, pp. 737-742.
Y. Zhou, X. Chen, D. Zhao, H. Yao, and W. Gao, â€œAdaptive sign language recognition with Exemplar extraction and MAP/IVFSâ€, IEEE signal processing letters, Vol. 17, No. 3, 2010, pp. 297-300.
E. Candes, L. Demanet, D. Donoho and L. Ying, "Fast discrete curvelet transforms". Multiscale Modeling & Simulation, Vol. 5, No. 3, 2006, pp. 861-899.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).