Static Digits Recognition Using Rotational Signatures and Hu Moments with a Multilayer Perceptron

Abstract

This paper presents two systems for recognizing static signs (digits) from American Sign Language (ASL). These systems avoid the use color marks, or gloves, using instead, low-pass and high-pass filters in space and frequency domains, and color space transformations. First system used rotational signatures based on a correlation operator; minimum distance was used for the classification task. Second system computed the seven Hu invariants from binary images; these descriptors fed to a Multi-Layer Perceptron (MLP) in order to recognize the 9 different classes. First system achieves 100% of recognition rate with leaving-one-out validation and second experiment performs 96.7% of recognition rate with Hu moments and 100% using 36 normalized moments and k-fold cross validation.

Share and Cite:

Solís, F. , Hernández, M. , Pérez, A. and Toxqui, C. (2014) Static Digits Recognition Using Rotational Signatures and Hu Moments with a Multilayer Perceptron. Engineering, 6, 692-698. doi: 10.4236/eng.2014.611068.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1] Oz, C. and Leu, M. (2011) American Sign Language Word Recognition with a Sensory Glove Using Artificial Neural Networks. Engineering Applications of Artificial Intelligence, 24, 1204-1213.
http://dx.doi.org/10.1016/j.engappai.2011.06.015
[2] Elons, S., Abull, M. and Tolba, F. (2013) A Proposed PCNN Features Quality Optimization Technique for Pose-Invariant 3D Arabic Sign Language Recognition. Applied Soft Computing, 13, 1646-1660.
http://dx.doi.org/10.1016/j.asoc.2012.11.036
[3] Karami, A., Zanj, B. and Kiani, A. (2011) Persian Sign Language (PSL) Recognition Using Wavelet Transform and Neural Networks. Expert Systems with Applications, 38, 2661-2667.
http://dx.doi.org/10.1016/j.eswa.2010.08.056
[4] Rajam, S. and Balakrishnan, G. (2012) Recognition of Tamil Sign Language Alphabet Using Image Processing to Aid Deaf-Dumb People. Procedia Engineering, 30, 681-686.
http://dx.doi.org/10.1016/j.proeng.2012.01.938
[5] Munib, Q., Habeeb, M., Takruri, B. and Al-Malik, A. (2007) American Sign Language (ASL) Recognition Based on Hough Transform and Neural Networks. Expert Systems with Applications, 32, 24-37.
http://dx.doi.org/10.1016/j.eswa.2005.11.018
[6] Al-Rousan, M., Assaleh, K. and Tala’a, A. (2009) Video-Based Signer-Independent Arabic Sign Language Recognition Using Hidden Markov Models. Applied Soft Computing, 9, 990-999.
http://dx.doi.org/10.1016/j.asoc.2009.01.002
[7] Urcid, G., Padilla-Vivanco, A., Cornejo, A. and Baez, J. (2004) Correlation-Based Rotational Operator Signature of Planar Binary Objects. Proceedings of SPIE5558, Applications of Digital Image Processing XXVII, 2 November 2004, 87.
http://dx.doi.org/10.1117/12.558744
[8] Hu, M. (1962) Visual Pattern Recognition by Moment Invariants. IRE Transactions on Information Theory, IT-08, 179-187.

Copyright © 2021 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.