A Design Flow for Robust License Plate Localization and Recognition in Complex Scenes

Dhawal Wazalwar, Erdal Oruklu, Jafar Saniie

.

DOI: 10.4236/jtts.2012.21002                

Abstract

In this paper, we present a new design flow for robust license plate localization and recognition. The algorithm consists of three stages: 1) license plate localization; 2) character segmentation; and 3) feature extraction and character recognition. The algorithm uses Mexican hat operator for edge detection and Euler number of a binary image for identifying the license plate region. A pre-processing step using median filter and contrast enhancement is employed to improve the character segmentation performance in case of low resolution and blur images. A unique feature vector comprised of region properties, projection data and reflection symmetry coefficient has been proposed. Back propagation artificial neural network classifier has been used to train and test the neural network based on the extracted feature. A thorough testing of algorithm is performed on a database with varying test cases in terms of illumination and different plate conditions. Practical considerations like existence of another text block in an image, presence of dirt or shadow on or near license plate region, license plate with rows of characters and sensitivity to license plate dimensions have been addressed. The results are encouraging with success rate of 98.10% for license plate localization and 97.05% for character recognition.

Keywords

License Plate Localization; Character Recognition; Reflection Symmetry Coefficient; Artificial Neural Network

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	X. F. Shi, W. Z. Zhao and Y. H. Shen, “Automatic Li- cense Plate Recognition System Based on Color Image Processing,” International Conference on Computational Science and Its Applications (ICCSA), Vol. 3483, 2005, pp. 1159-1168.
[2]	Z. Chen, C. Liu, F. Chang and J. Xu, “A Novel Algorithm of License Plates Automatic Location Based on Texture Feature,” IEEE International Conference on Automation and Logistics, Shenyang, 5-7 August 2009, pp. 1360-1363. doi:10.1109/ICAL.2009.5262747
[3]	W. Pan and N. Yang, “A new method of vehicle license plate location under complex scenes,” 2nd International Conference on Advanced Computer Control (ICACC), Shenyang, 27-29 March 2010, pp. 134-138. doi:10.1109/ICACC.2010.5486754
[4]	A. Delforouzi and M. Pooyan, “Efficient Farsi License Plate Recognition,” 7th International Conference on In- formation, Communication and Signal Processing, Macau, 8-10 December 2010, pp. 1-5.
[5]	C. N. K. Babu and K. Nallaperumal, “A License Plate Localization using Morphology and Recognition,” IEEE Indian Conference (INDCON), Kanpur, 11-13 December 2008, pp. 34-39. doi:10.1109/INDCON.2008.4768797
[6]	B. M. Shan, “License Plate Character Segmentation and Recognition Based on RBF Neural Network,” Second In- ternational Workshop on Education Technology and Com- puter Science (ETCS),Wuhan, 6-7 March 2010, pp. 86-89. doi:10.1109/ETCS.2010.464
[7]	H. Lan and G. Shrestha, “Real Time License Plate Reco- gnition at the Time of Red Light Violation,” International Conference on Computer Application and System Mo- deling (ICCASM), Taiyuan, 22-24 October 2010, pp. 243- 247.
[8]	Y. Wen, Y. Lu, J. Q. Yan, Z. Y. Zhou, K. M. von Deneen, and P. F. Shi, “An Algorithm for License Plate Reco- gnition Applied to Intelligent Transportation System,” IEEE Transactions on Intelligent Systems, Vol. 12, No. 3, 2011, pp. 1-16.
[9]	J.-M. Guo and Y.-F. Liu, “License Plate Localization and Character Segmentation With Feedback Self-Learning and Hybrid Binarization Techniques,” IEEE Transactions on Vehicular Technology, Vol. 57, No.3, 2008, pp. 1417- 1424. doi:10.1109/TVT.2007.909284
[10]	Z.-X. Chen, C.-Y. Liu, F.-L. Chang and G.-Y. Wang, “Au- tomatic License-Plate Location and Recognition Based on Feature Salience,” IEEE Transactions on Vehicular Te- chnology, Vol. 58, No.7, 2009, pp. 3781-3785. doi:10.1109/TVT.2009.2013139
[11]	S.-L. Chang, L.-S. Chen, Y.-C. Chung and S.-W. Chen, “Au- tomatic License Plate Recognition,” IEEE Transactions on Intelligent Transportation Systems, Vol. 5, No. 1, 2004, pp. 42-53. doi:10.1109/TITS.2004.825086
[12]	C. Nikolaos, I. Anagnostopoulos, D. Psoroulas, V. Lou- mos and E. Kayafas, “A License Plate-Recognition Algo- rithm for Intelligent Transportation System Applications,” IEEE Transactions on Intelligent Transportation Systems, Vol. 7, No. 3, 2006, pp. 377-392. doi:10.1109/TITS.2006.880641
[13]	L. Keilthy, “ANPR System Performance,” Parking Trend International, June 2008.
[14]	“CitySync Single Lane PAL Demo Video,” 2011. http://www.citysync.co.uk/
[15]	R. C. Gonzalez and R. E. Woods, “Digital Image Proces- sing,” 3rd Edition, Prentice Hall, Saddle River, 2008.
[16]	X. Lin, J. Ji and Y. Gu, “The Euler Number Study of Image and Its Applications,” 2nd IEEE Conference on In- dustrial Electronics and Its Applications, Harbin, 23-25 May 2007, pp. 910-912.
[17]	X. Wang, “Multiscale Median Filter for Image Denois- ing,” IEEE 10th International Conference on Signal Pro- cessing, Beijing, 24-28 December 2010, pp. 2617-2620.
[18]	C.-Y. Ning, S.-F. Liu and M. Qu “Research on Removing Noise in Medical Image Based on Median Filter Me- thod,” IEEE International Symposium on IT in Medicine and Education, Jinan, 14-16 August 2009, pp. 384-388.
[19]	N. Otsu, “A Threshold Selection Method from Gray- Level Histograms,” IEEE Transactions on Systems, Man and Cybernetics, Vol. 9, No. 1, 1979, pp. 62-66. doi:10.1109/TSMC.1979.4310076
[20]	Z. M. Li, K. P. Hou and H. Li, “Continuous Symmetry Measure of Image,” IEEE International Conference on Information Acquisition, Shandong, 20-23 August 2006, pp. 824-828. doi:10.1109/ICIA.2006.305838
[21]	A. K. Jain, J. C. Mao and K. M. Mohiuddin, “Artificial Neural Networks: A Tutorial,” IEEE Computer Society, Vol. 29, No. 3, 1996, pp. 31-44. doi:10.1109/2.485891