A Survey on Matching of Shoeprint with Reference Footwear in Forensic Study

Footwear impression marks on the outside surface of shoes are distinctive patterns and an important forensic clue often found at offense scenes. However, in many cases, the footwear mark is treated with improper evidence due to difficulties in visibility and understanding. This paper presents a thorough review of matching algorithms along with enhancement techniques of shoe-print in the forensic study. Finally, it shows some research directions.

based on footwear design or conditions of outer edges of shoes, and, also wearer intentions. Figure 1 reflects full and partial footwear marks on different surfaces and Figure 2 presents known shoeprint marks which are indexed in a database as reference for matching [17]. For this, a preprocessing of shoeprint images (obtained in a crime scene) is essential before using a recognition algorithm. This paper discusses the present status of preprocessing and matching algorithms of shoeprint images along with a guideline for future research.
We have described the rest parts of the paper in the following two sections: Section 2 explains the footwear marks enhancement, detection and matching methodologies with critical comments and Section 3 presents the conclusion of the paper.   -Impressions can be visualized with the help of natural or artificial lifting.

Footwear Image Enhancement, Detection and Matching Methodologies with Critical Comments
-Oblique, coaxial and polarized light is provided from artificial light sources.
-Electrostatic lifting is used to pick up dusty impressions.
-Fingerprint powders are used to build up latent impressions.
-Physical or chemical enhancement methods are used to form enhanced soft impressions. Existing shoeprint matching algorithms along with enhancement can be grossly classified into two groups: feature-based matching technique and probabilistic method. Some bench-marked methods are discussed below.
1) Feature-based matching technique Kadam et al. [17] uses discrete Fourier transform to extract features for pattern matching in shoeprint-footwear. This method performs on 503 shoeprints.
This method has a limitation as it did morphological operation without segmentation.
Pradeep et al. [18] presents a Radon transformation-based method that is invariant to rotation. This method shown in Figure 3 confirms good performance in shoe images with Gaussian white noise and salt-pepper noise. It can handle partial shoeprint images. The matching score for partial shoeprints is obtained about 95%. It has lower computational time but is not appropriate for large database.
Xinnian et al. [19] proposed a fully automatic offense scene shoeprint retrieval algorithm that can be used to link crime scenes for finding out the brand of a  shoe. At first, the shoeprint database is preprocessed to separate the shoeprint from background and then applied for feature extraction. Finally, correspondence measure is performed based on the extracted features. This method works on 210,000 shoeprints and the overall matching score is 90.87%. However, this method is risky (due to false matching) and time-consuming.
Tang et al. [20] proposed a method that uses the elementary slopes in shoe features and retrieved the most analogous layout from a clustered database in noisy and blurry environments. This method did experimentation with only 100 real footwears and the obtained matching score is about 91%. Dardi and Carrat [24] described a footwear detection system based on the Mahalanobis distance map. This method used processed footwear image rather than real image. In this analysis, a method based on luminance is applied to remove false border and edge in noisy footwear marks. It works on only 87 known shoeprints and the matching score is obtained around 91%.
Rathinavel and Arunugam [25] proposed a shoeprint detection method using preprocessed (through enhancement and restoration) footwear marks. However, its performance is not up-to the mark.

Journal of Computer and Communications
Khan and Tidke [26] showed the sketch of a method using Radon transformation without any detail experiment.
Xiangyang et al. [27] proposed a shoeprint detection system for forensic investigation using Gabor transform and histogram analysis. At first, Gabor transform extracts features and then integral histogram is applied for similarity measure. This method used only 195 footwear marks and the similarity score is found around 93%. Fragmentation creates obstacle in extracting shoeprint features properly and consequently, matching score is not encouraging.
Manish and Pradeep [28] described an automatic shoeprint detection system for investigation of crime scenes. It uses Fourier features in finding matching score through Euclidian distance. It does not work well on large database. Srihari and Tang [29] described a computational method for investigating footwear image. It uses 1000 known shoeprints and 50 real footwear marks and the obtained matching score is 92%. It has depicted that computational method needs standard database for better matching of shoeprint-footwear.
Vaishal et al. [30] proposed a forensic investigation technique which uses a shoeprint image database. Gabor and Radon transforms are applied on routinely sorted query shoeprint images. It uses 40 footwear marks for analysis and the obtained similarity score is 90%. This shoeprint matching technique needs larger database.
Rathinavel and Arumugam [31] proposed a system that converts images to gray scale and then histogram equalization is applied for image enhancement. Then inverse filtering is applied for image restoration and, finally, image segmentation is applied to index the shoeprint database storage. This method performs on only 50 footwear marks and the obtained matching score is somehow good.
Andres and Peter [32] suggested a foot biometric based approach. At first, edge detection and thresholding techniques are applied. Then texture segmentation and alteration invariant algorithms are applied for finding matching. This method experiments on only 160 footwear marks and obtained high matching score.
Chazal et al. [33] suggested a Fourier transformation-based automated processing of shoeprint images in forensic science. The method is not efficient, as it did not use segmentation, clustering and edge detection.
2) Probabilistic method Vishnu and Srihari [34] proposed shoeprint extraction system by using probabilistic method rather than special thresholding and neural networks. This system used machine learning based probabilistic model for matching but could not provide a suitable result.
From the above analysis, most existing techniques have problems and at primitive stage. Therefore, it is preferable to concentrate on image enhancement, segmentation, feature extraction and pattern matching for improving the existing techniques for a reliable forensic investigation. A combination of feature-based and probabilistic methods may be an option for developing improved matching Journal of Computer and Communications algorithms. In addition to normal probabilistic method, recently neural-based method (such as recurrent neural network (RNN), convolutional neural network (CNN), and deep learning) [35] shows promising results. Therefore, it may be a good direction to concentrate on RNN, CNN and deep learning for shoeprint recognition.

Conclusion
We presented the existing status of matching of shoeprint with reference footwear in the forensic study. Many researchers describe only preliminary stages of matching method; some researchers discuss a few matters and others proposed systems for matching images without proper enhancement and/or feature extraction algorithm. As a result, none of these approaches gives perfect results. Therefore, the paper addresses the shortcomings and recommends researchers to put emphasis on developing hybrid systems as well as neural-based approaches suitable for real-life applications.