Gait Based Human Recognition with Various Classifiers Using Exhaustive Angle Calculations in Model Free Approach

Human Gait recognition is emerging as a supportive biometric technique in recent years that identifies the people through the way they walk. The gait recognition in model free approaches faces the challenges like speed variation, cloth variation, illumination changes and view angle variations which result in the reduced recognition rate. The proposed algorithm selected the exhaustive angles from head to toe of a person, and also height and width of the same subject. The experiments were conducted using silhouettes with view angle variation, and cloth variation. The recognition rate is improved to the extent of 91% using Support vector machine classifier. The proposed method is evaluated using CASIA Gait Dataset B (The institute of Automation, Chinese Academy of Sciences), China. Experimental results demonstrate that the proposed technique shows promising results using state of the art classifiers.


Introduction
In this modern era, with an increasing demand for surveillance systems, people want to have a more convenient method for identifying a person.The gait is the only biometric that identifies the person at a distance.Human gait recognition is drawing huge interest in biometrics field to monitor or authenticate a person with malicious intent.Over the last few decades, gait analysis has evolved as a well potential technology in computer vision community.Human gait is a complex action involving the motion of various parts of the body.It refers to various activities like joint motion, swinging with linear and nonlinear motions, toe on, toe off, heel on and heel off.Because gait parameters such as step length, gait cycle, angles of the hip, knee and joint rotation can be unique attributes of the human gait to identify a person.The gait recognition methods can be categorized into the model based and appearance based methods [1].Model-based approach [2]- [4] models the person body structure that estimates static body parameters over time.This process is computationally intensive since it needs to model and track the subject body.Models are constructed on the basis of prior knowledge about the object and justifiable assumptions, such as the system only accounts for pathologically normal gait.The model based methods use template matching like rectangle, ellipse, ribbon and skeleton models for gait recognition [5]- [13].In appearance based methods, silhouette based, floor sensor based (sensor outside the body), body owned sensor (sensors kept with human) methods are used for recognition.In the silhouette based method, the recognition can be made by using various approaches like, gait energy image (GEI), gait entropy image (GEnI), change energy image (CEI), gait flow image (GFI).Of these approaches, linear techniques like Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA) and Independent Component Analysis (ICA) are taken into consideration.Using PCA, a linear view independent gait identification system was proposed [14].Speed variation, view angle variation, and age calculation performed using OU-ISIR database [15].Most of the papers consider the features from head to ankle portion applied with different algorithms.

CASIA Gait Data Base
CASIA dataset consists of four subsets.Dataset A is a standard dataset that contains 19,139 images.Dataset B is a large gait dataset which has 124 subjects.Waking style of each subject in the form silhouettes were captured from 11 views and three variations namely viewing angle variation, different clothing styles and different luggage carrying conditions, with the changes in personality.Dataset C was collected using an infrared camera with four different walking styles: normal walking, slow walking, fast walking, and normal walking with a bag.It contains 153 subjects.Dataset D consists of the gait of 88 subjects and their corresponding footprints.In this paper, CASIA dataset B with 124 persons have been taken for experimentation with cloth variation and viewing angle variation of 11 views from 0˚, 18˚, 36˚, ••• 180˚.

Pre-Processing
The silhouettes obtained from CASIA database are affected by noises and discontinuities.Imperfections in silhouette extraction have a negative effect on the performance of a gait recognition system [16].There are algorithms for background subtraction and shadow removal algorithm [17].Hence a pre processing technique is implemented in this work.Silhouettes with discontinuity are detected using blob detection technique.The number of blobs is greater than one, indicates discontinuity is present in the silhouette.Incomplete silhouette which contained inside a gait sequences are taken into clustering procedure by taking height and width as features.Dominant energy image (DEI) is evaluated using clustering.This DEI consists of noise.Hence threshold is used to remove noises.The successive frame difference at consecutive instants is obtained as Frame Difference Energy Image (FDEI).Implementation of gray scale erosion filter is used to produce good quality silhouettes [18].

Experimentation
The pre processed gait sequences are taken for the experimentation.The proposed methodology consists of training and testing phases.In training phase gait patterns are captured and features are extracted from pre processed silhouettes.It is stored in a feature database.The exhaustive angle components from head to neck, neck to torso, hip to knee of two leg portions, knee to toe of both of the legs, maximum height and maximum width of the silhouette sequences are also taken into feature dataset.In testing phase same features are extracted and classified using various classifiers.

Height and Width Calculation
A person moves nearer to the camera, the frame height is increased.Similarly, when a person is leaving away , , , H H H  be the various frame heights of skeleton in a gait cycle.Then the maximum height of the person in the entire silhouettes is denoted as in Equation ( 1) The variation of the width in a gait cycle is one other important feature for gait analysis, as it contains structural and dynamical information about the gait.When the person is in mid stance position, the space between the two legs is quite small and hence the width is reduced.The maximum width is achievable when a person walks by swinging his arms.Let ( ) , , , be the width of skeleton in a gait cycle.Then the maximum spacing between two legs for a person is denoted as in Equation ( 2) ) The width of the outer contour of the binary silhouettes of a walking person is also one of the feature vectors.
The centroid ( ) X Y of the human silhouette is calculated by using the following Equations ( 3) & ( 4) where ( ) X Y represents the average contour pixel position.( ) X Y represents points on the human blob, N-total number of points on the contour.

Skeletonization and Angle Calculation
Skeleton of the input silhouette U is defined as ( ) S U in terms of erosions and openings.
where ( ) ( ) with V is the structuring element and ( ) The angles are measured in terms of deviation of reference partitioned planes between the given divided skeleton planes as shown in Figure 1.
Since the variation is higher, the output of the Radon coefficients also become higher in its value, and it is very suitable to act as feature vectors.
The radon transform of a skeleton image ( ) , f a b is denoted as ( ) , R r θ where r is defined by a normal distance from the origin, θ as a normal angle [19].
Radon transform point is given by the Equation ( 8)  Figure 3 shows the block diagram for the proposed method.The silhouettes are taken from CASIA database.θ -angle between neck to torso, 3 θ -angle between hip to knee of left leg, 4 θ -angle between hip to knee of right leg, 5 θ -angle between knee to foot of left leg, 6 θ -angle be- tween knee and foot of right leg.
Six angles, height and width are extracted from the silhouettes.Classifiers are used to train the features and it is stored in a database.During the testing period, the classifier is used to recognize the person by comparing the database.

K_Nearest Neighbour Classifier (K_NN)
K_NN is the one of the simplest method for pattern classification.Let { } 1 Linear transform optimizes K_NN classification.And the cost function over the distance metrics is defined by the Equation (10).( ) ( ) Here

Multiclass SVM
Support Vector Machines (SVM) was originally designed for binary classification.The formulation to solve multiclass SVM problems in one step has variables proportional to the number of classes.Therefore, for multiclass SVM methods, either several binary classifiers have to be constructed or a larger optimization problem is needed.Hence, in general it is computationally more expensive to solve a multiclass problem than a binary problem with the same number of data (Kohli & Verma 2011) [20].Assume , , , , , , and for 1 2 k k − .For a k class problem, the optimal hyper plane constructed with SVM for the class i against class j and is defined as Here T ij w is a vector in feature, ( ) x φ is a mapping function and ij b is a scalar.Here the orientation of optimal hyper plane is given in Equation ( 12) For the n set of classes, One-Against-All method was constructed using SVM models.The i th SVM is trained with all of the training examples in the i th class with positive labels and all other examples with negative labels.The final output of the one-against-all method is the class that corresponds to the SVM with the highest output value (Liu et al. 2008) [21].Thus, by solving the optimization problem of SVM using all the training samples in the dataset, the decision function of the i th SVM is given in Equation ( 13) ( ) ( ) The input vector x will be assigned to the class that corresponds to the largest value of the decision function.Sample x is classified into class X given by the Equation ( 14)

RVM Classifier
The relevance vector machine (RVM) technique has been applied in many different areas of pattern recognition.
It is a machine learning technique that uses Bayesian inference to obtain parsimonious solutions for regression and probabilistic calculations.However, during the training phase the inversion of a large matrix is required.Hence this methodology is not suitable for large datasets.Consider a two class problem with training points , , , , , , where ( ) y ε is the logistic function and

Results and Discussion
CASIA data set B with different cloth variation and angle variation are trained and tested with K_NN, RVM, SVM classifiers.The recognition rate is obtained using the given formula as in the Equation ( 16) Number of correctly recognized image of a person Recognition rate 100 Total number of images tested of the person Table 1 shows around 85% of recognition rate using K_NN classifier.The performance of this classifier in the different sets did not produce large variation with respect to different clothing.The proposed algorithm shows robustness towards cloth variation.The successive frames of training and testing are relevant then the recognition rate is improved.Figure 4 shows the histogram representation of cloth variation set using K_NN.
Table 2 shows around 88% of recognition rate using RVM classifier.The output of this classifier produced improved recognition rate for same database than K_NN classifier.K_NN outperforms well for small dataset.RVM provides Bayesian inference based probabilistic output.Hence it makes results more informative than K_NN. Figure 5 shows the histogram representation of cloth variation set using RVM classifier.
Table 3 shows around 91% of recognition rate using SVM classifier since the SVM classifier found the best separation among the closest feature points .The SVM classifier outperforms well than K_NN and RVM classifier.Figure 6 represents Histogram representation of cloth variation using SVM classifier.
Table 4 shows training and testing of silhouettes with different viewing angle from 0˚ to 180˚ the highest recognition for the similar angle variation for training and testing frames using SVM.Angle variation for training      produced low recognition rate than SVM for cloth variation and angle variation dataset.Table 6 shows that the proposed method produced the good recognition percentage than the existing  method.The selected features of exhaustive angles, height and width improved the good recognition rate.

Conclusion and Future Work
This algorithm presented an automated approach for human identification from low-resolution silhouettes.The algorithm has utilized exhaustive head to toe angles, height, and width as feature vectors.The gait characteristic features are kinematics based.The proposed method produced small variation in recognition percentage for cloth variations, since the algorithm identifies the person without bothering his dress codes.Moreover the algorithm shows its robustness towards different clothing styles.The SVM classifier classified the gait features efficiently.Experimental results demonstrated the feasibility of the approach.In future, more attention would be paid to the feature space for describing and recognizing the human gait on more subjects.SVM classifier has produced a high recognition rate of 91.5% in CASIA dataset than K_NN and RVM classifiers.The algorithm includes the meeting point of ground with toe as added information, and it distinguishes the person correctly.
For future, the challenging problems like occlusion, shadows, and noises in silhouettes by modifying this proposed algorithm need to be rectified.

Figure 2 (
a) represents the silhouettes and its corresponding skeletons.

Figure 2 (
b) represents the sub divided six skeleton portions for angle calculations.

2
denote a training set of n la- belled examples with inputs represent whether y i and y j are matched with each other or not.Then to compute the squared distance between two vectors are denoted by the Equation(9)

Figure 2 .
Figure 2. (a) Human silhouettes and its corresponding skeletons (b) segmented parts of a skeleton.

Figure 3 .
Figure 3. Block diagram for the proposed method.

Figure 4 .
Figure 4. Histogram representation of K_NN Classifier output.frame is different with testing frame angle variation, the recognition rate is reduced.So view angle variation has produced the high impact on this algorithm.The similar variations are obtained using K_NN and RVM classifiers with less recognition rate than SVM Classifier.Goffredo et al. (2010) [22] achieved the mean correct classification rate for 65 persons with 73.6% across all views.The proposed algorithm shows an average of 91.4% for a range of 0˚ to 180˚ variations (multi view).Regarding cloth variations, the recognition rate of a person is around 91.5%.For the experiments conducted to recognize the persons from CASIA dataset B of 124 persons from CASIA, and more than 25,000 silhouette sequences are trained and stored in a database for the recognition calculation.The efficiency of SVM produces better results than K_NN, RVM classifiers.SVM classifiers produce a good recognition performance to CASIA database.Table5shows that the SVM classifier outperforms and produced 91.5%.The K_NN and RVM classifier

Table 4 .
Percentage of recognition rate in a CASIA dataset (multi view) using SVM classifier.

Table 5
shows that the SVM classifier outperforms and produced 91.5%.The K_NN and RVM classifier

Table 5 .
Percentage recognition rate with respect to different classifier.

Table 6 .
Comparison of recognition rate with existing method.