Fingerprint Recognition with Artificial Neural Networks: Application to E-learning

Fingerprint recognition is a mature biometric technique for identification or authentication application. In this work, we describe a method based on the use of neural network to authenticate people who want to accede to an automated fingerprint system for E-learning. The idea is to apply back propagation algorithm on a multilayer perceptron during the training stage. One of the advantages of this technique is the use of a hidden layer which allows the network to make comparison by calculating probabilities on template which are invariant to translation and rotation. Results come both from the NIST special database 4 and a local database, and show that a proposed method gives good results in some cases.


Introduction
Usual identification methods based on what we have (magnetic card, identity card, chip, etc.) or on what we know (password, encoding, etc.) cause big problems of reliability [1] [2].The recent terrorist acts and threats to many countries, coupled with the growing evolution of cybercrime in a world where all tasks tend to become automatic identification/authentication of flawless natural persons have become a problem crucial for security reasons (border controls, access to public or virtual sites, transport, ...).All these problems have encouraged the further development of biometrics as an identification and authentication tool.The use of fingerprints is one of the oldest and most successful methods of identification/authentication biometrics [3] [4].Concerning a fingerprint, F. Galton was the first to prove the existence of the papillary drawings from birth to death [5]; this particular arrangement of the papillary lines forms points called minutiae, which are the cause of uniqueness and immutability of the fingerprint.
The digital fingerprint forms a specific class of pattern with a particular singularity and statistics characteristics known.Then, fingerprint recognition seems to be more constraining than the other problem of pattern recognition (like handwritten character recognition) where neural network has been well applied [6]- [8].
The main question we therefore consider here is: how to automatically authenticate flawless people who wish to access a computer system (or electronic) with the lowest possible error rate?The approach consists in the use of neural networks to develop such a system.The built model will then be applied to E-learning with a relatively stable database.In fact, neural network has shown their ability to deal with many domains.Their peculiarity is the ability to adapt to the data to be processed that they offer, and the ability to perform calculations in parallel, allowing them to work in various fields of application.
In this paper, we present a model of authentication by fingerprints, based on the use of a neural network having a multilayer perceptron structure and extraction algorithm and classification minutiae at two levels.
The first level consists of the fingerprint classification at the input layer considering its general topography according to the classification of Henry [9], and is divided into two stages: the first stage permits the classification of the input fingerprint according to the prototypes of the first class of constructed data by simple calculation of probabilities, exactly as done by Baldi [4]; the second stage serves as a control of the first classification and reduces the risk of incorrect answers.This second control can reduce the rate of false rejection, even when the number of detected minutiae is low.
The second level which is actually devoted to correspondence or authentication is to compare in the network training phase, the feature vector of the input fingerprint (which is invariant to translation and rotation) to all those belonging to the class winner after the two previous classifications, by a simple similarity measure (the Euclidean norm for example).
The rest of the document is organised into three sections.The first section presents algorithms of neural network for fingerprint recognition.The second section describes the proposed method based on multilayer perceptron with two hidden layers.The third section presents the application of studied methods and obtained results; we finish by a conclusion.

Fingerprint Recognition and Neural Network
From a technical point of view, there are two different problems in the field of fingerprint analysis, namely: classification and correspondence.The classification consist in putting together some fingerprints that have templates that are similar in predefined subclasses.Today, there are five classes of fingerprints defined by Henry [9].Correspondence implies authentication and identification, is based on other more subtle elements (minutiae, streaks' orientations) and requires a much more detailed analysis of the fingerprint image.The whole picture is no longer taken into consideration here, but a set of elements which as a whole constitutes the imprint template or the feature vector: This is the minutiae and their guidelines when making the correspondence.This technique involves the use of pre-processing (binarization, thinning, filtering, etc.) that will enable the refinement of the image to extract the most useful features [10] [11].As part of this work we will present algorithms that deal exclusively with the appearance of correspondence, the classification being standardised.

Comparison Based on Correlation (Minimum Distance)
This method aims simply to compare pixels array of two fingerprint images and to calculate the correlation of that pixels [12] [13].For two fingerprint images to be compared, this method just compares the minimum distance between the mean of data pixels of each pattern.The technique based on the correlation of pixels is not very effective, because we can get many different images for one fingerprint.

Remarks
• If images of the same fingerprint are different, the values of their pixels are automatically different; • In addition two images taken at different resolutions (from two different scanners) may not have the same pixel values.
For this method, we can give a threshold (for example if the difference between the values of the two pixels is less than 3, it is considered that these pixels are equal); but this technique is clearly not rigorous.

Comparison Based on Minutiae (Image Mapping)
Comparison based on minutiae (Image mapping) it's the most widely used method because it's based on individual features in each person, the minutiae [14] [15].Minutiae are extracted from two prints and are represented as a set of points in a two dimensional plans depending on the model coordinates (type of minutiae, coordinates, angle).The comparison is to find a proper alignment of the two fingerprint minutiae (F1 and F2) which produces a maximum of pairs of similar minutiae.
By taking two fingerprints F1 and F2 to be compared as vectors of minutiae, wherein each m is represented by a vector ( ) x y θ , where i x and j y are coordinates of the location of the minutiae in the fingerprint and θ the direction of the minutiae.We consider that the distance sd between two minutiae of two different fingerprint must be less than a level 0 r and the difference dd of their direction should be less or equal to an angular tolerance 0 θ : , min ,360 .

Remarks
• Computation number increase with vector number already classified; • Classification result depends on a critical level (two fingerprints are identical when a number t of identical minutiae is reached, this number can vary from one system to another depending on the degree of security chosen by the designer).

Probabilistic Neural Networks
The algorithm described by Baldi and Chauvin [16] that exclusively deals with the aspect of correspondence consists of two main steps, namely: a preprocessing step and a decision step.The preprocessing stage basically aligns the two images and extracts, from each one of them, a central region.The two central regions are fed to the decision stage, which is the proper neural network part of the algorithm and subject to training from examples.Whereas the preprocessing stage is fairly standard, the decision stage is innovative and based on a neural network that implements a probabilistic Bayesian approach to the estimate of the probability p of a match.The network is formed by the descent of the gradient using a training set of n pairs of images from several different fingers.Adding some additional fingers to make using phase strengthens the robustness of the neural network created and tested beforehand.Given two fingerprint images A and B, the proposition that they match (or do not match) will be denoted by ( ) The purpose then is to design a neural network algorithm that when presented with a pair (A, B) of fingerprint images outputs a number ( ) ( )  be- tween 0 and 1 corresponding to a degree of confidence or probability that the two fingerprints match.

Advantages • Use of a central region of the image with alignment and data compression;
• Calculation of probabilities to make the correspondence between two patterns provided at the network entry after several successive filtering; • The algorithm is adapted for authentication of a person who wishes to access a system in which its fingerprint is previously known; • The algorithm is suitable for systems using a small database.

Limitations
• Use complex formulas for the calculation of probabilities; • Usable for a limited number of fingerprint's pictures including the learning phase.

Locally Connected Neural Network
For this algorithm, pattern recognition systems typically consist of two stages: construction of feature vectors and classification of pattern [17].
1) In the first step, a fingerprint is passed in the system entry and is reduced to a feature vector (which is invariant to translation and rotation), this throws operations of transformation (calculating an activation for each neurone of the network and a global energy).After having extracted feature vectors, prototype vectors are formed by subclass of data.
2) In the second step, a classification or direct comparison which led to the recognition or not of the pattern is performed between the input feature vector and the prototypes of the database.This method based on the locally connected neural network is more appropriate for verification applications, security and identification.Mathematically, the network activation is iteratively computed by [18]: where: - are the coordinates kl of a point that falls within a radius r of the neighbourhood of neurone ij; -( ) is the weight of the synaptic connection between neurone ij and neurone kl; ij I is the input pattern pixel value at location ij; -E is the global network energy constant; -n is the iteration number.The peculiarity of this technique is the use of feature vectors that are invariant to the translation and rotation of the fingerprint image.This technique is based on three classification algorithms which are: average classes, nearest neighbour and k-nearest neighbours.

Advantages
• Use of prototypes (feature vectors of fingerprint by subclass of data) invariants to translation/rotation to make correspondence; • This algorithm is suitable for identification of person in a great set of data; • Use of nearest neighbours to perform the classification.

Limitations
• The learning time is high; • Relatively high rate of false rejections; • Using thresholds and activation calculations to perform the correspondence.

A Two Hidden Layers Perceptron for Fingerprint Recognition
By leveraging the benefits of the previously mentioned methods, we have developed a new technique based on the use of a multilayer perceptron.The proposed structure of the neural network (see Figure 1) will be that of a locally connected neural network, which uses the calculation of probabilities to classify the input image subblocks considering the henry's classification.We also use a threshold (to determine whether there is matching or not between two patterns) and the retro-propagation algorithm to train the network.
The neural network used here is a multilayer perceptron with an input layer, a hidden layer which itself contains three layers (two classification layers and a correspondence layer) and finally an output layer (see Figure 1).The principle is the same like a usual recognition method based on the use of neural network and is based on two main steps: training and recognition stage [19].Before applying the training stage, we classify the entire sample of data into four main classes (arch, whorl, left and right loop) according to the Henry's classification and we determine two prototypes for each class of data.
After this strict classification of the database and the determination of a K1 prototypes for the 1 st and 2 nd classification layer, the training stage can be proceeded as follow: the three layers of our network are strongly connected among its.Input layer is connected to the 1 st classification layer, the 1 st classification layer is connected to the 2 nd classification layer, the 2 nd classification layer and correspondence layer are connected to- gether and then, the correspondence layer is connected to the output layer by connection weights.The N input fingerprint images to be recognised (after pretreatment operations), is applied at the input layer of our neural network.Connection weights of the 1 st and 2 nd classification layer are respectively initialised by K1 (here K1 = 4 because of four main classes) prototypes of every data class already known according to the fingerprint class made.Then, connection weights of the correspondence layer are initialised by all the K2 expected fingerprint image of the database for the training stage for each class of data determined above.So K2 is the number of pattern of a data class, for example is the winner neurone after the two classification belong to the class of whorl then K2 will be equal to the number of pattern of the whorl class.The input vector is compared to all prototype of every data class of the 1 st and 2 nd classification layers, and it's assigned to the class of winner neurone (the second classification serve as control of the first and help to reduce error rate).After this, the input vector is compared to all data of the class of the winner neurone at the correspondence layer, and it's assigned the winner neurone too.If the winner neurone is not the prototype of the right class, committed errors are back propagated.The output layer gives us the activated winner neurone.
Mathematically, proposed algorithm can be applied like this: 1) Choose the initial prototypes two by two for each data class, according to the classification of Henry.
2) Initialise neurone of the first classification layer by the first prototype of each data class.
3) Initialise neurone of the second classification layer by the second prototype of each data class.4) Initialise every correspondance layer neurone weight with the database pattern class by class.5) Apply an input vector.6) Apply the similarity measure on the first classification layer by probability calculation.
( ) ) represent a set of featured vectors obtained after pretreatment operations; H() is a combination of featured vectors and their minutiae orientation.7) Select the winner neurone.8) Apply the similarity measure on the second classification layer.
( ) Select the winner neurone.10) Apply the similarity measure on the correspondance layer (if the winner is in the right class).
( ) Select the winner neurone.12) Calculate the error between the expected and the obtained output.

Applications and Results
Application fields of biometrics are many and diverse (criminal police, airport control, election system, medical file, ...).We apply our work in particular to an online learning system (E-learning) whose purpose is to enable secure access, including learners located at long distances from the place of learning [20].E-learning is a learning mode that takes advantage of the use of technology of information and communication at all levels of training activity.It particularly refers to a training system whose main purposes can be defined as: independent learning, distance learning, individualised learning paths and development of pedagogical relationships online.
To compute different training stage and tests, we use: a laptop Intel?CoreTM i52450M CPU@ 2.50 GHz 2.50 GHz with 4Go RAM; a desktop Intel Pentium CPU G645@ 2.90 Hz 2.90 GHz with 2Go de RAM; the OS Ubuntu 12.10 and GNU Octave 3.6.1 and the gcc 3.4 compiler with OpenMPI library.
The model thus constructed is performed using two databases: • A database (called BDAL) consisting of 500 fingerprint images sized 248 338 × with 8-bit grayscale, from 100 different people (all being E-learners especially trained and cooperatives which permits to avoid having latent images and very noisy) with 5 pictures of fingerprints per person (it's the same fingerprint is taken into account);

Discussion
The images of the databases (BDAL and NIST) used to perform the above tests are proportionally distributed among the sub-classes defined by Henry (arch, arch attempted, whirl and loops).By using vector blocks size of 16 16 × compared to vector blocks size of 8 8 × , a significant gain of 6.40 minutes and 1.5 seconds on average can be achieved respectively in the learning time and the recognition time.In return, there has been an average fall of 0.3% and a slight increase of 0.3% respectively on the acceptance rate (AR) and the false rejection rate (FRR).In fact, when using blocks of size 8 8 × compared to those of size 16 16 × , the quantity of information to handle is reduced and therefore easier to compute with regard to the detection of streaks, singular points, valleys, ...However, the number of sub-blocks to be processed increases and promotes the long processing time.
The proposed method, based on the use of a perceptron with three hidden layers offers best results in terms of recognition rate and false rejection rate as shown by Table 3 and Table 4.This can be explained by the fact that the proposed network uses three hidden layers to perform the classification, using calculation of the probabilities on features vectors (which are invariant to translation and rotation).In fact, the use of the second classification layer has been introduced to control wether the winner neurone after the first classification is really a pattern of the right class, and this contribute to reduce the proportion of error rate (especially false acceptance rate).Furthermore, the use of prototype (with process update) instead of the entire database to make classification contribute to the robustness of our proposed method.
One of the strong results of our experience shows that the more the decision threshold is strict, the more the probability that the system provides a satisfactory result is high (as shown in Figure 2).But in return, the complexity of the algorithm is increased, resulting in increased learning and recognition time.Also the choice of a reasonable decision threshold is recommended to avoid the perverse effect of a surcharge on the rate due to threshold considered too strict.
The proposed algorithm, performs matching in less than 7 s on average.On both databases used, as the  decision threshold (from 0.1 to 7 10 − with 20 minutiae), the overall system has a false acceptance rate (FAR) ranging from 0.6% to 4.8%, a false rejection rate (FRR) ranging from 1.1% to 5.3% as shown in Figure 2 above.

Conclusions
The aim of this paper was to provide a fingerprint recognition algorithm based on artificial neural networks for authentication.The results obtained with different techniques studied show that using blocks of processed image enables a recognition with low false acceptance rate in the range of 0.5% ± on average.For against, when the recognition system uses the mean classes of entire images, these false acceptance rates are very high and reflect the subjectivity of this method.
Many fingerprints' recognition systems for authentication have already been established in the literature, but the method we propose is quite innovative and takes into account both the calculation of probabilities and the comparison of templates (invariants to translation/rotation) to perform classification, an unexplored way till now (to our knowledge).A special effort has been used to take into account other singularities of fingerprint lines for the case of images from the same individual.Tests conducted with this technique have led us to some encouraging results, although upgradeable.Indeed we limited ourselves to perform tests with a maximum set at 7 10 − squared error between the expected output and that obtained; because beyond this value (which is already very high), the results are somewhat biased.One small technical issue that we propose is that it does not handle very well the case of latent images due to the objective that we set at the start which was to minimise error rate (in particular false rejection rates).
As it stands, the performance of different approaches is considered satisfactory for images of good qualities.However further study on the choice and number of times to be applied pretreatment operations on the fingerprint images would have more powerful algorithms better suited to the case of latent images or visible half.Future work will focus on the establishment of an authentication system that uses more fingerprints, other biometrics such as face shape, the dynamics of the plot of the signature and/or dynamics keystrokes.
The combination of these techniques will highlight a fundamental element in the recognition before and during use of the online training system, namely the signing of the user.Indeed, the use of signing rather than the template is unique that it allows recording in addition to the fingerprint features, a set of other elements specific to individual behaviour of each user and it supports authentication before and during system access.

Figure 1 .
Figure 1.Structure of the proposed neural network.Where: i x represents the input image vector while i o is the expected output; j h are prototypes of each class of data (according to Henry classification); ij w the connection weight between the input layer and the 1 st classification layer; jk Z the connection weight between the 1 st and the 2 nd classification layer; k g are prototypes of the second classification layer; kl z′ the connection weight between the 2 nd classification and the output layer; l h′ are the vectors of the entire database for the correspondence layer; li w′ the connection weight between the correspondence layer and the output layer.
) Check the thresholds.14) Modify connection weight of winners neurone:

Figure 2 .
Figure 2. FRR and FAR depending on the decision threshold.