Intuitionistic Neuro-Fuzzy Optimization in the Management of Medical Diagnosis ()
1. Introduction
Present day’s diabetes becomes a major health problem causing many health issues in the human body. Delay in the initial identification of diabetes becomes crucial to control the severity of the disease. Many specific techniques of the prevention and diagnosis for diabetes based on fuzzy logic have already been done so far. Fuzzy logic was first introduced in 1965 by Zadeh [1]. The tremendous utility of fuzzy logic has been used in different fields of science, engineering and medicine. Kabiraj et al. gave the utility of fuzzy logic has been used in linear programming [2] [3]. Lee, C.S. and Wang, M.H. gave a fuzzy expert system application for the Ontology-based on intelligent healthcare “Global Neglected Tropical Disease (GNTD)” application to respiratory waveform recognition which gave better results from previous researches [4]. Olej, V. and Hájek, P. designed Inference systems aimed at the forecast of ozone for time series: the situation of Pardubice micro-region showed again in addition to their work, Inference systems with Takagi-Sugeno type in ozone prediction by using comparison of fuzzy operators [5]. Olej and Hájek [6] compared the fuzzy operators Takagi-Sugeno Inference system in ozone prediction. Kalpana, M. and Dr. Kumar, A.V.S. also proposed a system which was the fuzzy expert system with the help of a fuzzy verdict machine for fuzzy rules by fuzzifying the input factors into triangular intuitionistic fuzzy numbers. The whole process is the diagnosis of diabetes. This system gave much accurate results in diagnosing diabetes in comparison to all previous studies [7]. Habib, S. and Akram, M. designed a decision-making system for washing machines by using AIFNN which is very useful nowadays [8]. Jain, V. and Raheja, S. suggested another fuzzy expert system for improving the prediction rate of diabetes their system gave better results from the system which was designed by Kalpana, M. and Dr. Kumar, A.V.S. [9]. Ahmadi, H. proposed a method for diseases diagnosis by using fuzzy logic methods, which is a systematic and meta-analysis review [10]. Bressan, G. M. also suggested a system for diabetes mellitus type-2 classifications which was based on a fuzzy approach [11]. But, due to the consideration of membership grade only, fuzzy logic failed to handle the uncertainty, presents in the diagnosis process. So, we need compellable tools that can deal with that kind of situation. In the last few decades, many efforts have been done to bring out a common framework of neural networks and fuzzy expert systems. First, Detlef Nauck and Rudolf Kruse gave a neuro-fuzzy technique for the classification of data named NEFCLASS which was presented in the symposium proceeding on applied computing [12]. Musilek, P. and Gupta, M. gave the theory of fuzzy systems which provides a mathematical framework for capturing the uncertainties with human cognitive processes [13]. Goncalves, L.B. et al. designed such a neuro-fuzzy system for the classification of pattern and rule mining for diabetes which was upturned into a classified neuro-fuzzy BSP system [14]. A seminal review has been provided by Jabbar and Mehrotra [15] in the context of ANN to decision-making in health care. Later on, for nonlinear systems, an ambiguous rule-based fuzzy neural system [16] with a constant knowledge mechanism has been studied [17]. Sentimentality in yearly reports was recognized for economic presentation. The study was given for the observation of outcomes of the sentiments on upcoming economic crisis [18]. A survey was given by Viharos and Kis on NFS in 2015 [19], this study also shows the utility of both the system, i.e., fuzzy inference system and neural network. [20] gave a prediction fuzzy model for identification and prevention of diabetes, this study expected the five major complications which have arisen due to diabetes. An adaptive neuro-fuzzy inference system [21] has also been studied to determine the economic order quantity and order implementation. Atanassov [22] [23] presented the concept of the intuitionistic fuzzy set that can handle uncertainty very well as compared to traditional fuzzy logic. In the study of intuitionistic fuzzy logic, we consider the values with two types of grades are as the membership and the other is non-membership. So, these methods give us a wide range to cover the uncertainness and vagueness. Neuro-fuzzy system has a vital role in the medical field, especially in the diagnostic process. A large amount of neuro-fuzzy systems has been studied over intuitionistic fuzzy sets. Intuitionistic fuzzy logic has also been used in many medical diagnosis tools. Sang and Zhang gave an approach which was based on Intuitionistic Fuzzy Information [24]. Barrenechea, E. et al. generalized the work of Atanassov’s intuitionistic fuzzy index construction method [25], Hájek, P. and Olej, V. solved the regression problems by using an adaptive intuitionistic fuzzy inference system of Takagi-Sugeno type approach, afterwards they used again Takagi-Sugeno type intuitionistic Fuzzy Inference System (FIS) by using defuzzification methods to solve the matter of incorporated liquidation forecast, followed by these two works they added Intuitionistic Fuzzy Neural Network, a new approach in their work and got results for the situation of credit scoring using text acquaintance [26] [27] [28]. After Hájek, P. and Olej, V., Zhao, J. et al. proposed “a general fuzzy cerebella model neural network multidimensional classifier using Intuitionistic fuzzy sets for medical identification” [29]. Eyoh, I. et al. also introduced an intuitionistic fuzzy logic for regression problems that was of interval Type-2 fuzzy sets [30]. An advanced distance measurement technique on intuitionistic fuzzy set-in decision making was also studied [31]. Samuel, A.E. and Rajakumar, S. introduced the intuitionistic fuzzy sets that are useful in the field of medical diagnosis [32]. Chao, L. et al. gave such a network which helps in online learning and time series forecast named as an evolving recurrent interval type-2 intuitionistic fuzzy neural network for online learning and time series forecast [33]. Shie-Jue, Lee and Chen-Sen, Ouyang [34] proposed a neuro-fuzzy system model that includes the input-output data found in two phases, in the primarily phase, the input-output datum gives the similarity and then by using the similarity a fuzzy network is constructed in the second step [35]. A genetic algorithm has also been used in the situation of Self-Organized Fuzzy Neural Networks [36], optimized weight technique of artificial neural networks [37], the type-2 fuzzy logic system which is used for the linguistic prognostic models (for economic praxis) [38] and Elman model based neural network algorithm [39]. Later, a multidisciplinary technique has also been applied to artificial swarm intelligence to deal with heterogeneous computing and cloud scheduling [40]. In order to carry out the applications of fuzzy logic in the medical field, Guzman [41] proposed an optimized fuzzy qualifier for blood pressure disease. Tyagi, K. and Tyagi, K. published a paper A Comparative Analysis of Optimization Techniques, in which they used various techniques for the test cases of optimization to choose less vague test cases [42]. Later on, Parouha, R.P. and Verma, P. [43] also discussed various optimization techniques in the paper State-of-the-Art Reviews of Meta-Heuristic Algorithms with Their Novel Proposal for Unconstrained Optimization and Applications. This paper is not only about GA and PSO but the comparison amongst different types of algorithms also done such that Meta-heuristic, aroused from the actions of societal creatures or animals, aroused from ecology, aroused by the laws leading a natural phenomenon, aroused from the human being.
The basic objectives of this research paper are pointed out the following points to focus the whole work as follows:
1) We will design a novel intuitionistic fuzzy logic based neural network approach for the diagnosis of diabetes.
2) We observed six input factors and with the help of the fuzzification process; we constructed the membership function for these inputs and with the help of Sugeno’s fuzzy inference system. We applied this over the intuitionistic fuzzy numbers.
3) A new approach is developed for optimization to get the optimized weights of the neurons.
The present work is separated into nine sections. In Section 2, we defined some basic definitions related to intuitionistic fuzzy sets. In Section 3, a survey on optimization techniques is discussed. We proposed the intuitionistic neuro-fuzzy system in the form of Sugeno’s intuitionistic neuro-fuzzy approach in Section 4 of the paper. In Section 5, the mathematical formulation and description of the system are given. The proposed optimization technique is also been described in Section 6 of the paper. In Section 7, the data collection method is given and Section 8 of the research paper describes the numerical computation part of the present work and comparison with the previous algorithm. In Section 9, the last section describes the discussions and conclusions of the paper.
2. Basic Perceptions
2.1. Intuitionistic Fuzzy Set
Let S be any Intuitionistic fuzzy set on a universe of discourse U is defined as:
(1)
where
is called the “degree of membership” of
in S and
is called the “degree of non-membership” of
in S. Where,
. Here,
is called hesitational part of
.
can also be considered as the degree for the lack of uncertainty related with the membership or non-membership grades in S.
The membership and non-membership functions for the trapezoidal and triangular intuitionistic fuzzy number in real line R, is defined by:
For Trapezoidal:
with
.
For Triangular:
with
.
2.2. Neural Network
A neural network is a network of neurons that is combination of nodes and links. An artificial neuron constructs a “Artificial Neural Network (ANN)” or “Artificial Neural Systems” and behave like the intelligence of human beings. Neural Network is a natural biological process used for solving the Artificial Intelligence (AI) models. In this structure, we have used the network neurons with the weights function. They have information about the inputs. In this we have constructed the activation function to get the rule in the form of linear combination of inputs and give the extension for the output.
For example, usually the range of output is between o and 1 but it could be −1 and 1.
2.3. Neural Fuzzy System
A neuro-fuzzy system is a learning mechanism which finds the constraints of a fuzzy system by manipulating the estimate systems from neural networks. The Fuzzy Neuro System is a construction of FNN (N, W, P, Q, A) with following conditions:
1) N is a non-empty set of fuzzy neurons and supplementary units.
2) By the given model and constraints of the fuzzy neuro system are defined as the weight matrix W given by Cartesian product N × N → DW (DW is the domain of weights).
3) Fuzzy inputs’ vector P
DP defines the inputs of the fuzzy neuro system (DP is defined as the domain of the input vector).
4) Fuzzy outputs’ vector Q
DQ defines the output for the fuzzy neuro system (DQ is defined as the domain of the output vector).
5) The learning algorithm A defines the phases of learning and adaptation for the new data (usually by changing the weights matrix W).
2.4. Optimization
An optimization problem comprises of maximizing or minimizing an actual function by methodically selecting input values from inside an allowable set and computation for the values of the function. Main aim of optimization is to maximize or minimize the values for better result. The simplification of optimization concept and methods to other formulations create a huge area of applied mathematics. Specifically, optimization contains searching “best available” values for some objective function specified a well-defined input, with a variety of objective functions and various types of inputs.
The methods presently accessible in works for resolving optimization difficulties may generally be classified as deterministic methods and probabilistic methods. Nature inspired algorithms are most popular population-based algorithms mimicking the evolutionary, self-organizing and collective process of nature. Some nature-inspired algorithms use the concepts of natural evolutions like selection, reproduction, crossover and mutation; some display the socio-cooperative behavior of natural species like birds, ants, termites, bees and humans well These algorithms are termed as metaheuristic algorithms such as Genetic Algorithms, Particle Swarm Optimization, Ant Colony Optimization, Differential Evolution, Self-Organizing Migrating Algorithm and many more.
3. Related Background
A survey has been done over the evolution of various kinds of algorithms for the presented research work. These algorithms are inspired from natural phenomenon and their social behaviors which helps in finding the optimized values for any given problem [43] - [71].
The survey of this study has been listed in the given Table 1, which is as follows:
Table 1. Evolution of different algorithms.
4. Intuitionistic Neuro-Fuzzy System
We introduced the structure of Intuitionistic Neuro Sugeno Fuzzy System (INSFS) for multilayered neural network. The detail of this network is as follows:
We consider if-then based rules of Sugeno’s approach. Initially, we will construct a structure of six inputs with one output then inputs are further categorized into three or four linguistic terms and divided in Membership and Non-Membership in the context of favorable and unfavorable cases. Our inputs are I1, I2, I3, I4, I5 and I6 and yi is the functional consequent value for each i = 1, 2, 3, 4, …, where I denotes the number of rules.
Let ith if-then rule of INSFS expressed as:
IF I1 is x1 and I2 is x2 and I3 is x3 and I4 is x4 and I5 is x5 and I6 is x6.
Then yi can be stated as:
(2)
where x denotes the linguistic characterization variables into three categories as; Low, Medium, Normal, High, Overweight & Obesity class I, Obesity class II & III, Less High, More High, Most High, Less Chance, More Chance, Most Chance and High Risk (such that L, M, N, H, OW, OB, LH, MRH, MTH, LC, MRC, MTC and HR respectively). The linguistic characterization variables are further divided into two categories membership and non-membership shown in Figure 1.
5. Description of System and Mathematical Formulation
Layer 1 (Input Layer): we define layer 1 as input layer in which we taken six inputs and use the non-linear system which is considered as combination of several linear systems or non-linear systems. The membership functions for this input layer have shown in Figure 2.
Layer 2 (Fuzzification): we described this layer as fuzzification layer. In these layers neurons receives an input which will fuzzify this layer with some degree of membership or non-membership. After the fuzzification this layer works as input for layer 3. This is simply the membership and non-membership values for the given inputs.
We have used Trapezoidal and Triangular function in our work, for example, Membership and Non-Membership function for Glucose:
For membership function:
For non-membership function:
Figure 2. The graphical representation for the membership and non-membership grade of input factors.
Layer 3 (Fired set of Inputs): In this layer, we choose those rules which should be fired out of the total number of rules which are constructed by the inputs, which as follows:
e.g.: IF I1 is x1 and I2 is x2 AND I3 is x3 and I4 is x4 and I5 is x5 and I6 is x6.
Layer 4 (Layer of Firing Strengths or Weights): This layer corresponds to an if-then rules with each neuron of sugeno’s type and computes the firing strength for every rule by using Max-Min operator.
(3)
and:
(4)
Layer 5 (Functional Consequent Values): In this layer, we find the values of (yi’s) with the help of fired set of inputs. These values help us in next layer, which are as follows:
Layer 6 (Implication Layer): Sixth layer of our system is described in the form of implication, which expresses the consequent part of our Sugeno-based approach. The objective of this layer is to find the average of Membership grade (M) and Non-Membership grade (NM) as follows:
(5)
is the minimum of membership values, and:
(6)
is the maximum of non-membership values:
Layer 7 (Output or Defuzzification Layer): This is the final layer of our system and output for our proposed system will be calculated as:
(7)
Moreover, the error for our proposed system is calculated as:
(8)
where Y is the output value calculated by our system and T is the targeted values value.
Our system might be wrong in calculating and finding the correct output due to uncertainties in data. So, we have to optimize these errors by optimizing the weights which are used by us in the equation of yi,
where
6. Proposed Optimization Technique
We have the output equation as:
(9)
in which we got six weights as
that are to be optimized to minimize the error. In this respective work we used the general concept of Hit and Trial method to optimize the weights. The given method is used to minimize the error in this paper which can increase its accuracy.
In this method we have used a technique in which we choose the optimized value for the
by any existing method. In this technique we find the values for these weights once and after that we used these values thoroughly for each example. This proposed technique is better than other techniques due to its low complexity in calculations. In other techniques we must do more complex calculations to optimize weights again and again but, in this technique, we optimize these weights once and use in whole calculation. Flow chart for this proposed technique has shown in Figure 3.
7. Data Collection Method
In this paper, we have used the dataset from the website of Pima Indians Diabetes Database (PIDD). PIDD is a huge group which has the large number of datasets for diabetes globally. The National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) [37] have studied the Pima Indians. And the database of PIDD for this work is saved from the Internet (http://archive.ics.uci.edu/ml/).
8. Numerical Computations and Comparison with Existing Algorithms
We choose the patients randomly from the given data to check the output of diabetes; first, we developed the INSFS structure considering fuzzy rules based on Sugeno’s Approach.
Figure 3. Representation of proposed technique.
We have two outputs for diabetes i.e., 1 and 0, which means Yes and No.
For example: we took one patient with ID 31which is shown in Table 2.
Layer 1: G = 145 mg/dL; BP = 82 mmHg; BMI = 22.2 kg/m2; A = 57 yrs; I = 110 IU/mL; DPF = 0.245 are six inputs for patient 31.
Layer 2: After taken the values of inputs from given data we have to fuzzify them for further calculation.
So, the membership and non-membership values for given inputs given as:
For glucose:
&
;
For BP:
&
;
For insulin:
&
;
For BM:
&
;
For DPF:
&
;
For MRC:
&
;
For age:
&
.
Here we got two values for DPF as 0.245 lies between two ranges i.e., MRC and LC, which has given above.
Layer 3: Corresponding to these six inputs from all possible rules, we have only two rules, which will be fired in this case.
Therefore, we have two fired rules as follows:
R1: IF Glucose is medium and Diastolic B.P. is normal and BMI is normal and Age is most high and Insulin is low and DPF is less chance THEN output is:
R2: IF Glucose is medium and Diastolic B.P. is normal and BMI is normal and Age is most high and Insulin is low and DPF is more chance THEN output is:
Layer 4: Weight or strength of the rules can be determined as follows:
W1:
and:
W2:
and:
i.e., W1 = 0.6375 and 0.3625
W2 = 0.49 and 0.51.
Layer 5: We have calculated the values of functional consequent by the expression of yi, which is the consequent part of fuzzy rules. After calculating, we have the values of y1 and y2 as follows:
and
.
Layer 6: This is the Implication layer; here we have calculated the value of overall Membership and Non-Membership, as following:
M is membership value:
NM is non-membership value.
Layer 7: This is the final layer of our structure, which is Output Layer and the output have calculated as:
The error of our structure is shown as:
We have, Y = 0.0985 and T = 0 (as given o/p from the given data).
So,
Table 3. Comparison of proposed technique’s accuracy with the existing [7] [9].
9. Conclusions and Discussions
The entire work done in this article illustrates the following points:
1) Proposed intuitionistic fuzzy logic-based neuro system shows the diagnostic process of diabetes with the help of membership and non-membership function with some hesitation margins. We have adopted the framework of intuitionistic fuzzy logic-based inference system in the neural network, in which the neural network works as hardware and intuitionistic fuzzy-based inference system works as software.
2) The experimental data of the diabetic patient is collected from PIDD, to check the accuracy of our proposed system and to minimize the complexity of treating diabetes.
3) In this work, a survey has been done on various optimization techniques. We have considered many optimization tools used in existing literature for optimization, the proposed work contains 21 previous studies on optimization in different fields.
4) A comparative study is also given in this work (as revealed in Table 3), the accuracy value of our system has also been calculated as shown in Table 2. The obtained value is 88.76% which is more optimal than the values obtained in the previously existing techniques. Therefore, the proposed system can help doctors in hospitals to evaluate the risk of diabetes.
5) For the future perspective, the proposed method describes that its performance is increased with the use of any population-based optimization technique and it will provide better results.
6) To decrease the complexity of the system, we have used the MATLAB software to the representation of membership and non-membership values of the input variable. And the further process is handled by using Sugeno’s fuzzy inference system based on the intuitionistic fuzzy logic approach.
7) The proposed model has considered the six major input factors (due to the effects of these factors on diabetes diseases) for Sugeno’s fuzzy inference system in the intuitionistic environment.
Acknowledgements
The corresponding author is thankful to the Higher Education Department of Uttar Pradesh Government for financial support under the research and development scheme, file number: 47/2021/606/sattar-4-2021-4(56)/2020.