Bayesian Study Using MCMC of Three-Parameter Frechet Distribution Based on Type-I Censored Data

Abstract

Type-I censoring mechanism arises when the number of units experiencing the event is random but the total duration of the study is fixed. There are a number of mathematical approaches developed to handle this type of data. The purpose of the research was to estimate the three parameters of the Frechet distribution via the frequentist Maximum Likelihood and the Bayesian Estimators. In this paper, the maximum likelihood method (MLE) is not available of the three parameters in the closed forms; therefore, it was solved by the numerical methods. Similarly, the Bayesian estimators are implemented using Jeffreys and gamma priors with two loss functions, which are: squared error loss function and Linear Exponential Loss Function (LINEX). The parameters of the Frechet distribution via Bayesian cannot be obtained analytically and therefore Markov Chain Monte Carlo is used, where the full conditional distribution for the three parameters is obtained via Metropolis-Hastings algorithm. Comparisons of the estimators are obtained using Mean Square Errors (MSE) to determine the best estimator of the three parameters of the Frechet distribution. The results show that the Bayesian estimation under Linear Exponential Loss Function based on Type-I censored data is a better estimator for all the parameter estimates when the value of the loss parameter is positive.

Share and Cite:

Ahmed, A. (2021) Bayesian Study Using MCMC of Three-Parameter Frechet Distribution Based on Type-I Censored Data. Journal of Applied Mathematics and Physics, 9, 220-232. doi: 10.4236/jamp.2021.92016.

1. Introduction

Frechet distribution was introduced by [1] for the largest extremes and it had been derived with nonnegative initial variates. Many studies have been carried out on the Frechet distribution by a lot of researchers with the aim of estimating its parameters using different statistical approaches, some of which include [2] [3] and [4]. Furthermore, [5] estimated the scale and shape parameters of Frechet distribution using principal components and least median of squares. [6] derived the reference and matching priors for the Frechet stress-strength model and developed Bayesian approach for Frechet distribution under reference prior, respectively. [7] attained Bayesian estimators of Frechet distribution and their risks by using loss functions under Gumbel Type-II prior and Levy prior. Likewise, [8] estimated the Frechet distribution parameters with an application to the medical field. As demonstrated above, no previous study dealt with Bayesian estimations of the three-parameter Frechet distribution under Type-I censored data in survival/reliability analysis.

One of the special features of survival/reliability analysis data is the censoring mechanism. There are several types of censoring mechanisms but the focus of this manuscript is in Type-I censoring. Type-I censoring is where a study is designed to end at some pre-specified given time and an event is said to have taken place if and only if the event occurs before or at the specified time period.

In this paper we want to solve the following steps:

1) To estimate the three parameters of Frechet distribution using Type I censored data by the maximum likelihood model.

2) To estimate the three parameters of Frechet distribution using Type I censored data with Jeffreys and gamma priors via Markov Chain Monte Carlo (MCMC).

3) To extend the Bayesian estimators with two loss functions, which are squared error loss function and Linear Exponential Loss Function (LINEX).

4) To assess the performance of maximum likelihood and Bayesian models through simulation study.

2. Methodology

2.1. Maximum Likelihood Estimation of Frechet Censored Data

We introduce the concept of maximum likelihood estimation on distribution with censored data. Let ( x 1 , , x n ) be the set of n random lifetime from the Frechet distribution with parameters λ , α and β . The probability density function of the Frechet distribution according to [1] is:

f ( x ; λ , α , β ) = α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) , (1)

where the cumulative distribution function (cdf) of the Frechet distribution is given as

F ( x ; λ , α ) = exp ( ( x β λ ) α ) , (2)

with λ as the scale parameter, α the shape parameter and β the location parameter of the distribution

The likelihood function for a Type-I censored data as in [9] is

L ( λ , α | x ) = i = 1 n [ f ( x i ; λ , α ) ] δ i [ S ( x i ; λ , α ) ] 1 δ i , (3)

where δ i = 1 for failure and δ i = 0 for censored observation, and S ( . ) is the survival function.

The logarithm of the likelihood function given in Equation (3) can be expressed as follows:

ln L ( λ , α , β | x ) = i = 1 n [ δ i ( ln α + α ln λ ( α + 1 ) ln ( x i β ) ) ( x i β λ ) α ] + i = 1 n [ ( 1 δ i ) l n ( 1 exp ( ( x i β λ ) α ) ) ] (4)

To obtain the equations for the unknown parameters, we differentiate Equation (4) partially with respect to the parameters λ , α and β and equal it to zero. The resulting equations are given below respectively see [10],

L λ i = α i = 1 n δ i λ α i = 1 n δ i λ ( x i β λ ) α + i = 1 n ( 1 δ i ) ( α ( x i β λ ) α exp ( ( x i β λ ) α ) λ ( 1 exp ( ( x i β λ ) α ) ) ) (5)

L α i = i = 1 n δ i [ 1 α + ln ( λ ) ln ( x i β ) + ( x i β λ ) α ln ( x i β λ ) ] + i = 1 n ( 1 δ i ) ( ( x i β λ ) α ln ( x i β λ ) exp ( ( x i β λ ) α ) 1 exp ( ( x i β λ ) α ) ) (6)

L β i = i = 1 n δ i ( ( α 1 ) + α ( x i β λ ) α x i β ) + i = 1 n ( 1 δ i ) ( α ( x i β λ ) α exp ( ( x i β λ ) α ) ( x i β ) ( 1 exp ( ( x i β λ ) α ) ) ) (7)

2.2. Bayesian Estimation of Frechet Based on Type-I Censored Data

We consider Jeffreys prior for the scale and shape parameters. Moreover, the gamma prior will be in location parameter and the proposed prior is, see [8].

g ( λ ) 1 λ (8)

g ( α ) 1 α (9)

g ( β / c , d ) β c 1 exp ( d β ) (10)

The joint prior distribution of three parameters is

g ( λ , α , β / c , d ) 1 λ α β c 1 exp ( d β ) (11)

The posterior probability density function of the three parameters given the data ( x 1 , , x n ) is obtained by dividing the joint probability density function over the marginal density function, following [11].

Π ( λ , α , β | x ) = L ( λ , α , β | x ) g ( λ , α , β / c , d ) 0 0 L ( λ , α , β | x ) g ( λ , α , β / c , d ) d λ d α d β (12)

= 1 λ α β c 1 exp ( d β ) i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i [ 1 exp ( ( x β λ ) α ) ] 1 δ i 0 0 1 λ α β c 1 exp ( d β ) i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i [ 1 exp ( ( x β λ ) α ) ] 1 δ i d λ d α d β (13)

With this, the Bayesian estimates for the three parameters of Frechet distribution under squared error loss function are given as:

λ ^ s = 0 0 λ Π ( λ , α , β | x ) d λ d α d β (14)

α ^ s = 0 0 α Π ( λ , α , β | x ) d λ d α d β (15)

β ^ s = 0 0 β Π ( λ , α , β | x ) d λ d α d β (16)

The Bayesian estimates under Linear Exponential Loss Function (LINEX)

λ ^ l = 1 r ln [ 0 0 exp ( r λ ) Π ( λ , α , β | x ) d λ d α d β ] (17)

α ^ l = 1 r ln [ 0 0 exp ( r α ) Π ( λ , α , β | x ) d λ d α d β ] (18)

β ^ l = 1 r ln [ 0 0 exp ( r β ) Π ( λ , α , β | x ) d λ d α d β ] (19)

The parameters (scale, shape and location) of the Frechet distribution cannot be solved analytically under the Bayesian approach therefore, Metropolis-Hastings Algorithm is. Used instead.

Metropolis-Hastings Algorithm

The Metropolis-Hastings algorithm is a very general Markov Chain Mote Carlo method. It can be used to obtain random samples from any arbitrarily complicated target distribution of any dimension that is known up to a normalizing constant. In fact, Metropolis algorithm is an alternative to Gibbs sampler that does not require availability of full conditionals see [12] [13] and [14].

Therefore, the full conditional posterior density function for the three parameters given the data for Jeffreys prior with likelihood are given below

Π ( λ , α , β | x ) 1 λ α β c 1 exp ( d β ) i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i × [ 1 exp ( ( x β λ ) α ) ] 1 δ i (20)

From Equation (20) we can get the conditional posterior of the scale parameter λ as follows

Π ( λ | α , β , x ) 1 λ i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i × [ 1 exp ( ( x β λ ) α ) ] 1 δ i (21)

where the others the scale parameter will be constant for the conditional posterior of the scale parameter then from the posterior we can remove and get the final formula as given in Equation (21).

The conditional posterior of the shape parameter is given below

Π ( β | λ , α , x ) β c 1 i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i × [ 1 exp ( ( x β λ ) α ) ] 1 δ i (22)

The conditional posterior of the location parameter is given below

Π ( α | λ , β , x ) 1 α i = 1 n [ α λ ( x β λ ) ( α + 1 ) exp ( ( x β λ ) α ) ] δ i × [ 1 exp ( ( x β λ ) α ) ] 1 δ i (23)

As shown in the conditional posterior of the three parameters, they do not follow any close form, hence the use of Metropolis-Hastings algorithm as detailed below to generate MCMC sample, see [15] and [16].

Algorithm:

1) Start with initial value λ 0 , α 0 , β 0

2) The current value λ i , α i , β i and generate the candidate value λ , α , β * from arbitrary distribution Uniform (0, 1).

3) Taken the ratio at the candidate value λ and current value λ i

γ 1 = min { 1 , Π ( λ | α , β , x ) Π ( λ i | α , β , x ) }

The next value of λ i is given below as

λ i + 1 = { λ with probability p λ i with probability 1 p

4) Generate u from Uniform (0, 1) and accept λ with probability p if λ < p and return to step 2, otherwise accept λ i and return to step 2.

5) Taken the ratio at the candidate value α and current value α i

γ 2 = min { 1 , Π ( α | λ , β , x ) Π ( α i | λ , β , x ) }

The next value of α i is given below as

α i + 1 = { α with probability p α i with probability 1 p

6) Generate u from Uniform (0, 1) and accept α with probability p if α < p and return to step 2, otherwise accept α i and return to step 2.

7) Taken the ratio at the candidate value β and current value β i

γ 3 = min { 1 , Π ( β | λ , α , x ) Π ( β i | λ , α , x ) }

The next value of α i is given below as

β i + 1 = { β with probability p β i with probability 1 p

8) Generate u from Uniform (0, 1) and accept β with probability p if β < p and return to step 2, otherwise accept β i and return to step 2.

9) The Bayesian estimation of the scale, shape and location parameters under the squared error loss function is given as

E ^ S ( λ | α , β , x ) = 1 n i = 1 n λ i (24)

E ^ S ( α | λ , β , x ) = 1 n i = 1 n α i (25)

E ^ S ( β | λ , α , x ) = 1 n i = 1 n β i (26)

10) The Bayesian estimation of the scale, shape and location parameters under the Linex loss function is given as

E ^ L ( λ | α , β , x ) = 1 r ln [ 1 n i = 1 n exp ( r λ i ) ] (27)

E ^ L ( α | λ , β , x ) = 1 r ln [ 1 n i = 1 n exp ( r α i ) ] (28)

E ^ L ( β | λ , α , x ) = 1 r ln [ 1 n i = 1 n exp ( r β i ) ] (29)

3. Simulation Study

The values specified for the parameters, sample sizes, censoring time and the Linex loss function were meant for illustration purposes only and were therefore not restrictive. However, to assess the performance of the Maximum likelihood and Bayesian estimations based on Type-I censored data to estimate the three parameters of Frechet distribution, the Mean Squared Errors (MSE) were calculated after running 10,000 iterations. Different sets of sample sizes as well as censoring mechanisms were considered. The samples were n = 25, 50 and 100 and that of the censoring time was 20%. The values considered for the Frechet distribution parameters were the scale parameter which was (1 and 2), the shape parameter which was (0.4 and 1.4) and the location parameter which was 3. Two values (both decreasing and increasing) were specified for the Linex loss function; these were; r = −0.7 and 0.7. The maximum likelihood (MLE) estimated the three parameters of Frechet distribution by using the numerical method with R programme in the Equation (4) via (maxLik) package. In the Bayesian estimation, the Metropolis-Hastings Algorithm was used in Algorithm via (pscl) package in R programme for Bayesian under square error loss function and LINEX loss function to estimate the three parameters of Frechet distribution, where hyper-parameters of gamma priors were equal to 1.

The results were displayed in Tables 1-6 and indicated the different choices of the three parameters, sample size, loss parameter and censoring rate.

Table 1. Estimate the scale parameter of Frechet based on Type-I censored data.

Table 2. MSE for the scale parameter of Frechet based Type-I censored data.

Table 3. Estimate the shape parameter of Frechet based Type-I censored data.

Table 4. MSE for the shape parameter of Frechet based Type-I censored data.

Table 5. Estimate the location parameter of Frechet based Type-I censored data.

Table 6. MSE for the location parameter of Frechet based Type-I censored dat.

4. Results and Discussion

Four values of the estimators which are Maximum likelihood estimation (MLE), Bayesian under squared error loss function (BS), Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = −0.7)) and Bayesian under Linear Exponential Loss Function with r = 0.7 (BL (r = 0.7)) are shown in each column for each size.

Table 1 contains the estimate of the scale parameter of Frechet distribution based on Type-I censored data with Maximum likelihood, Bayesian under squared error loss function and under Linear Exponential Loss Function with r = −0.7 and 0.7. As shown in the results when the shape paramemter λ was 1 and location pramster α was 0.4 with size 25, the Maximum Likelihood Estimation (MLE) was 1.1042, the Bayesian under squared error loss function (BS) estimation was 1.1486, BL (r = −0.7) estimation was 1.1580 and BL (r = 0.7) estimation was 1.0716, we observed that the BL (r = 0.7) was closer to true value than others estimation.

From Table 2 the results show that, the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 is better compared to the others with respect to the MSE of scale parameter. We observed from Table 2 that the maximum likelihood estimation has the smallest MSE and therefore is a better estimate that Bayesian under squared error loss function as well as Bayesian under Linear Exponential Loss Function with r = −0.7 for all cases except with size 25 when.

Table 3 presented the estimates of the shape parameter of Frechet distribution based on Type-I censored data by employing the four estimators above as illustrated earlier. The initial values of the shape parameter were 0.4 and 1.4.

As shown in the results, the Maximum Likelihood Estimation (MLE) was 0.5432 and the Bayesian under squared error loss function (BS) estimation was 0.5876. When the true value of the shape parameter was 0.4, we observed that the MLE was closer to true value than BS estimation.

As shown in the results when the shape paramemter λ was 1 and location pramster α was 0.4 with size 25, the Maximum Likelihood Estimation (MLE) was 0 5432, the Bayesian under squared error loss function (BS) estimation was 0.5876, BL (r = −0.7) estimation was 0.5971 and BL (r = 0.7) estimation was 0.5106, we observed that the BL (r = 0.7) was closer to true value than others estimation.

As shown in Table 4 the performance of the estimators for the estimation of the shape parameter was compared again using mean squared error (MSE). We again observed that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 performed better compared to the others with respect to the MSE of scale parameter. Moreover, the maximum likelihood estimation is better than Bayesian under squared error loss function and Bayesian under Linear Exponential Loss Function with r = −0.7 for all cases except with size 25 when also with size 50 when Table 5 presented the estimates of the location parameter of Frechet distribution based on Type-I censored data by employing the four estimators. The initial value of the location parameter was 3. The result showed that the MLE was 3.1165 and Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = 0.7)) estimation was 3.0839. We observed that the Bayesian under Linear Exponential Loss Function with r = −0.7 (BL (r = 0.7)) estimation was closer to true value than the MLE.

In Table 6 the estimators of the location parameter were compared by mean square error (MSE) and it was observed that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 is better compared to the others with respect to the MSE of scale parameter. Moreover, the maximum likelihood estimation is better than Bayesian under squared error loss function and Bayesian under Linear Exponential Loss Function with r = −0.7.

5. Conclusion

The results from this study show that the Bayesian estimation under Linear Exponential Loss Function with r = 0.7 based on Type-I censored data was a better estimator for all the parameters (scale, shape and location) estimates. The contribution to knowledge in this manuscript was the application of the Bayesian estimation approaches based on Type-I censored data that was considered under Markov Chain Monte Carlo (MCMC) for the three parameters of Frechet distribution. The Maximum Likelihood Estimation (MLE) was better than Bayesian under square error loss function and Exponential Loss Function with r = −0.7 for all the parameters (scale, shape and location) estimates. When the number of sample size increases, the mean squared errors (MSE) decrease in all cases.

Conflicts of Interest

The author declares no conflicts of interest regarding the publication of this paper.

References

[1] Frechet, M. (1928) Sur la loi de probabilite de lecart maximum. Annales Polonici Mathematici, 6, 93-116.
[2] Gumbel, E.J. (1965) A Quick Estimation of the Parameters in Frechet’s Distribution. Review of the International Statistical Institute, 33, 349-363.
https://doi.org/10.2307/1401700
[3] Mann, R.N. (1984) Statistical Estimation of Parameters of the Weibull and Frechet Distribution. In: de Oliveira, J.T., Ed., Statistical Extremes and Applications, Vol. 131, Springer, Dordrecht, 81-89.
https://doi.org/10.1007/978-94-017-3069-3_6
[4] Hooda, B.K., Singh, N.P. and Singh, U. (1993) On Estimation in Fre’chet Distribution of m-th Maxima. Communications in Statistics-Theory and Methods, 22, 907-919.
https://doi.org/10.1080/03610929308831064
[5] Afify, E.D. (2004) On the Confidence Interval of the Frechet Distribution. Far East Journal of Theoretical Statistics, 12, 221-226.
[6] Abbas, K. and Tang, Y. (2015) Analysis of Frechet Distribution Using Reference Priors. Communications in Statistics-Theory and Methods, 44, 2945-2956.
https://doi.org/10.1080/03610926.2013.802351
[7] Nasir, W. and Aslam, M. (2015) Bayes Approach to Study Shape Parameter of Frechet Distribution. International Journal of Basic and Applied Sciences, 4, 246-254.
https://doi.org/10.14419/ijbas.v4i3.4644
[8] Abbas, K., Abbasi, N.Y., Ali, A., Khan, S.A., Manzoor, S., Khalil, A., Khalil, U., Khan, D.M., Hussain, Z. and Altaf, M. (2019) Bayesian Analysis of Three-Parameter Frechet Distribution with Medical Applications. Computational and Mathematical Methods in Medicine, 2019, Article ID: 9089856.
https://doi.org/10.1155/2019/9089856
[9] Klein, J.P. and Moeschberger, M.L. (2003) Survival Analysis: Techniques for Censored and Truncated Data. Springer, New York.
https://doi.org/10.1007/b97377
[10] Al Eibood, F. and Eidous, O. (2017) A Weighted Exponential Model for Grouped Line Transect Data. Mathematics and Statistics, 5, 1-4.
https://doi.org/10.13189/ms.2017.050101
[11] Al Omari, M.A., Ibrahim, N.A., Arasan, J. and Adam, M.B. (2012) Bayesian Survival and Hazard Estimate for Weibull Censored Time Distribution. Journal of Applied Sciences, 12, 1313-1317.
https://dx.doi.org/10.3923/jas.2012.1313.1317
[12] Hastings, W.K. (1970) Monte Carlo Sampling Methods Using Markov Chains and Their Applications. Biometrika, 57, 97-109.
https://doi.org/10.1093/biomet/57.1.97
[13] Soliman, A.A., Abd-Ellah, A.H., Abou-Elheggag, N.A. and Ahmed, E.A. (2011) Modified Weibull Model: A Bayes Study Using MCMC Approach Based on Progressive Censoring Data. Reliability Engineering & System Safety, 100, 48-57.
https://doi.org/10.1016/j.ress.2011.12.013
[14] Suparman (2020) Bayesian Estimation in Piecewise Constant Model with Gamma Noise by Using Reversible Jump MCMC. Mathematics and Statistics, 8, 17-22.
https://doi.org/10.13189/ms.2020.081303
[15] Al Omari, M.A. (2014) Comparison of the Bayesian Methods on Interval-Censored Data for Weibull Distribution. Open Journal of Statistics, 4, 570-577.
http://dx.doi.org/10.4236/ojs.2014.48053
[16] Al Omari, M.A. (2016) Bayesian Study Using MCMC of Gompertz Distribution Based on Interval Censored Data with Three Loss Functions. Journal of Applied Sciences, 16, 88-97.
https://dx.doi.org/10.3923/jas.2016.88.97

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.