Levenberg-Marquardt Method for Mathematical Programs with Linearly Complementarity Constraints


In this paper, a new method for solving a mathematical programming problem with linearly complementarity constraints (MPLCC) is introduced, which applies the Levenberg-Marquardt (L-M) method to solve the B-stationary condition of original problem. Under the MPEC-LICQ, the proposed method is proved convergent to B-stationary point of MPLCC.

Share and Cite:

Zhang, C. , Sun, L. , Zhu, Z. and Fang, M. (2015) Levenberg-Marquardt Method for Mathematical Programs with Linearly Complementarity Constraints. American Journal of Computational Mathematics, 5, 239-242. doi: 10.4236/ajcm.2015.53020.

1. Introduction

The mathematical program with equibrium constraints (MPEC) has extensive application in area engineering design and economic model [1] . It has been an active research topic in recent years. In this paper, we consider the mathematical programming problem with linearly complementarity constraints (MPLCC), which is a special case of the MPEC:


where is twice continuously differential real-valued function;, and are given matrices; and are given p, m dimensional vectors, respectively.

Complementarity constraints in MPEC are known to be difficult to treat. Research work on the MPEC includes the monograph of Luo et al. [1] in which Bouligand stationary condition is introduced that provides a comprehensive study on MPEC. Based on different formulations, there are many algorithms such as Fukushima [2] , Zhu [3] , Zhang [4] [5] , Jiang [6] , Tao [7] , and Jian [8] . Notice that B-stationary condition is a stronger stationary point. Differing from the approaches mentioned above, we directly introduce L-M technique, without any reformulation or relax form, to solve the B-stationary condition of MPLCC (1.1).

The plan of the paper is as follows: in Section 2, some preliminaries and model we used are presented; in Sec- tion 3, the algorithm is proposed.

2. Preliminaries

For reader’s convenience, we use following notation throughout this paper:

Let F denote the feasible set of problem (1.1).

Now we give two definitions as follow.

Definition 2.1. Let be a feasible point of MPLCC (1.1), we say that MPEC linear independence constraint qualification is satisfied at if the gradient vectors

is linearly independent, where,

Definition 2.2. Under the MPEC-LICQ, a feasible point z is a B-stationary of problem (1.1) if there exist multiplier vectors, and such that






As we know, most of the works on MPLCC want to get the B-stationary point of problem (1.1), so we also put emphasis on trying to construct a method to obtain the B-stationary of MPLCC (1.1). Now we rewrite the conditions (2.1)-(2.5) in term of lagrange multipliers as follow:


subject to:





Remark: In (2.7) we replace with, because it will be convenient for our computing.

3. The Description of Algorithm

Without any reformulation and relaxing techniques, we now use L-M method to solve the nonlinear systems (2.6). Firstly, let J be the Jacobian of at. For an approximate solution of (2.6), in order to produce an improving direction, we consider the following system of linear equations


where, is a constant.

Lemma 3.1. The coefficient matrix of (L − M) is positive definite, and furthermore, (L − M) method has unique solution.

According to the constraint conditions, we now find a step length for current iterated point. First, we consider computing the step length of. In the first place, for each constraint in (2.7), we should use the and to computer a step length:


where is the element of. Similar to the discussion of step length about x, we can obtain the step length about.

As to calculating the step length for the constraint we get the solution to the equation with as its variable, then is as follows:



Secondly, we will consider the step length of. Based on the step length that we obtain above, we can compute the value of. If there is some i that, then the step length of corres- ponding variables is obtained by the same way in (3.2) in order to satisfy the constraints (2.8); otherwise the step lengths of u, v are set to 1. The step length of is set to 1.

In this paper, we take as the merit function.

Lemma 3.2. Let be computed from (3.1), then

Proof. In view of Equation (3.1) and the positive definition of matrix, we have

Now we present the algorithm.

Algorithm A:

Step 0: Given a feasible initial point, let;

Step 1: If, then stop; else get the for (3.1);

Step 2: Compute the step length;

Step 3:, go to Step 1, where.

Theorem 3.1. Suppose that is generated by Algorithm A and converges to; if for infinitely

many k, let the MPEC-LICQ hold on, then is a B-stationary point of problem (1.1).

Proof. From the construction of the algorithm, we have for sufficient large k and. And because the MPEC-LICQ holds on, then is a B-stationary point of problem (1.1).


This work was supported in part by the National Natural Science Foundation (No. 11361018), the Natural Science Foundation of Guangxi Province (No. 2014GXNSFFA118001), Key Program for Science and Technology in Henan Education Institution (No. 15B110008) and Huarui College Science Foundation (No. 2014qn35) of China.


*Corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.


[1] Luo, Z.Q., Pang, J.S. and Ralph, D. (1996) Mathmetical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge.
[2] Fukushima, M., Luo, Z.Q. and Pang, J.S. (1998) A Globally Convergent Sequential Quadratic Programming Algorithm for Mathematical Programs with Linear Complementarity Constraints. Computational Optimization and Application, 10, 5-34.
[3] Zhu, Z.B. and Zhang, K.C. (2006) A Superlinearly Convergent SQP Algorithm for Mathematical Programs with Linear Complementarity Constraints. Application and Computation, 172, 222-244.
[4] Zhang, C., Zhu, Z.B., Chen, F.H. and Fang, M.L. (2010) Sequential System of Linear Equations Algorithm for Optimization with Complementary Constraints. Mathematics Modelling and Applied Computing, 1, 71-80.
[5] Zhang, C., Zhu, Z.B. and Fang, M.L. (2010) A Superlinearly Convergent SSLE Algorithm for Optimization Problems with Linear Complementarity Constraints. Journal of Mathematical Science: Advance and Application, 6, 149-164.
[6] Jiang, H. (2000) Smooth SQP Methods for Mathematical Programs with Nonlinear Complementarity Constraints. SIAM Journal of Optimization, 10, 779-808.
[7] Tao, Y. (2006) Newton-Type Method for a Class of Mathematical Programs with Complementarity Constrains. Computers and Mathematics with Applications, 52, 1627-1638.
[8] Jian, J.B. (2005) A Superlinearly Convergent Implicit Smooth SQP Algorithm for Mathematical Programs with Nonlinear Complemetarity Constraints. Computational Optimization and Applications, 31, 335-361.

Copyright © 2023 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.