On the approximation of the integer least-squares success rate: which lower or upper bound to use?

Sandra Verhagen

Delft Institute of Earth Observation and Space Systems, Delft University of Technology, Kluyverweg 1, 2629 HS Delft.

DOI:                 

Abstract

The probability of correct integer estimation, the success rate, is an important measure when the goal is fast and high precision positioning with a Global Navigation Satellite System. Integer ambiguity estimation is the process of mapping the least-squares ambiguity estimates, referred to as the float ambiguities, to an integer value. It is namely known that the carrier phase ambiguities are integer-valued, and it is only after resolution of these parameters that the carrier phase observations start to behave as very precise pseudorange measurements. The success rate equals the integral of the probability density function of the float ambiguities over the pull-in region centered at the true integer, which is the region in which all real values are mapped to this integer. The success rate can thus be computed without actual data and is very valuable as an a priori decision parameter whether successful ambiguity resolution is feasible or not. The pull-in region is determined by the integer estimator that is used and therefore the success rate also depends on the choice of the integer estimator. It is known that the integer least-squares estimator results in the maximum success rate. Unfortunately, it is very complex to evaluate the integral when integer least-squares is applied. Therefore, approximations have to be used. In practice, for example, the success rate of integer bootstrapping is often used as a lower bound. But more approximations have been proposed which are known to be either a lower or upper bound of the actual integer least-squares success rate. In this contribution an overview of the most important lower and upper bounds will be given. These bounds are compared theoretically as well as based on their performance. The performance is evaluated using simulations, since it is then possible to compute the ’actual’ success rate. Simulations are carried out for the two-dimensional case, since its simplicity makes evaluation easy, but also for the higher-dimensional geometry-based case, since this gives an insight to the performance that can be expected in practice.

Keywords

ambiguity resolution, success rate, integer least-squares

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	De Jonge P.J. and C.C.J.M. Tiberius (1996) The LAMBDA method for integer ambiguity estimation: implementation aspects, Publications of the Delft Computing Centre, LGRSeries No. 12.
[2]	Hassibi A. and S. Boyd (1998) Integer parameter estimation in linear models with applications to GPS, IEEE Transactions on Signal Processing, Vol. 11, No. 11, pp. 2938-2952.
[3]	Kondo K. (2003) Optimal success/error rate and its calculation in resolution of integer ambiguities in carrier phase positioning of Global Positioning System (GPS) and Global Navigation Satellite System (GNSS), Proc. of ION Annual Meeting, Albuquerque, New Mexico, pp. 176-187.
[4]	Teunissen P.J.G. (1993) Least-squares estimation of the integer GPS ambiguities, Invited Lecture, Section IV Theory and Methodology, IAG General Meeting, Beijing, China, August 1993. Also in: LGR Series, No. 6, Delft Geodetic Computing Centre.
[5]	Teunissen P.J.G. (1995) The least-squares ambiguity decorrelation adjustment: a method for fast GPS integer ambiguity estimation, Journal of Geodesy, Vol. 70, pp. 65-82.
[6]	Teunissen P.J.G. (1997) A canonical theory for short GPS baselines. Part IV: Precision versus reliability, Journal of Geodesy, Vol. 71, pp. 513-525.
[7]	Teunissen P.J.G. (1998a) On the integer normal distribution of the GPS ambiguities, Artificial Satellites, Vol. 33, No. 2, pp. 49-64.
[8]	Teunissen P.J.G. (1998b) Some remarks on GPS ambiguity resolution, Artificial Satellites, Vol. 32, No. 3, pp. 119-130.
[9]	Teunissen P.J.G. (1997) Success probability of integer GPS ambiguity rounding and bootstrapping, Journal of Geodesy, Vol. 72, pp. 606-612.
[10]	Teunissen P.J.G. (1999) An optimality property of the integer least- squares estimator, Journal of Geodesy, 73: 587-593.
[11]	Teunissen P.J.G. (2000) ADOP based upperbounds for the bootstrapped and the least-squares ambiguity success rates, Artificial Satellites, Vol. 35, No. 4, pp. 171-179.
[12]	Teunissen P.J.G. and D. Odijk (1997) Ambiguity Dilution of Precision: definition, properties and application, Proc. Of ION GPS-1997, Kansas City MO, pp. 891-899.
[13]	Thomsen H.F. (2000) Evaluation of upper and lower bounds on the success probability, Proc. of ION GPS-2000, Salt Lake City UT, pp. 183-188.