Estimation of a Type of Form-Invariant Combined Signals under Autoregressive Operators

We focus on a type of combined signals whose forms remain invariant under the autoregressive operators. To extract the true signal from the autoregressive noise, we develop a strategy to separate parameters and use a two-step least squares approach to estimate the autoregressive parameters directly and then further give the estimate of the signal parameters. This method overcomes the difficulty that the autoregressive noise remains unknown in other methods. It can effectively separate the noise and extract the true signal. The algorithm is linear. The solution of the problem is computationally cheap and practical with high accuracy.


Introduction
The reconstruction of signals from color noises is a general problem in data processing.Effective solutions to this problem have a wide range of applications in many fields, such as radar signal processing, image enhancement, speech coding and data mining.Usually, different strategies are applied for different scenarios and assumptions.The parameter estimation of signals with autoregressive (i.e., AR) noises is a class of typical problems.
The approaches can be raised from several perspectives.Firstly, as far as the parameters estimation of the AR model is concerned, Harry H. Kelejian et al. [1] discussed the estimation of the autoregressive parameter in a widely considered spatial autocorrelation model.They suggested a generalized moment estimator that is computationally simple irrespective of the sample size.Sascha Korl et al. [2] considered this problem from a graphical-model viewpoint.In particular, they demonstrate joint estimation of AR coefficients, innovation variance and noise variance.Wing-Keung Wong et al. [3] presented the way of estimating parameters in AR models with asymmetric innovations.Jinfang Liu et al. [4] raised a self-tuning weighted measurement fusion Kalman filter to estimate the parameters for single channel autoregressive moving average signals with colored noise when the model parameters and noise statistics are unknown.
Secondly, for the noise removal and signal extraction, the simplest approach is to ignore the coloring of the noise and use methods such as least squares that assume white noise.This approach is obviously inappropriate.Mihalis Samonas et al. [5] used a self-consistent restoration peak preserving algorithm to eliminate the high level additive colored Gaussian noise.David Kozel et al. [6] proposed a spectral subtraction algorithm for reducing colored noise from noise-corrupted speech, however with a limitation of the requirement of a favorable signal to noise ratio as with all spectral subtraction algorithms.Jesper Højvang Jensen et al. [7] derived the signal amplitude and noise covariance matrix estimator with colored Gaussian noise and extended the existed singlesinusoid algorithm to multiple sinusoids.The method does not consider the estimation of the noise covariance matrix and the sinusoid amplitudes as two separate tasks, but rather estimates them jointly.
In addition to the above two types of methods, the most effective way is apparently to derive the AR pa-rameters and the true signal parameters simultaneously.This is difficult to perform in the general case.In this contribution, as for a wide class of signals which are form-invariant under the autoregressive operators, we propose a method of parameters separation and then use the idea to give the estimates of both the AR and the signal parameters.This approach can solve the above problem and improve the estimation accuracy of the true signal.

Signal-Noise Model
Consider the observation   y t satisfies the following model where where B is a one-step backward operator, and  1) and (2).
The vector form of model ( 1) is as following. where is a known column-full-rank matrix, which is usually called the design matrix in linear regression analysis, and As e is a stationary correlated noise, the least squares estimates  X X X Y will no longer possess the favorable properties as usual.In this case, the weighted least squares estimates should be used, which requires the knowledge of the co- However, e not observable in practice, thus the solution to is rather difficult.To solve this problem, we need to find another way.Signals and noises can usually be expressed as parametric models, thus it can be summed up as parameter estimation issues of the signal-noise models.In the following part of this paper, we will give the estimates of both the AR and the signal parameters for a wide class of signals which are form-invariant under the autoregressive operators.is Σ

  Φ B
For , we impact the autoregressive operator on both sides of (1) at the same time and get where In the procedure of the above transformation, if the true signal β satisfies the following property: where is the vector function of , φ β , and the design matrix made up by the transformed remains the characteristics of column-full-rank, then we call . Here the design matrix remains column-full-rank under is the key factor, which will be shown clearly in the following section.One of an important special case for Equation ( 5) is that: That is, the design matrix remains completely the same under the impact of A. Polynomial signal Assume where Then we have β is the form-invariant signal satisfying Equation (6).then β is another form-invariant signal satisfying Equation (6).
Finally, we can come to the statement that the mixed signals composed of the signals above linearly (e.g.,

Suppose ,
  sides the signals we mentioned above, there is also plenty of other form-invariant signals satisfying Equation ( 5) or Equation ( 6) in practice.where

The Estimation of Parameter φ
From the discussion above, for the form-invariant signal β , the linear model ( 1) becomes the following equation under the autoregressive operator : The vector form of Equation ( 7) is where

y p y p y y p y p y M y T y T y T p z p y p p z p y p p z T y T T
Since the design matrix of the form-invariant signal remains column-full-rank after the transform of , the least squares solution "in form" of Equation ( 8) is: The solution is called "in form" because in is unknown.And the residual sum of squares is where RSS φ is a quadratic function of , so there exists the unique satisfying The solution to Equation (11) is: The above procedure to get actually involves twice the solution to the minimum of least squares residuals, therefore Equation ( 12) is also called the two-step least squares estimate of .φ φ

The Estimation of Parameter β
After the acquisition of the estimate of , from Equation (4), we can regard the estimation of φ φ β as the parameter estimation of the following linear model: The vector form of Equation ( 13) is From Equation ( 14), the estimation of the parameter Furthermore, from Equation ( 15) and ( 14) we have 16) illustrates that the estimation error    φ φ φ of and impose "approximately" linear influences on the estimation error and it is "approximately" because includes .V φ

Simulation
We take the sample points at and two simulation models.
  Table 1 lists the estimation results of β by using the method proposed in this paper and the least squares estimate (LSE) respectively.Table 2 illustrates the estimation results of by using our method, and the least squares estimate of the AR parameters of Equation ( 19) when pure AR model is applied.Table 1 shows that the method proposed here can obtain a much better estimation of φ β than by using LSE.The results in Table 2 give a demonstration that the estimates of by our methods are close to the LSE of in pure AR models.In summary, the method proposed in this paper is satisfactory.

Conclusion
In this paper, a class of combined signal with AR noise is studied.The signal possesses the property of remaining form-invariant under the autoregressive operator.We proposed a parameter separation and two-step least squares method to separate the noise and signal and to give good estimates of each parameter.This method overcomes the difficulty with the conventional method for which the AR noise is unknown.It makes it easier to extract and estimate the true signal.It can provide good estimation effects for a wide class of signals and can be applied to the practical data analysis.
we give a few examples of the form-invariant signals.