Sequential Shrinkage Estimate for COX Regression Models with Uncertain Number of Effective Variables ()
1. Introduction
The COX proportional hazards model is a popular choice for the analysis of censored survival data with covariates, illustrated in [1] [2] [3]. It has been widely used in many areas, such as biomedical research and engineering, for assessing covariate effects on the time to some events in the presence. However, in applications such as Biology, Engineering and Epidemiology there are data sets that usually have a large number of explanatory variables but only a few of them contributes to the model. They were called effective variables in [4]. Many methods are focused on how to identify the effective variables such as LASSO and LARS, see in [5] and [6], however, people also want to know how many samples can identify the effective variables and simultaneously make the parameter estimates achieve a pre-specified accuracy. It is very important to those who care about the cost of samples such as Biology and Epidemiology. For linear regression model, Wang and Chang propose a sequential shrinkage estimate method to identify the effective variables and attain accuracy of parameter estimate in [4]. For COX regression models, similar methods have not been proposed, so there is still a lot of work to do for this problem.
For handling the problem mentioned above, we propose a sequential procedure for constructing the fixed size confidence set for effective parameters based on an adaptive shrinkage estimate (ASE) such that the effective coefficients can be efficiently identified with the minimum sample size. Suppose the conditional hazard rate of a survival time, T, given the regressor vector, X, is written as
(1)
In the paper, it will be studied under fixed design and the consistency and asymptotic properties of the proposed estimator will be obtained under this design. The rest of this paper is organized as follows. In Section 2, we will give the adaptive shrinkage estimate (ASE) based on the Maximum Partial Likelihood Estimate (MPLE) of COX regression models and their asymptotic properties. In section 3, sequential sampling strategy based on ASE and stopping rule as well as random size confident set is presented. In Section 4, an example with numerical simulation is given to illustrate the performance of the proposed method via sequential fixed size confidence estimation using synthesized data sets.
2. Sequential Adaptive Shrinkage Estimate
2.1. Asymptotic Properties of MPLE
Let
and
be the potential failure time and censoring time of the i-th
subject from a random sample with n individuals, respectively, and
be a p-dimensional vector of covariates which assumed to be time-independent throughout this paper for the i-th individual. Assume that
and
are conditionally independent given
. In practice, the failure time
might not always be observed due to censoring because of the termination of study or early withdrawal from the study. What we can actually observe are
, the smaller of the failure time and the censoring time, and
, the indicator that failure has been observed. The data then consist of the triplets
. Suppose there is no tie among failure times. Let
denote the N ordered times of observed failures and (j) be the label of the individual that fails at
. Let
be the risk set at time
, i.e.
. The partial likelihood of the model (1) is defined as
(2)
and the log partial likelihood is then,
(3)
The maximum partial likelihood estimate of
,
, is found by solving the score equation
, where
(4)
2.2. Adaptive Shrinkage Estimate
Let
be a non-random function of n such that for some
and
,
and
, as
. In this paper, we need the following assumptions:
(A1)
satisfies
, and the residual term
has
for some
, where
is some cumulative baseline function.
(A2)
, where
is the information matrix of
and
is a positive matrix.
Then, Theorem 3.1 in [7] implies that
almost surely as n tends to
for some
. Define
with
being the j-th components of
. From (16) and asymptotic property of
we have
almost surely as
. Where
denotes the indicator function and we presume that
. Similar to Wang and Chang, define
as an adaptive shrinkage estimate (ASE) of
, where
is a
diagonal matrix. So far, we get good statistical properties of the proposed ASE estimate under non-random sample size, but our goal is to determine a sample size under which the ASE attains the required accuracy. To this end, we will introduce the sequential sampling scheme based on the ASE below. It is known that construction of the confidence set for
depends on the asymptotic distribution of
and sample size under sequential analysis is a random variable. So we need to study asymptotic properties of ASE under random sample size. Fortunately, property of uniform continuity in probability, see in [8] and [9], is a sufficient condition such that the randomly stopped sequence has the same asymptotic distribution as the fixed sample size estimate. That is,
, has the property of uniform continuity in probability, which indicates the following Theorem holds.
Theorem 1. Suppose that the (A1) and (A2) are satisfied, and let
be a positive integer-valued random variable such that
converges to 1 in probability as
. Then
in distribution as
.
From Theorem 1, we can construct a confidence set of
and a stopping rule on sequential sampling procedure to determine final sample size. Let
be the first k observations and denoted by
. Define a stopping rule
as
(5)
For sequential estimation procedure, one new observation is collected at a time until the stopping criterion is satisfied. When the stopping rule holds, based on N samples a confidence set of
is constructed as follow,
(6)
where
. Properties of the sequential procedure and the confidence set
are summarized below.
Theorem 2. Assume that the (A1) and (A2) are satisfied, and let N be the
stopping time defined in Equation (5). Then 1)
almost surely; 2)
; 3)
; 4)
almost surely; 5)
where
is the maximum eigen-value of matrix
.
3. Example and Simulation
We evaluate the performance of the proposed method via sequential fixed size confidence estimation using synthesized data sets. As mentioned previously, by the definition of the stopping rule, when sampling is stopped, the final confidence ellipsoid constructed will have the prescribed precision and coverage probability. Thus, we can compare the average stopping times of procedures based on MPLE and ASE. Since the proposed method ignores the non-effective variables, we expect the average stopping time to be significantly smaller than that of the procedure based on MPLE with no variable identification mechanism. If the
variables are known in advance, then the most efficient procedureis, of course, to use only these
variables. Therefore, we also construct a sequential procedure under such a situation, and the results of the cases with known
can serve as the baseline, in which the smallest sample size is achieved, asymptotically.
The synthesized data sets for the model with fixed designs are generated as follows: the regressor
are generated independently from a standard multivariate normal distribution with mean 0 and identity covariance matrix beforehand, and the error term
is independently drawn from the standard normal distribution for each
. The system error is assumed to follow the standard normal distribution. The response generated by model (1) with the arbitrary
without loss of the generality and the true parameter
with 8 non-effective variables. Different precisions of confidence ellipsoid
are chosed with coverage probability equal to 95%
in the simulation. We choose
,
and
in analyzing simulated data. When applying the ASE method, the regularization parameter
needs to be determined by some model selection criteria, as the AIC, BIC together with a GCV method. For convenience, we only use BIC to illustrate our method,
,
where df is the number of the non-zero components in
.
Table 1 state results of sequential sampling method for COX regression. In the table, we list final sample size N (stopping time),
and empirical coverage probability CP of the 95% confidence set
. For all of the three cases: MPLE,
, ASE, the value
of is very close to 1, and the empirical coverage probability CP approaches the Normal 95% as d decreases, as stated in Theorem 2. However, the sample size N of MPLE are much larger than those of the other two cases, and ASE has sample size very close to those of
. In conclusion, the proposed ASE is more efficient than MPLE.
Table 2 reports powers of identity effective variables and effective variables and estimates of the regression coefficients for COX regression. We can see that numbers of incorrectly identified zero variables (
) using ASE is almost close to 0, and the number of correctly identified zero variables (
) are all very close to the true number of effective variables (2 and 8). These results suggest that
is a good estimator of
under the sequential sampling method based on ASE. The MPLE procedure does not identify the effective variables, so
and
are not available. In addition, all of parameter estimates of effective variables are very close to the true values.
Table 1. Results of sequential sampling method based on ASE, MPLE with all variables and
with only
non-zero variables for COX regression model.
;
is the empirical coverage probability of 95% confidence ellipsoid region
; **Empirical standard deviations are in parentheses.
Table 2. Power of variable identification and estimation of nonzero components under sequential sampling method based on ASE and MPLE with COX regression model.
and
are the average number of zero components in
correctly identified and nonzero components incorrectly estimated as zero values, respectively.
4. Conclusion
Based on an ASE estimate of the parameter in COX regression model, a sequential sampling procedure is constructed to estimate the minimum sample size to identify the effective variables and simultaneously make estimate of parameters with required accuracy. We prove that the proposed sequential procedure is asymptotically optimal in the sense of Chow and Robbins [10]. Simulation studies show that the proposed method can save a large sample size compared to the traditional sequential sampling method. However, this paper supposes the dimension of variables is fixed, not varying as sample size. Our future work is to investigate the properties of sequential sampling method with varying number of variables as sample size.
Supported
This research was supported by Research projects of universities in Xinjiang Uygur Autonomous Region under Grant No. XJEDU2016I033 and Xinjiang Normal University postdoctoral research foundation under Grant No. XJNUBS1539.