A recent literature on qualitative analysis has shown that its successful application in testing the consistency of the sign patterns of a proposed structure and an estimated reduced form was far less restricted than a previous literature had proposed. A frequent example used in this demonstration was the qualitative analysis of Klein’s Model I. For this, the proposed structural sign pattern was falsified by the sign pattern of the estimated reduced form. As a result, the subsequent application two-stage least squares would always find quantifications of the structure that could not possibly have resulted in the sign pattern of the estimated reduced form. We view this result as a diagnostic calling for further analysis. We show that the Klein model fails standard over identification tests. We make modest amendments to the model that resolves this problem but find that the resulting estimated reduced form still falsifies the structure, calling for further developmental effort. Our point is that qualitative falsification should be viewed as a diagnostic in developing a model, rather than a criterion for entirely dismissing the model.
The issue of the scientific nature of economic theory is surprisingly undeveloped; or, at least, not fully formulated. To set up the issues at stake, we will follow Samuelson [
f i ( Y , Z ) = 0 , i = 1 , 2 , ⋯ , n , (1)
where Y is an n-vector of endogenous variables and Z is an m-vector of exogenous variables. This system is brought to the data by the method of comparative statics, as expressed by the total differentiation of the system (1),
∑ j = 1 n ∂ f i ∂ y j d y j + ∑ k = 1 m ∂ f i ∂ z k d z k = 0 , i = 1 , 2 , ⋯ , n . (2)
For purposes of estimation, it is usual to assume that (1) is (at least locally) linear, so that (2) can be more compactly expressed as,
β Y = γ Z + δ U , (3)
where β, γ and δ are appropriately dimensioned matrices, with δU representing errors embodied in the data. The system (3) is termed the structural form of the model. Estimation then proceeds with respect to the reduced form,
Y = π Z + ψ U , (4)
where in (4) π = β − 1 γ . The arrays β and γ are then recovered from the estimated π using some version of multi-stage least squares. Depending upon issues of identification, there may be more than one way to do this for an over-identified system and no way to do this for an under-identified system.
For the theory to be “scientific”, the expression of the structure (3) must take a form such that the outcomes for the estimate of π are in some way limited. If the outcome of the estimation is not consistent with such limit(s), then the model has been falsified, i.e., Popper [
So far, the issues at stake seem straight-forward. Nevertheless, problems arise in terms of what it is about a proposed structure that is hypothesized by the theory; and, given this, just what limits does the hypothesis create for the estimated reduced form? Before providing his answers to these questions, Samuelson ( [
Having said all of this, Samuelson goes on to propose that the “likelihood” of finding that all of the (potentially millions) of terms in the expansions of β’s determinant and (at least some) cofactors would all have the same sign was too small to be taken seriously. Hence, a qualitative analysis of a model’s structure would virtually never yield entries in the reduced form that had to have particularly signs and hence (potentially) lead to the falsification of the structural hypothesis. Instead, Samuelson proposed that for β derived from the second order conditions of a (possibly constrained) optimization problem, the first n entries of β−1’s main diagonal would have to be negative and, for β a stable matrix with non-negative off-diagonal and negative main diagonal entries, β−1 would have all negative entries, e.g., Hale, et al. ( [
A recent literature, Buck and Lady [
Buck and Lady [
β = [ ? 0 0 ? ? ? 0 0 0 ? ? 0 0 0 ? ? ] .
In the above array, the entries marked “?” are nonzero, but may otherwise be of any sign and magnitude. The zero restrictions selected present an irreducible inference structure with only one cycle of inference. The Monte Carlo sampling and derivation of the reduced form for β−1 = π, found only 256 sign patterns out of the possible 65,536 sign patterns that a 4 × 4 array could take on, barring zeros. This result is due to the zero restrictions only and is independent of the nonzero signs and magnitudes of the other entries. Suppose a multistage least squares process were applied to this structure to estimate the nonzero entries. If any but the 256 reduced form sign patterns consistent with the structure were then found in the estimated reduced form, the resulting estimates of the nonzeros in the structure would be impossible, i.e., could not possibly generate a reduced form with the sign pattern found in the estimated reduced form. Consequently, any estimates of the structural nonzeros would be incorrect, since the zero restrictions themselves have been falsified.
One of the examples of falsification due to zero and other restrictions given in Buck and Lady [
In this paper we re-specify the original Klein Model I slightly, but enough to cause it to pass the overidentification tests and re-examine the resulting sign pattern on the theory that the model generated an impossible sign pattern because it was not properly identified in the first place. In the next section Klein’s Model I is briefly reiterated. In Section III, we test the original model’s identification strategy and suggest a slightly modified version that at least passes the usual overidentification tests. Nevertheless, we found that the zero and other restrictions on the structural arrays were again falsified by the sign pattern of the reduced form estimated for this case. Therefore, we suggest that the Monte Carlo sign pattern test presented in Buck and Lady (2016) is a complement to rather than a substitute for standard overidentification tests. Unlike Buck and Lady (2016), in the Appendix we go on to find the particular feature of the reduced form sign pattern that falsify the structural arrays and write out the expansions of the corresponding cofactors of Klein’s coefficient matrix that confirm this result. Conclusions are provided in Section 4.
With the error vector not included, the structural arrays for Klein’s Model I are given below, β Y = γ Z , where
[ − 1 0 a 1 0 a 2 0 0 0 − 1 0 0 b 1 0 0 0 0 − 1 0 0 0 c 1 1 1 0 − 1 0 0 0 0 0 0 1 − 1 − 1 0 0 0 1 0 0 − 1 0 0 0 0 1 0 0 − 1 ] [ C I W 1 Y P W E ] = [ − a 1 − a 3 0 0 0 0 0 0 − b 2 − b 3 0 0 0 0 0 0 0 − c 2 − c 3 0 0 0 0 0 0 0 1 − 1 0 0 0 0 0 0 0 − 1 0 0 0 0 0 0 1 0 0 0 0 − 1 0 ] [ W 2 P − 1 K − 1 E − 1 Y e a r T X G ]
In this structure the endogenous variables are: private consumption (C), investment (I), the private wage bill (W1), income (Y), profits or nonwage income (P), the sum of private and government wages (W), and private product (E); the exogenous variables are the government wage bill (W2), lagged profits (P−1), end of last period capital stock (K−1), lagged private product (E−1), years since 1931 (Year), taxes (TX), and government consumption (G). The entries notated ai, bj and ck are nine in number and represent the behavioral entries of the model that (ultimately) would be estimated via multi-stage least squares. The remaining entries in the structure are restrictions. The sign patterns proposed by Klein for the structural arrays are given by,
sgn β = [ − 0 + 0 + 0 0 0 − 0 0 + 0 0 0 0 − 0 0 0 + + + 0 − 0 0 0 0 0 0 + − − 0 0 0 + 0 0 − 0 0 0 0 + 0 0 − ] and sgn γ = [ − − 0 0 0 0 0 0 − + 0 0 0 0 0 0 0 − − 0 0 0 0 0 0 0 + − 0 0 0 0 0 0 0 − 0 0 0 0 0 0 + 0 0 0 0 − 0 ] .
An estimate of the reduced form for this model was provided by Goldberger [
Estimated sgn π ^ = [ − + − + + − + − + − − + − + − + − + + − + − + − + + − + − + − + + − + − + − + + − + − + − + + − + ] .
Significantly, Berndt [
sgn β = [ − 0 ? 0 ? 0 0 0 − 0 0 ? 0 0 0 0 − 0 0 0 ? + + 0 − 0 0 0 0 0 0 + − − 0 0 0 + 0 0 − 0 0 0 0 + 0 0 − ] and sgn γ = [ ? ? 0 0 0 0 0 0 ? ? 0 0 0 0 0 0 0 ? ? 0 0 0 0 0 0 0 + − 0 0 0 0 0 0 0 − 0 0 0 0 0 0 + 0 0 0 0 − 0 ] ,
there did not exist nonzero signs and magnitudes that could be given to the structural entries marked “?” in the above that would result in the sign pattern of the estimated reduced form. As a result, all of the estimates given in Berndt [
Thus, Klein Model I generates a sign pattern that is impossible given the sign pattern of the reduced form equations. However, could this sign pattern be a feature of the way in which the model is specified? If the model is not properly identified, then it is not a proper reduction from the reduced form. See Hendry ( [
The Klein Model I is specified, for estimation purposes as follows (Goldberger 1964, 303-304). The variables are defined above.
Klein Model I
1) C = a 0 + a 1 P + a 2 P − 1 + a 3 ( W 1 + W 2 ) + u 1
2) I = b 0 + b 1 P + b 2 P − 1 + b 3 K − 1 + u 2
3) W 1 = c 0 + c 1 E + c 2 E − 1 + c 3 Y e a r + u 3
4) Y = C + I + G − T X
5) P = Y − W
6) W = W 1 + W 2
7) E = Y − W 2 + T X
Estimating the three behavioral equations using two-stage least squares yields the results shown in
As noted above, this model has been shown to be impossible given the reduced form equations. One problem with the model, an issue that might be responsible for this unfortunate result, is that this model is not properly specified. The Sargan [
A bit of experimentation yields the following alternative model, which we call the Klein-Lady-Moody model (KLM). There are only two small changes in behavioral Equation (2) and Equation (3). In the investment Equation (2’) we have added lagged wages, on the theory that, for example, a rise in wages in the previous year could impinge on investment in the current year. In the private sector wage bill equation we have added taxes, which could reduce employment and/or wages in that sector.
KLM model
1) C = a 0 + a 1 P + a 2 P − 1 + a 3 ( W 1 + W 2 ) + u 1
2’) I = b 0 + b 1 P + b 2 P − 1 + b 3 K − 1 + b 4 W − 1 + u 2
3’) W 1 = c 0 + c 1 E + c 2 E − 1 + c 3 Y e a r + c 4 T X + u 3
4) Y = C + I + G − T X
5) P = Y − W
6) W = W 1 + W 2
7) E = Y − W 2 + T X
Using the above notation, the amended model is expressed by,
[ − 1 0 a 3 0 a 1 0 0 0 − 1 0 0 b 1 0 0 0 0 − 1 0 0 0 c 1 1 1 0 − 1 0 0 0 0 0 0 1 − 1 − 1 0 0 0 1 0 0 − 1 0 0 0 0 1 0 0 − 1 ] [ C I W 1 Y P W E ] = [ − a 3 − a 2 0 0 0 0 0 0 0 − b 2 − b 3 0 0 0 0 − b 4 0 0 0 − c 2 − c 3 − c 4 0 0 0 0 0 0 0 1 − 1 0 0 0 0 0 0 0 0 0 − 1 0 0 0 0 0 0 0 1 0 0 0 0 − 1 0 0 ] [ W 2 P − 1 K − 1 E − 1 Y e a r T X G W − 1 ]
In writing out the expansions of the entries of π referred to in falsifying the KLM version of the model given in the Appendix, the above notation is used.
The resulting estimated KLM behavioral equations are presented in
Variable | Consumption | Investment | Private Wages |
---|---|---|---|
W | 0.800 | ||
(12.39)** | |||
P | 0.047 | 0.153 | |
(0.36) | (0.90) | ||
P−1 | 0.178 | 0.613 | 0.322 |
(1.10) | (3.83)** | (1.89) | |
---|---|---|---|
E−1 | 0.014 | 0.083 | |
(0.20) | (1.30) | ||
K−1 | −0.157 | ||
(4.40)** | |||
E | 0.330 | ||
(5.30)** | |||
Year | 0.303 | ||
(4.41)** | |||
_cons | 16.250 | 20.181 | −579.702 |
(9.20)** | (2.71)** | (4.43)** | |
R2 | 0.98 | 0.89 | 0.97 |
N | 21 | 21 | 21 |
Note: t-ratios in parenthesis; *p < 0.05; **p < 0.01.
Variable | Consumption | Investment | Private Wages |
---|---|---|---|
W | 0.810 | ||
(20.76)** | |||
P | 0.047 | 0.461 | |
(0.44) | (4.31)** | ||
P−1 | 0.192 | 0.455 | |
(1.94) | (4.90)** | ||
W−1 | −0.133 | ||
(2.91)** | |||
K−1 | −0.072 | ||
(2.38)* | |||
E | 0.478 | ||
(18.29)** | |||
E−1 | 0.106 | ||
(3.71)** | |||
Year | 0.330 | ||
(11.42)** | |||
TX | −0.695 | ||
(7.47)** | |||
_cons | 16.441 | 5.770 | −632.888 |
(12.93)** | (1.06) | (11.44)** | |
R2 | 0.98 | 0.95 | 0.99 |
N | 21 | 21 | 21 |
Note: t-ratios in parenthesis; *p < 0.05; **p < 0.01.
The Sargan overidentification test statistics are no longer significant: consumption (p = 0.0782), investment (p = 0.0993), private wages (p = 0.1117). Thus, whatever else might be said about this model, it appears to be a valid reduction from the reduced form. The resulting matrix representation of the KLM model is as follows.
[ − 1 0 0.810 0 0.047 0 0 0 − 1 0 0 0.461 0 0 0 0 − 1 0 0 0 0.478 1 1 0 − 1 0 0 0 0 0 0 1 − 1 − 1 0 0 0 1 0 0 − 1 0 0 0 0 1 0 0 − 1 ] [ C I W 1 Y P W E ] = [ − 0.810 − 0.192 0 0 0 0 0 0 0 − 0.455 0.072 0 0 0 0 0.113 0 0 0 − 0.106 − 0.330 0.695 0 0 0 0 0 0 0 1 − 1 0 0 0 0 0 0 0 0 0 − 1 0 0 0 0 0 0 0 1 0 0 0 0 − 1 0 0 ] [ W 2 P − 1 K − 1 E − 1 Y e a r T X G W − 1 ]
sgn β = [ − 0 + 0 + 0 0 0 − 0 0 + 0 0 0 0 − 0 0 0 + + + 0 − 0 0 0 0 0 0 + − − 0 0 0 + 0 0 − 0 0 0 0 + 0 0 − ] , sgn γ = [ − − 0 0 0 0 0 0 0 − + 0 0 0 0 + 0 0 0 − − + 0 0 0 0 0 0 0 + − 0 0 0 0 0 0 0 0 0 − 0 0 0 0 0 0 0 + 0 0 0 0 − 0 0 ]
Does this solve the impossibility issue? We use the same Monte Carlo methodology reported on in Buck and Lady [
The reduced form estimated for the KLM model is given below in
The Monte Carlo method takes quantitative samples of the structural arrays with the sign patterns given above, computes π = β − 1 γ , and then checks to see if the resulting sign pattern of π as computed from the sample corresponds to the sign pattern of the estimated reduced form given above. The sample is constructed as follows.
The Monte Carlo sampling procedure takes the sign patterns proposed for the arrays beta and gamma and quantifies the arrays consistent with the given sign patterns. The resulting quantifications are then used to compute pi, the reduced
W2 | P−1 | K−1 | E−1 | Year | TX | G | W−1 | |
---|---|---|---|---|---|---|---|---|
C | 1.164807 | 1.103044 | −0.0808039 | 0.3888034 | 0.7563496 | −0.2291788 | 0.208483 | −0.6608964 |
I | 0.1787256 | 1.091179 | −0.1319317 | 0.1959241 | 0.382831 | −0.0356712 | 0.1034288 | −0.7714421 |
W1 | 0.4761662 | 1.146809 | −0.0607081 | 0.3068805 | 0.7659097 | −0.4748558 | 0.8695093 | −0.6870231 |
P | 0.8673651 | 1.047414 | −0.1520275 | 0.2778469 | 0.3732713 | −0.7899943 | 0.4424027 | −0.7453154 |
Y | 1.343533 | 2.194224 | −0.2127355 | 0.5847274 | 1.139181 | −0.2648502 | 1.311912 | −1.432339 |
W | 1.476168 | 1.14681 | −0.0607081 | 0.3068805 | 0.765909 | −0.4748559 | 0.8695091 | −0.6870232 |
E | 0.3435363 | 2.194224 | −0.2127354 | 0.5847274 | 1.13918 | 0.7351493 | 1.311912 | −1.432339 |
form, the sign pattern of which is then compared to the sign pattern of the estimated reduced form. Call the sign patterns proposed for beta and gamma the text-files and the particular quantification chosen the sample-files. The steps in selecting the sample-files from the text-files are as follows.
1) The text files for β and γ are read into their corresponding sample arrays.
2) All entries in the sample-files are set equal to zero if the corresponding entries in the text-files are equal to zero, preserving the zero restrictions.
3) The value of each remaining (not set to zero) entry of the sample-files are chosen individually and randomly from the open interval (0, 100) using a uniform distribution.
4) The values in the sample-files chosen in step 2) above that correspond to negative entries in the text-files are set negative.
5) The value of γ(1, 1) in the sample file is set equal to the negative of β(1, 3) in the sample-file, a restriction of both the Klein Model I and the KLM structural form.
6) All entries other than β(1, 1) that are equal to “1” or “−1” in the structural form are set equal to the absolute value of the value with chosen for beta (1, 1) in the sample file, keeping their appropriate sign as given in the text-files.1
1This produces a sample of coefficients that are consistent with the input text files. However, the values of 1 and −1 (indicating normalization and identities) have all been changed to the random value chosen for β(1, 1). To restore these values to unit values, one could multiply all rows by abs (β (1/(1, 1)), chosen in step 2) above. This sets all entries in the sample-files that are equal to “1” or “−1” in the structural form equal to the same value, scaling all other entries in the sample files as appropriate to maintain the ratios of all entries in the sample files. However, since this is an elementary row operation it does not change the sign pattern of the reduced form achieved by using the sample-files that result by step 6). As a result, the actual sampling algorithm used does not utilize this step.
The sample-files are then used to compute the implied reduced form, the sign pattern of which is compared to the sign pattern of the estimated reduced form. Subject to the precision of the real variables utilized by the computer software being used (Visual Basic Version 6, service pack 6), the sample-files would in principle allow any possible quantification of the text-files with the given sign patterns and structural form restrictions.
This issue is entirely resolved, as shown below, by documenting why a reduced form sign pattern is not found by examination of the expansions of the arrays used in calculating entries of the reduced form.
The sign pattern of the KLM estimated reduced form was never found after investigating millions of possibilities. The software reported that the sign patterns of the sixth column and the seventh row in the estimated reduced form were never found, independent of the rest. Further analysis showed that in the sixth column, the signs of the triplet of entries: π ( 1 , 6 ) < 0 , π ( 2 , 6 ) < 0 and π ( 7 , 6 ) > 0 , were never found, independent of the rest. Also, the signs of the triplet of entries π ( 7 , 5 ) > 0 , π ( 7 , 6 ) > 0 and π ( 7 , 8 ) < 0 , where never found, independent of the rest.
The chance that the Monte Carlo sampling procedure “missed” a sample which would have led to the estimated reduced form sign pattern is vanishingly small for the large number of samples generated; however, the probability of this happening is nonzero. Accordingly, for the first triplet above we wrote out the expansions the cofactors of β times entries of γ appropriate to the computation of these entries of π = β − 1 γ . Having done this, we found that,
π ( 7 , 6 ) = π ( 1 , 6 ) + π ( 2 , 6 ) .
The derivation of this result is given in the Appendix. Further study revealed that this result could be readily derived from the system of equations. For d T X ≠ 0 , d G = d W 2 = 0 , the result found can be expressed by the condition,
d E = d C + d I .
From Equation (7),
d E = d Y + d T X ;
and from Equation (4),
d Y = d C + d I − d T X .
Substituting this into the relationship from Equation (7) yields,
d E = d C + d I .
the result derived from the expansions involved in the computation of π = β − 1 γ . Accordingly, this condition can only be satisfied if sgn π ( 7 , 6 ) equals (at least) one of ( sgn π ( 1 , 6 ) , sgn π ( 2 , 6 ) ). Thus, the signs of this triplet of entries in the estimated reduced form falsifies the model, i.e., are impossible. Further, this result is based entirely upon the accounting relationships (4) and (7) and is therefore independent of the signs and values of the behavioral coefficients. Thus, although our amendments to Klein’s original specification solved the overidentification problem, the model is nevertheless falsified and is falsified independent of the signs and values of the behavioral coefficients.
The theme of this paper is that qualitative analysis and its potential to falsify a structural form based upon its sign pattern and the sign pattern of the estimated reduced form is a tool for model development as well as model dismissal. The demonstration presented here was to react to the falsification of the original Klein Model I, as presented in Buck and Lady [
Our point is then that such a finding should prompt additional analysis in the further development of the model’s structural form and the underlying data upon which the model is based. The important point is that, among other tests, a qualitative analysis could provide a useful analytical tool to support development. The Monte Carlo technique utilized for this analysis is easily programmed into a spread sheet and can readily reveal what reduced form sign patterns (appear) possible, among other things based only upon the structural form’s restrictions. In our opinion, when these restrictions are falsified by the estimated reduced form sign pattern, further development is appropriate and initiating the second stage of two stage least squares is not.
The authors declare no conflicts of interest regarding the publication of this paper.
Lady, G.M. and Moody, C.E. (2019) Econometric Modeling and Model Falsification. Advances in Pure Mathematics, 9, 762-776. https://doi.org/10.4236/apm.2019.99036
In Section III above it was reported that the triplet of signs in the estimated reduced form of the KLM version of Klein’s model I,
π ( 1 , 6 ) < 0 , π ( 2 , 6 ) < 0 , and π ( 7 , 6 ) > 0 ,
was not found by the Monte Carlo methodology in millions of samples. The expansions of the underlying computation of these entries of the reduced form calculated as π = β − 1 γ revealed that,
π ( 1 , 6 ) + π ( 2 , 6 ) = π ( 7 , 6 ) .
As a result, the sign pattern found in the estimated reduced form was not possible, since sgn π ( 7 , 6 ) must equal (at least) one of ( sgn π ( 1 , 6 ) , sgn π ( 2 , 6 ) ) for this equality to hold. This Appendix presents the derivation of that result, using the notation for the KLM structural form given in Section 3.
The details of the computation of these three entries of the reduced form are given by,
det ( β ) π ( 1 , 6 ) = − c 4 a ( 1 , 3 ) + a ( 1 , 4 ) − a ( 1 , 7 ) ;
det ( β ) π ( 2 , 6 ) = − c 4 a ( 2 , 3 ) + a ( 2 , 4 ) − a ( 2 , 7 ) ; and,
det ( β ) π ( 7 , 6 ) = − c 4 a ( 7 , 3 ) + a ( 7 , 4 ) − a ( 7 , 7 ) ;
where the a ( i , j ) are the appropriate entries in the adjoint of β.
The expansions of the cofactors that correspond to these entries in the adjoint of β are given by:
a ( 1 , 3 ) = a 3 ( 1 − b 1 ) − a 1 ;
a ( 1 , 4 ) = a 1 + c 1 ( a 3 − a 1 ) ;
and,
a ( 1 , 7 ) = c 1 a 3 ( 1 − b 1 ) − c 1 a 1 ;
so that,
det ( β ) π ( 1 , 6 ) = c 4 a 1 − c 4 a 3 + c 4 a 3 b 1 + a 1 + c 1 a 3 b 1 .
a ( 2 , 3 ) = a 3 b 1 − b 1 ;
a ( 2 , 4 ) = b 1 − b 1 c 1 ;
and,
a ( 2 , 7 ) = c 1 b 1 a 3 − c 1 b 1 ;
so that,
det ( β ) π ( 2 , 6 ) = − c 4 a 3 b 1 + c 4 b 1 + b 1 − c 1 b 1 − c 1 b 1 a 3 + c 1 b 1 .
a ( 7 , 3 ) = a 3 − b 1 − a 1 ;
a ( 7 , 4 ) = 1 ;
and,
a ( 7 , 7 ) = 1 − a 1 − b 1 ;
so that,
det ( β ) π ( 7 , 6 ) = c 4 b 1 + c 4 a 1 − c 4 a 3 + a 1 + b 1 .
Based on these expansions, the reader can quickly verify that,
det ( β ) π ( 1 , 6 ) + det ( β ) π ( 2 , 6 ) = det ( β ) π ( 7 , 6 ) = c 4 b 1 + c 4 a 1 − c 4 a 3 + a 1 + b 1 .
Significantly, this result is independent of the signs and magnitudes of the behavioral coefficients of the KLM model.