Autoregressive processes: going from the particular to the general is the safest option. Simple observations are the foundation of any theory.
Intuition
Figure 1. Electricity load in France and Great Britain for 2001 to 2006
If you have only one variable, what can you regress it on? Only on its own past values (future values are not available at any given moment). Figure 1 on electricity demand from a paper by J.W. Taylor illustrates this. A low value of electricity demand, say, in summer last year, will drive down its value in summer this year. Overall, we would expect the electricity demand now to depend on its values in the past 12 months. Another important observation from this example is that probably this time series is stationary.
AR(p) model
We want a definition of a class of stationary models. From this example we see that excluding the time trend increases chances of obtaining a stationary process. The idea to regress the process on its own past values is realized in
(1)
Here is some positive integer. However, both this example and the one about random walk show that some condition on the coefficients
will be required for (1) to be stationary. (1) is called an autoregressive process of order
and denoted AR(p).
Exercise 1. Repeat calculations on AR(1) process to see that in case for (1) the stability condition
is sufficient for stationarity (that is, the coefficient
has no impact on stationarity).
Question. How does this stability condition generalize to AR(p)?
Characteristic polynomial
Denote the lag operator defined by
. More generally, its powers are defined by
. Then (1) can be rewritten as
Whoever first did this wanted to solve the equation for . Sending all terms containing
to the left we have
The identity operator is defined by , so
. Factoring out
we get
(2)
Finally, formally solving for we have
(3)
Definition 1. In replace the identity by 1 and powers of the lag operator by powers of a real number
to obtain the definition of the characteristic polynomial:
(3) .
is a polynomial of degree
and by the fundamental theorem of algebra has
roots.
Definition 2. We say that model (1) is stable if its characteristic polynomial (3) has roots outside the unit circle, that is, the roots are larger than 1 in absolute value.
Under this stability condition the passage from (2) to (3) can be justified. For AR(1) process this actually has been done.
Example 1. In case of a first-order process, has one root
which lies outside the unit circle exactly when
Example 2. In case of a second-order process, has two roots. If both of them are larger than 1 in absolute value, then the process is stable. The formula for the roots of a quadratic equation is well-known but stating it here wouldn't add much to what we know. Most statistical packages, including Stata, have procedures for checking stability.
Remark. Hamilton uses a different definition of the characteristic polynomial (linked to vector autoregressions), that's why in his definition the roots of the characteristic equation should lie inside the unit circle.
Leave a Reply
You must be logged in to post a comment.