Moving average processes: this time the intuition is mathematical and even geometric.
Review and generalize
Science is a vertical structure, as I say in my book, and we have long past the point after which looking back is as important as looking forward. So here are a couple of questions for the reader to review the past material.
Q1. What is a stochastic process? (Answer: imagine a real line with a random variable attached to each integer point.)
Q3. White noise is a simplest (after a constant) type of a stationary process. Give the definition, and don't hope for a hint. Do you realize that the elements of white noise don't interact with one another in the sense that covariance between each two of them is zero?
Idea. Define a class of stationary processes by forming linear combinations of elements of white noise.
Q4. A simple realization of this idea is given here. How do you generalize it?
Answer. The process
where is white noise, is called a moving average process of order and denoted MA(q).
Remarks. 1) The "moving average" name may be misleading. In Finance we use that name when the coefficients sum to one and are positive. Here the thetas do not necessarily sum to one and may change sign.
2) It would be better to say a "moving linear combination". The coefficients of the linear combination do not change but are applied to a moving segment of the white noise, starting from the element dated and going back to the element dated . In this sense we say that (1) involves the segment .
3) In Economics and Finance, the errors are treated as shocks. (1) tells us that the process is a result of the current shock and previous shocks.
Moving average properties
First stationarity condition. , should be absolutely obvious by now.
Second stationarity condition. Variance does not depend on time:
because only products have nonzero expectations.
Third stationarity condition. Here is where geometry is useful. If one linear combination involves the segment and the other - the segment , then under what condition these segments do not overlap? Answer: if the distance between the points is larger than . In this case the linear combinations do not have common elements and is zero.
Exercise. (I leave you the tedious part). Calculate for .
Conclusion. MA(q) is stationary, for any thetas.