Statistics & Regression

Lesson 9 of 9

Time Series: AR(1) and Stationarity

Autocorrelation, the AR(1) model and its mean, variance and half-life, what stationarity means, why a unit root breaks ordinary inference, and how serial correlation shrinks your effective sample size.

Does yesterday predict today?

Most of this track has assumed independent observations. Prices, spreads, rates and volatility are ordered in time, and today's value usually carries information about tomorrow's. The first tool for measuring that is autocorrelation.

For a series XtX_t with constant mean μ\mu, the autocovariance at lag kk is γk=Cov(Xt,Xt−k)\gamma_k = \text{Cov}(X_t, X_{t-k}), and the autocorrelation function (ACF) is

ρk=γkγ0\rho_k = \frac{\gamma_k}{\gamma_0}

so ρ0=1\rho_0 = 1 and ρk\rho_k is the correlation between the series and a copy of itself shifted kk steps. The sample version replaces γk\gamma_k with 1n∑t(xt−xˉ)(xt−k−xˉ)\frac{1}{n}\sum_t (x_t - \bar x)(x_{t-k} - \bar x).

How big does a sample autocorrelation have to be before you care? If the series is really white noise (independent, constant variance), each ρ^k\hat\rho_k is roughly N(0,1/n)N(0, 1/n). The usual band is ±2/n\pm 2/\sqrt{n}. With 400 daily returns the band is ±0.1\pm 0.1, so a lag-1 autocorrelation of 0.080.08 is consistent with no predictability at all.

Daily stock returns typically sit inside that band at every lag. Their squares do not: rt2r_t^2 shows positive autocorrelation that decays slowly over weeks and months. Returns can be close to uncorrelated while volatility is highly predictable, which is why "returns are unpredictable" and "volatility clusters" are both true.