Problem bank
Problem 236 of 333MediumStatisticsP236
Training error is optimistic
Let with a fixed matrix of full column rank and having mean zero and covariance . Fit OLS, .
(a) Show .
(b) Let be fresh data at the same inputs, with independent of and distributed the same way. Show .
(c) With daily observations and predictors, by what factor does average training MSE understate average test MSE?
See the hint and solution with a free account
Every problem on Quant Engine is free, with a hint and a full worked solution. Making an account takes 30 seconds and no card. Then you can see them and track what you have solved.