Template-Type: ReDIF-Paper 1.0
Series: Tinbergen Institute Discussion Papers
Creation-Date: 2019-08-19
Number: 19-058/III
Author-Name: Sander Barendse
Author-Workplace-Name: University of Oxford
Author-Name: Erik Kole
Author-Workplace-Name: Erasmus University Rotterdam
Author-Name: Dick van Dijk
Author-Workplace-Name: Erasmus University Rotterdam
Title: Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error
Abstract: We investigate the effect of estimation error on backtests of (multi-period) expected shortfall (ES) forecasts. These backtests are based on first order conditions of a recently introduced family of jointly consistent loss functions for Value-at-Risk (VaR) and ES. We provide explicit expressions for the additional terms in the asymptotic covariance matrix that result from estimation error, and propose robust tests that account for it. Monte Carlo experiments show that the tests that ignore these terms suffer from size distortions, which are more pronounced for higher ratios of out-of-sample to in-sample observations. Robust versions of the backtests perform well, although this also depends on the choice of conditioning variables.  In an application to VaR and ES forecasts for daily FTSE 100 index returns as generated by AR-GARCH, AR-GJR-GARCH, and AR-HEAVY models, we find that estimation error substantially impacts the outcome of the backtests.
Classification-JEL: C12, C53, C58, G17
Keywords: expected shortfall, backtesting, risk management, tail risk, Value-at-Risk
File-URL: https://papers.tinbergen.nl/19058.pdf
File-Format: application/pdf
File-Size: 721157 bytes
Handle: RePEc:tin:wpaper:2019058