Model Risk Management – The Quest for a Unifying Approach by Andrew Smith
Modern financial businesses rely on thousands of models to support decision-making from pricing and reserving through risk and capital to management bonuses and shareholder decisions. These models sometimes fail. Forecasts prove to be inaccurate, or decisions supported by models may turn out to be unwise.
What can we do about this? We cannot eliminate the possibility that the future turns out differently to a model prediction. However, we can ensure that assurance we give on models is both truthful and statistically meaningful. We can reverse stress-test models by feeding them awkward simulated data until they break down. We can choose between harsh validation tests that reveal model weaknesses, or we can apply powerless validation methods where a green light is a foregone conclusion. We can foster a culture where people who become aware of model shortcomings are heard rather than silenced.
This 8-part ASTIN Masterclass uses a series of examples to highlight quantitative approaches to model risk management, using examples related to underwriting risk, stochastic reserving and the modelling of asset price changes. Andrew offers tips for actuaries pressured into expressing undeserved confidence in risky models, together with tips better to support decision making in the context of uncertainty.
Episodes:
- Introduction: Uses of Models and Where Models Go Wrong (16 mins) - Open access
- How to Control Model Risk (13 mins) - Open access
- Application: Underwriting Risk Models (28 mins)
- Application: Reserving Risk (24 mins)
- Ersatz Model Tests (23 mins)
- Forecasting Financial Markets (40 mins)
- Professionalism Issues Related to Model Uncertainty (17 mins)
- Conclusion (12 mins)

About the Lecturer:
Andrew Smith is an assistant professor in the School of Mathematics and Statistics at University College Dublin and an Honorary Fellow of the Institute of Actuaries. Before he moved to Ireland in 2017, he gained 30 years of insurance experience, specializing in stochastic modelling, including fifteen years as a partner in a major consulting firm.

