Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections
Title | Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections PDF eBook |
Author | Klaus-Peter Hellwig |
Publisher | International Monetary Fund |
Pages | 43 |
Release | 2018-12-07 |
Genre | Business & Economics |
ISBN | 148438959X |
I regress real GDP growth rates on the IMF’s growth forecasts and find that IMF forecasts behave similarly to those generated by overfitted models, placing too much weight on observable predictors and underestimating the forces of mean reversion. I identify several such variables that explain forecasts well but are not predictors of actual growth. I show that, at long horizons, IMF forecasts are little better than a forecasting rule that uses no information other than the historical global sample average growth rate (i.e., a constant). Given the large noise component in forecasts, particularly at longer horizons, the paper calls into question the usefulness of judgment-based medium and long-run forecasts for policy analysis, including for debt sustainability assessments, and points to statistical methods to improve forecast accuracy by taking into account the risk of overfitting.
Strategic Foresight at the International Monetary Fund
Title | Strategic Foresight at the International Monetary Fund PDF eBook |
Author | Mr. Alberto Behar |
Publisher | International Monetary Fund |
Pages | 41 |
Release | 2021-12-22 |
Genre | Business & Economics |
ISBN | 1513593862 |
This note explains the value of strategic foresight and provides implementation advice based on the IMF’s experience with scenario planning and policy gaming. Section II provides an overview of strategic foresight and some of its tools. Scenario planning and policy gaming have been the Fund’s main foresight techniques so far, though other tools have been complementary. Accordingly, section III focuses on the scenario planning by illustrating applications before detailing the methods we have been using, while section IV describes policy gaming including the matrix policy gaming approach with which we have experimented so far. Section V summarizes the key points. In so doing, the note extends an invitation to those in the economics and finance fields (e.g., researchers, policymakers) to incorporate strategic foresight in their analysis and decision making.
Predicting Fiscal Crises: A Machine Learning Approach
Title | Predicting Fiscal Crises: A Machine Learning Approach PDF eBook |
Author | Klaus-Peter Hellwig |
Publisher | International Monetary Fund |
Pages | 66 |
Release | 2021-05-27 |
Genre | Business & Economics |
ISBN | 1513573586 |
In this paper I assess the ability of econometric and machine learning techniques to predict fiscal crises out of sample. I show that the econometric approaches used in many policy applications cannot outperform a simple heuristic rule of thumb. Machine learning techniques (elastic net, random forest, gradient boosted trees) deliver significant improvements in accuracy. Performance of machine learning techniques improves further, particularly for developing countries, when I expand the set of potential predictors and make use of algorithmic selection techniques instead of relying on a small set of variables deemed important by the literature. There is considerable agreement across learning algorithms in the set of selected predictors: Results confirm the importance of external sector stock and flow variables found in the literature but also point to demographics and the quality of governance as important predictors of fiscal crises. Fiscal variables appear to have less predictive value, and public debt matters only to the extent that it is owed to external creditors.
Lasso Regressions and Forecasting Models in Applied Stress Testing
Title | Lasso Regressions and Forecasting Models in Applied Stress Testing PDF eBook |
Author | Mr.Jorge A. Chan-Lau |
Publisher | International Monetary Fund |
Pages | 34 |
Release | 2017-05-05 |
Genre | Business & Economics |
ISBN | 1475599021 |
Model selection and forecasting in stress tests can be facilitated using machine learning techniques. These techniques have proved robust in other fields for dealing with the curse of dimensionality, a situation often encountered in applied stress testing. Lasso regressions, in particular, are well suited for building forecasting models when the number of potential covariates is large, and the number of observations is small or roughly equal to the number of covariates. This paper presents a conceptual overview of lasso regressions, explains how they fit in applied stress tests, describes its advantages over other model selection methods, and illustrates their application by constructing forecasting models of sectoral probabilities of default in an advanced emerging market economy.
On the Macroeconomic Consequences of Over-Optimism
Title | On the Macroeconomic Consequences of Over-Optimism PDF eBook |
Author | Paul Beaudry |
Publisher | International Monetary Fund |
Pages | 43 |
Release | 2018-05-30 |
Genre | Business & Economics |
ISBN | 1484354885 |
Is over-optimism about a country's future growth perspective good for an economy, or does over-optimism also come with costs? In this paper we provide evidence that recessions, fiscal problems, as well as Balance of Payment-difficulties are more likely to arise in countries where past growth expectations have been overly optimistic. To examine this question, we look at the medium-run effects of instances of over-optimism or caution in IMF forecasts. To isolate the causal effect of over-optimism we take an instrumental variables approach, where we exploit variation provided by the allocation of IMF Mission Chiefs across countries. As a necessary first step, we document that IMF Mission Chiefs tend to systematically differ in their individual degrees of forecast-optimism or caution. The mechanism that transforms over-optimism into a later recession seems to run through higher debt accumulation, both public and private. Our findings illustrate the potency of unjustified optimism and underline the importance of basing economic forecasts upon realistic medium-term prospects.
Powering the Digital Economy: Opportunities and Risks of Artificial Intelligence in Finance
Title | Powering the Digital Economy: Opportunities and Risks of Artificial Intelligence in Finance PDF eBook |
Author | El Bachir Boukherouaa |
Publisher | International Monetary Fund |
Pages | 35 |
Release | 2021-10-22 |
Genre | Business & Economics |
ISBN | 1589063953 |
This paper discusses the impact of the rapid adoption of artificial intelligence (AI) and machine learning (ML) in the financial sector. It highlights the benefits these technologies bring in terms of financial deepening and efficiency, while raising concerns about its potential in widening the digital divide between advanced and developing economies. The paper advances the discussion on the impact of this technology by distilling and categorizing the unique risks that it could pose to the integrity and stability of the financial system, policy challenges, and potential regulatory approaches. The evolving nature of this technology and its application in finance means that the full extent of its strengths and weaknesses is yet to be fully understood. Given the risk of unexpected pitfalls, countries will need to strengthen prudential oversight.
Global Financial Stability Report, October 2017
Title | Global Financial Stability Report, October 2017 PDF eBook |
Author | International Monetary Fund. Monetary and Financial Systems Dept. |
Publisher | International Monetary Fund |
Pages | 139 |
Release | 2017-10-11 |
Genre | Business & Economics |
ISBN | 1484308395 |
The October 2017 Global Financial Stability Report finds that the global financial system continues to strengthen in response to extraordinary policy support, regulatory enhancements, and the cyclical upturn in growth. It also includes a chapter that examines the short- and medium-term implications for economic growth and financial stability of the past decades’ rise in household debt. It documents large differences in household debt-to-GDP ratios across countries but a common increasing trajectory that was moderated but not reversed by the global financial crisis. Another chapter develops a new macroeconomic measure of financial stability by linking financial conditions to the probability distribution of future GDP growth and applies it to a set of 20 major advanced and emerging market economies. The chapter shows that changes in financial conditions shift the whole distribution of future GDP growth.