Analyst forecast accuracy during COVID-19: does prior epidemic experience matter?
Bibliographic record
Abstract
Purpose The authors examine the role of analysts’ prior experience of forecasting for firms exposed to epidemics on analysts’ forecast accuracy during the COVID-19 pandemic. Design/methodology/approach The authors examine the impact of analysts’ prior epidemic experience on forecast accuracy by comparing the changes from the pre-COVID-19 period (calendar year 2019) to the post-COVID period extending up to March 2023 across HRE versus non-HRE analysts. The authors consider a full sample (194,980) and a sub-sample (136,836) approach to distinguish “Recent” forecasts from “All” forecasts (including revisions). Findings The study's findings reveal that forecast accuracy for HRE analysts is significantly higher than that for non-HRE analysts during COVID-19. Specifically, forecast errors significantly decrease by 0.6% and 0.15% for the “Recent” and “All” forecast samples, respectively. This finding suggests that analysts’ prior epidemic experience leads to an enhanced ability to assess the uncertainty around the epidemic, thereby translating to higher forecast accuracy. Research limitations/implications The finding that the expertise developed through an experience of following high-risk firms in the past enhances analysts’ performance during the pandemic sheds light on a key differentiator that partially explains the systematic difference in performance across analysts. The authors also show that industry experience alone is not useful in improving forecast accuracy during a pandemic – prior experience of tracking firms during epidemics adds incremental accuracy to analysts’ forecasts during pandemics such as COVID-19. Practical implications The study findings should prompt macroeconomic policymakers at the national level, such as the central banks of countries, to include past epidemic experiences as a key determinant when forecasting the economic outlook and making policy-related decisions. Moreover, practitioners and advisory firms can improve the earning prediction models by placing more weight on pandemic-adjusted forecasts made by analysts with past epidemic experience. Originality/value The uncertainty induced by the COVID-19 pandemic increases uncertainty in global financial markets. Under such circumstances, the importance of analysts’ role as information intermediaries gains even more importance. This raises the question of what determines analysts’ forecast accuracy during the COVID-19 pandemic. Building upon prior literature on the role of analyst experience in shaping analysts’ forecasts, the authors examine whether experience in tracking firms exposed to prior epidemics allows analysts to forecast more accurately during COVID-19. The authors find that analysts who have experience in forecasting for firms with high exposure to epidemics (H1N1, Zika, Ebola, and SARS) exhibit higher accuracy than analysts who lack such experience. Further, this effect of experience on forecast accuracy is more pronounced while forecasting for firms with higher exposure to the risk of COVID-19 and for firms with a poor ex-ante informational environment.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.005 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".