Statistical and Machine Learning forecasting methods: Concerns and ways forward

Summary

Machine Learning (ML) methods have been proposed in the academic literature as alternatives to statistical ones for time series forecasting. Yet, scant evidence is available about their relative performance in terms of accuracy and computational requirements. The purpose of this paper is to evaluate such performance across multiple forecasting horizons using a large subset of 1045 monthly time series used in the M3 Competition. After comparing the post-sample accuracy of popular ML methods with that of eight traditional statistical ones, we found that the former are dominated across both accuracy measures used and for all forecasting horizons examined. Moreover, we observed that their computational requirements are considerably greater than those of statistical methods. The paper discusses the results, explains why the accuracy of ML models is below that of statistical ones and proposes some possible ways forward. The empirical results found in our research stress the need for objective and unbiased ways to test the performance of forecasting methods that can be achieved through sizable and open competitions allowing meaningful comparisons and definite conclusions.

Related articles

• HCI area - Quantitative and Qualitative Modeling and Evaluation

  This document explores the interconnected roles of quantitative and qualitative modeling and evaluation in Human-Computer Interaction (HCI) research. It discusses various modeling techniques and their applications in evaluating computer interfaces and user interactions.

• BCA SEM 2 (Data Structures) Unit V: Graphs and Traversal Algorithms

  This document serves as a comprehensive guide to graphs in data structures, explaining key concepts such as graph representation, types of graphs, and traversal algorithms like BFS and DFS.

• Group Decision Support Systems and Executive Support Systems

  This document presents an overview of Group Decision Support Systems (GDSS) and Executive Support Systems (ESS), detailing their functions, benefits, limitations, and characteristics to aid in collective decision-making processes in business contexts.

• Information Management and Decision Making

  This document provides an overview of Decision Support Systems (DSS), discussing their components, types, and the importance of information management in decision-making processes for business executives.

• Electronic Communication Systems

  The document provides an overview of electronic communication systems, discussing various types such as electronic conferencing, meeting systems, and publishing, while also addressing benefits and risks associated with electronic publishing.