Högskolan i Skövde

In forecasting research, the focus has largely been on decision support systems for enhancing performance, with fewer studies in learning support systems. As a remedy, Intelligent Tutoring Systems (ITSs) offer an innovative solution in that they provide one-on-one online computer-based learning support affording student modelling, adaptive pedagogical response, and performance tracking. This study provides a detailed description of the design and development of the first Forecasting Intelligent Tutoring System, aptly coined FITS, designed to assist students in developing an understanding of time series forecasting using classical time series decomposition. The system’s impact on learning is assessed through a pilot evaluation study, and its usefulness in understanding how students learn is illustrated through the exploration and statistical analysis of a small sample of student models. Practical reflections on the system’s development are also provided to better understand how such systems can facilitate and improve forecasting performance through training. 

Collections of time series formed via aggregation are prevalent in many fields. These are commonly referred to as hierarchical time series and may be constructed cross-sectionally across different variables, temporally by aggregating a single series at different frequencies, or even generalised beyond aggregation as time series that respect linear constraints. When forecasting such time series, a desirable condition is for forecasts to be coherent: to respect the constraints. The past decades have seen substantial growth in this field with the development of reconciliation methods that ensure coherent forecasts and improve forecast accuracy. This paper serves as a comprehensive review of forecast reconciliation and an entry point for researchers and practitioners dealing with hierarchical time series. The scope of the article includes perspectives on forecast reconciliation from machine learning, Bayesian statistics and probabilistic forecasting, as well as applications in economics, energy, tourism, retail demand and demography. 

This chapter elucidates liquidity forecasting within the context of technical assistance. The audience for this chapter is central bank staff with a strong quantitative background. Liquidity forecasting entails a process of estimating the near-term path of a bank’s reserves using a centralized framework. Short-term liquidity forecasts are used to calibrate the volume of central bank monetary operations to align liquidity with the announced stance of monetary policy, whether expressed as an interest rate or as a quantity. The best practice would be for the central bank to receive accurate information for counterparties that have accounts in its books, including its monetary counterparties (banks) or non-monetary counterparties, such as the government. However, the central bank may not have direct access to some counterparties (e.g., the public which demands banknotes) or the information could include significant errors. This chapter presents the statistical methods that have been used in technical assistance to forecast liquidity factors and the demand for liquidity. It also proposes solutions to select the best models, measure forecast accuracy, and reconcile forecasts. Some liquidity factors are relatively easy to forecast due to regular patterns (currency in circulation) while others require more sophisticated models, such as the government account. There is a tradeoff between the cost of implementing complex models and the accuracy gains.

Many modern statistical models are used for both insight and prediction when applied to data. When models are used for prediction one should optimise parameters through a prediction error loss function. Estimation methods based on multiple steps ahead forecast errors have been shown to lead to more robust and less biased estimates of parameters. However, a plausible explanation of why this is the case is lacking. In this paper, we provide this explanation, showing that the main benefit of these estimators is in a shrinkage effect, happening in univariate models naturally. However, this can introduce a series of limitations, due to overly aggressive shrinkage. We discuss the predictive likelihoods related to the multistep estimators and demonstrate what their usage implies to time series models. To overcome the limitations of the existing multiple steps estimators, we propose the Geometric Trace Mean Squared Error, demonstrating its advantages. We conduct a simulation experiment showing how the estimators behave with different sample sizes and forecast horizons. Finally, we carry out an empirical evaluation on real data, demonstrating the performance and advantages of the estimators. Given that the underlying process to be modelled is often unknown, we conclude that the shrinkage achieved by the GTMSE is a competitive alternative to conventional ones.

Retailers depend on accurate forecasts of product sales at the Store × SKU level to efficiently manage their inventory. Consequently, there has been increasing interest in identifying more advanced statistical techniques that lead to accuracy improvements. However, the inclusion of multiple drivers affecting demand into commonly used ARIMA and ETS models is not straightforward, particularly when many explanatory variables are available. Moreover, regularization regression models that shrink the model’s parameters allow for the inclusion of a lot of relevant information but do not intrinsically handle the dynamics of the demand. These problems have not been addressed by previous studies. Nevertheless, multiple simultaneous effects interacting are common in retailing. To be successful, any approach needs to be automatic, robust and efficiently scaleable. In this study, we design novel approaches to forecast retailer product sales taking into account the main drivers which affect SKU demand at store level. To address the variable selection challenge, the use of dimensionality reduction via principal components analysis (PCA) and shrinkage estimators was investigated. The empirical results, using a case study of supermarket sales in Portugal, show that both PCA and shrinkage are useful and result in gains in forecast accuracy in the order of 10% over benchmarks while offering insights on the impact of promotions. Focusing on the promotional periods, PCA-based models perform strongly, while shrinkage estimators over-shrink. For the non-promotional periods, shrinkage estimators significantly outperform the alternatives. 

In this paper, we explored how judgment can be used to improve the selection of a forecasting model. We compared the performance of judgmental model selection against a standard algorithm based on information criteria. We also examined the efficacy of a judgmental model-build approach, in which experts were asked to decide on the existence of the structural components (trend and seasonality) of the time series instead of directly selecting a model from a choice set. Our behavioral study used data from almost 700 participants, including forecasting practitioners. The results from our experiment suggest that selecting models judgmentally results in performance that is on par, if not better, to that of algorithmic selection. Further, judgmental model selection helps to avoid the worst models more frequently compared to algorithmic selection. Finally, a simple combination of the statistical and judgmental selections and judgmental aggregation significantly outperform both statistical and judgmental selections.

The aim of this paper is to provide a thinking road-map and a practical guide to researchers and practitioners working on hierarchical forecasting problems. Evaluating the performance of hierarchical forecasts comes with new challenges stemming from both the structure of the hierarchy and the application context. We discuss several relevant dimensions for researchers and analysts: the scale and units of the time series, the issue of intermittency, the forecast horizon, the importance of multiple evaluation windows and the multiple objective decision context. We conclude with a series of practical recommendations. 

The COVID-19 pandemic has had a devastating effect on many industries around the world including tourism and policy makers are interested in mapping out what the recovery path will look like. We propose a novel statistical methodology for generating scenario-based probabilistic forecasts based on a large survey of 443 tourism experts and stakeholders. The scenarios map out pessimistic, most-likely and optimistic paths to recovery. Taking advantage of the natural aggregation structure of tourism data due to geographic locations and purposes of travel, we propose combining forecast reconciliation and forecast combinations implemented to historical data to generate robust COVID-free counterfactual forecasts, to contrast against. Our empirical application focuses on Australia, analyzing international arrivals and domestic flows. Both sectors have been severely affected by travel restrictions in the form of international and interstate border closures and regional lockdowns. The two sets of forecasts, allow policy makers to map out the road to recovery and also estimate the expected effect of the pandemic.

Exponential smoothing is widely used in practice and has shown its efficacy and reliability in many business applications. Yet there are cases, for example when the estimation sample is limited, where the estimated smoothing parameters can be erroneous, often unnecessarily large. This can lead to over-reactive forecasts and high forecast errors. Motivated by these challenges, we investigate the use of shrinkage estimators for exponential smoothing. This can help with parameter estimation and mitigating parameter uncertainty. Building on the shrinkage literature, we explore ℓ1 and ℓ2 shrinkage for different time series and exponential smoothing model specifications. From a simulation and an empirical study, we find that using shrinkage in exponential smoothing results in forecast accuracy improvements and better prediction intervals. In addition, using bias–variance decomposition, we show the interdependence between smoothing parameters and initial values, and the importance of the initial value estimation on point forecasts and prediction intervals.