Humans in the Loop: Blending Human Expertise with Statistical & ML Models for Better Retail Decisions
2025 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE credits
Student thesis
Abstract [en]
Accurate sales forecasting is critical for effective planning and decision-making in retail, yet conventional statistical and machine learning models often overlook the value of human judgment. This thesis investigates the integration of human forecasts (HF) with model-based approaches in the context of weekly, multi-SKU sales data characterized by heterogeneous data availability. The study addresses two research questions: (1) to compare human forecasts with statistical and machine learning models trained on routinely available data, and (2) to assess whether simple, transparent human-in-the-loop (HITL) ensembles improve forecast accuracy relative to either humans or models alone.To this end, seven base models Exponential Smoothing (ETS), ARIMA, polynomial regression, Random Forest, Extra Trees, Histogram-based Gradient Boosting, and XGBoost were trained across three feature sets: (A) sales and derived features, (B) sales plus promotional information and prognosis leads, and (C) all features including human forecasts. Ensembles were designed by combining subsets of models with HF, incorporating promotion-gating rules and quantile-based weighting. Model and ensemble performance was evaluated using rolling-origin cross-validation with a strict temporal split into 26-week holdout, validation, and out-of-sample blocks. Metrics included MASE, RMSSE, MAE, RMSE, MAPE, ME, and pinball loss.The findings demonstrate that human forecasts provide valuable information but are not significantly biased across SKUs. HITL ensembles consistently reduced forecast error, particularly for products with sparse or irregular promotional histories, while preserving transparency and interpretability. This work contributes to the literature on judgmental forecasting by empirically showing when and how human judgment can be effectively integrated with data-driven methods, highlighting the practical potential of lightweight HITL designs for retail forecasting.
Place, publisher, year, edition, pages
2025. , p. 42
Keywords [en]
Judgmental Forecasting, Human-In-The-Loop, Sale Forecasting, Statistical Models, Machine Learning (ML) Models, Ensemble Models
National Category
Probability Theory and Statistics
Identifiers
URN: urn:nbn:se:his:diva-25960OAI: oai:DiVA.org:his-25960DiVA, id: diva2:2009162
Subject / course
Informationsteknologi
Educational program
Data Science - Master’s Programme
Supervisors
Examiners
2025-10-272025-10-272025-10-27Bibliographically approved