Högskolan i Skövde

This paper presents a hybrid machine learning framework to enhance traffic safety in urban road intersections. The framework employs a two-stage approach: Decision Trees predict vehicle trajectories by identifying turning behaviors, while Random Forests estimate collision probabilities involving vehicles and vulnerable road users (VRUs) such as pedestrians and cyclists. Engineered spatial, temporal, and motion-related features are derived from high-resolution trajectory data collected via connected camera systems in busy urban cores. The experimental results demonstrate high predictive accuracy, achieving an F1-Score of 0.97 for turning vehicle classification and a ROC-AUC of 0.98 for collision risk estimation. Compared to computationally intensive deep learning models, the proposed framework balances robust performance with computational efficiency, making it suitable for realtime deployment in complex urban environments. The framework integrates with in-vehicle Human-Machine Interfaces (HMIs) to enhance driver awareness and enable proactive safety interventions. This study addresses the need for interpretable and scalable road safety solutions in connected traffic systems.

Driver intention recognition (DIR) studies increasingly rely on deep neural networks. Deep neural networks have achieved top performance for many different tasks. However, apart from image classifications and semantic segmentation for mobile phones, it is not a common practice for components of advanced driver assistance systems to explicitly analyze the complexity and performance of the network’s architecture. Therefore, this paper applies neural architecture search to investigate the effects of the deep neural network architecture on a real-world safety critical application with limited computational capabilities. We explore a pre-defined search space for three deep neural network layer types that are capable to handle sequential data (a long-short term memory, temporal convolution, and a time-series transformer layer), and the influence of different data fusion strategies on the driver intention recognition performance. A set of eight search strategies are evaluated for two driver intention recognition datasets. For the two datasets, we observed that there is no search strategy clearly sampling better deep neural network architectures. However, performing an architecture search improves the model performance compared to the original manually designed networks. Furthermore, we observe no relation between increased model complexity and better driver intention recognition performance. The result indicate that multiple architectures can yield similar performance, regardless of the deep neural network layer type or fusion strategy. However, the optimal complexity, layer type and fusion remain unknown upfront.

Traffic fatalities remain among the leading death causes worldwide. To reduce this figure, car safety is listed as one of the most important factors. To actively support human drivers, it is essential for advanced driving assistance systems to be able to recognize the driver's actions and intentions. Prior studies have demonstrated various approaches to recognize driving actions and intentions based on in-cabin and external video footage. Given the performance of self-supervised video pre-trained (SSVP) Video Masked Autoencoders (VMAEs) on multiple action recognition datasets, we evaluate the performance of SSVP VMAEs on the Honda Research Institute Driving Dataset for driver action recognition (DAR) and on the Brain4Cars dataset for driver intention recognition (DIR). Besides the performance, the application of an artificial intelligence system in a safety-critical environment must be capable to express when it is uncertain about the produced results. Therefore, we also analyze uncertainty estimations produced by a Bayes-by-Backprop last-layer (BBB-LL) and Monte-Carlo (MC) dropout variants of an VMAE. Our experiments show that an VMAE achieves a higher overall performance for both offline DAR and end-to-end DIR compared to the state-of-the-art. The analysis of the BBB-LL and MC dropout models show higher uncertainty estimates for incorrectly classified test instances compared to correctly predicted test instances.

Driver intention recognition (DIR) methods mostly rely on deep neural networks (DNNs). To use DNNs in asafety-critical real-world environment it is essential to quantify how confident the model is about the producedpredictions. Therefore, this study evaluates the performance and calibration of a temporal convolutionalnetwork (TCN) for multiple probabilistic deep learning (PDL) methods (Bayes-by-Backprop, Monte-Carlodropout, Deep ensembles, Stochastic Weight averaging - Gaussian, Multi SWA-G, cyclic Stochastic GradientHamiltonian Monte Carlo). Notably, we formalize an approach that combines optimization-based pre-trainingwith Hamiltonian Monte-Carlo (PT-HMC) sampling, aiming to leverage the strengths of both techniques. Ouranalysis, conducted on two pre-processed open-source DIR datasets, reveals that PT-HMC not only matchesbut occasionally surpasses the performance of existing PDL methods. One of the remaining challenges thatprohibits the integration of a PDL-based DIR system into an actual car is the computational requirements toperform inference. Therefore, future work could focus on optimizing PDL methods to be more computationallyefficient without sacrificing performance or the ability to estimate uncertainties.

Climate change has impacted global temperatures, triggering extreme weather and adverse environmental effects. In Sweden, these changes have caused shifts in weather patterns, leading to disruptions in infrastructure. This, in turn, has influenced water turbidity levels, negatively impacting water quality. To tackle these issues, a study was conducted using machine learning to predict turbidity with six meteorological variables collected for two years. Our preliminary research showed a substantial influence of seasonal changes on water turbidity, especially air temperature. Identifying supporting indicators such as lagged features is crucial and considerably improved the turbidity prediction performance for two of the machine learning models used. However, the study also identified challenges like data collection and uncertainty issues. We recommend improving data collection quality with higher frequency, minimizing geographical gaps between data collection points, sharing calibration assumptions, checking the sensors regularly, and accounting for data anomalies. Understanding these challenges and their potential implications could lead to more methodological enhancements.

Real-world applications of artificial intelligence that can potentially harm human beings should be able to express uncertainty about the made predictions. Probabilistic deep learning (DL) methods (e.g., variational inference [VI], VI last layer [VI-LL], Monte-Carlo [MC] dropout, stochastic weight averaging - Gaussian [SWA-G], and deep ensembles) can produce a predictive uncertainty but require expensive MC sampling techniques. Therefore, we evaluated if the probabilistic DL methods are uncertain when making incorrect predictions for an open-source driver intention recognition dataset and if a surrogate DL model can reproduce the uncertainty estimates. We found that all probabilistic DL methods are significantly more uncertain when making incorrect predictions at test time, but there are still instances where the models are very certain but completely incorrect. The surrogate DL models trained on the MC dropout and VI uncertainty estimates were capable of reproducing a significantly higher uncertainty estimate when making incorrect predictions.

To ensure reliable network performance, anomaly detection is an important part of the telecommunication operators’ work. This includes that operators need to timely intervene with the network, should they encounter indications of network performance degradation. In this paper, we describe the results of an initial experiment for anomaly detection with regard to network performance, using topic modeling on base station run-time variable data collected from live Radio Access Networks (RANs). The results show that topic modeling clusters semantically related data in the same way as human experts would and that the anomalies in our test cases could be identified in latent Dirichlet allocation (LDA) topic models. Our experiment further reveals which information provided by the topic model is particularly usable to support human anomaly detection in this application domain.

Every year worldwide more than one million people die and a further 50 million people are injured in traffic accidents. Therefore, the development of car safety features that actively support the driver in preventing accidents, is of utmost importance to reduce the number of injuries and fatalities. However, to establish this support it is necessary that the advanced driver assistance system (ADAS) understands the driver’s intended behavior in advance. The growing variety of sensors available for vehicles together with improved computer vision techniques, hence led to increased research directed towards inferring the driver’s intentions. This article reviews 64 driver intention recognition studies with regard to the maneuvers considered, the driving features included, the AI methods utilized, the achieved performance within the presented experiments, and the open challenges identified by the respected researchers. The article provides a high level analysis of the current technology readiness level of driver intention recognition technology to address the challenges to enable reliable driver intention recognition, such as the system architecture, implementation, and the purpose of the technology.

Recognizing Pedestrians intention to cross a street and predicting their imminent crossing action are major challenges for advanced driver assistance systems (ADAS) and Autonomous Vehicles (AV). In this paper we address these problems by proposing a new neural network architecture that uses feature fusion. The approach is used to recog[1]nise/predict the pedestrians intention/action 1.5 sec (45 frames) ahead. We evaluate our approach on the recently suggested benchmark by Rasouli et al. and show that our approach outperforms current state of the art models. We observe further improved results when the model is trained and tested on a stronger balanced subset of the PIE dataset.

The safety of vulnerable road users (VRU) is a major concernfor both advanced driver assistance systems (ADAS) and autonomousvehicle manufacturers. To guarantee people safetyon roads, autonomous vehicles must be able to detect thepresence of pedestrians, track them, and predict their intentionto cross the road. Most of the earlier work on pedestrianintention recognition focused on using either handcraftedfeatures or an end-to-end deep learning approach. In thisproject, we investigate the impact of fusing handcrafted featureswith auto learned features by using a two-stream neuralnetwork architecture. Our results show that the combined approachimproves the performance. Furthermore, the proposedmethod achieved very good results on the JAAD dataset. Dependingon whether we considered the immediate frames beforethe crossing or only half a second before that point, wereceived prediction accuracy of 91%, and 84%, respectively.