Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
PT-HMC: Optimization-based Pre-Training with Hamiltonian Monte-Carlo Sampling for Driver Intention Recognition
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. Department of Complete Vehicle Data Science, R&D, Volvo Car Corporation, Sweden. (Skövde Artificial Intelligence Lab (SAIL))ORCID iD: 0000-0003-2135-6615
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Skövde Artificial Intelligence Lab (SAIL))ORCID iD: 0000-0003-2973-3112
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Skövde Artificial Intelligence Lab (SAIL))ORCID iD: 0000-0003-2949-4123
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Skövde Artificial Intelligence Lab (SAIL))ORCID iD: 0000-0001-8884-2154
Show others and affiliations
2024 (English)In: ACM Transactions on Probabilistic Machine Learning, E-ISSN 2836-8924, Vol. 1, no 1, article id 4Article in journal (Refereed) Published
Abstract [en]

Driver intention recognition (DIR) methods mostly rely on deep neural networks (DNNs). To use DNNs in asafety-critical real-world environment it is essential to quantify how confident the model is about the producedpredictions. Therefore, this study evaluates the performance and calibration of a temporal convolutionalnetwork (TCN) for multiple probabilistic deep learning (PDL) methods (Bayes-by-Backprop, Monte-Carlodropout, Deep ensembles, Stochastic Weight averaging - Gaussian, Multi SWA-G, cyclic Stochastic GradientHamiltonian Monte Carlo). Notably, we formalize an approach that combines optimization-based pre-trainingwith Hamiltonian Monte-Carlo (PT-HMC) sampling, aiming to leverage the strengths of both techniques. Ouranalysis, conducted on two pre-processed open-source DIR datasets, reveals that PT-HMC not only matchesbut occasionally surpasses the performance of existing PDL methods. One of the remaining challenges thatprohibits the integration of a PDL-based DIR system into an actual car is the computational requirements toperform inference. Therefore, future work could focus on optimizing PDL methods to be more computationallyefficient without sacrificing performance or the ability to estimate uncertainties.

Place, publisher, year, edition, pages
ACM Digital Library, 2024. Vol. 1, no 1, article id 4
Keywords [en]
Driver Intention Recognition, Probabilistic Deep Learning, Bayesian Deep Learning, Uncertainty quantification, Hamiltonian Monte Carlo
National Category
Computer graphics and computer vision
Research subject
Skövde Artificial Intelligence Lab (SAIL)
Identifiers
URN: urn:nbn:se:his:diva-24425DOI: 10.1145/3688573OAI: oai:DiVA.org:his-24425DiVA, id: diva2:1888171
Note

CC BY-SA 4.0

Koen Vellenga (corresponding author), University of Skövde, Skövde, Sweden and Volvo Car Corporation, Göteborg, Sweden

Available from: 2024-08-12 Created: 2024-08-12 Last updated: 2025-10-06Bibliographically approved
In thesis
1. Deep Learning-Based Driver Intention Recognition: Evaluating performance, complexity and uncertainty estimations
Open this publication in new window or tab >>Deep Learning-Based Driver Intention Recognition: Evaluating performance, complexity and uncertainty estimations
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Deep learning (DL) methods have advanced rapidly and are commonly applied in high-risk, resource-constrained environments such as advanced driver assistance systems (ADAS), where misclassifications can have serious consequences. With upcoming artificial intelligence (AI) legislation, it is essential to extensively evaluate and minimize the undesirable behavior of DL-based systems in such settings. An example is an ADAS that continuously evaluates whether a driver’s intended maneuvers are safe to execute given the current traffic context. Driver intention recognition (DIR), which predicts the maneuver a driver intends to perform in the near future, is a central DL-based component of such systems. Since deep neural networks (DNNs) do not inherently provide uncertainty estimates for their predictions, probabilistic deep learning (PDL) methods can be applied to improve the identification of scenarios where model outputs may be unreliable. In this thesis, we first review the current state of DIR research, focusing on the recent shift toward DL methods. We then examine how both established and novel PDL methods influence DIR performance. We evaluate the uncertainty estimations by analyzing their ability to distinguish between correct and incorrect predictions and by measuring their effectiveness in out-of-distribution (OOD) detection. Furthermore, we employ neural architecture search with multiple objectives and search strategies to explore how architectural complexity impacts DIR and OOD detection performance. Finally, we conduct a comparative experiment to evaluate human performance against that of DL-based models in video-based recognition of road user intentions.

Place, publisher, year, edition, pages
Skövde: University of Skövde, 2025. p. xiii, 294
Series
Dissertation Series ; 66
National Category
Computer Sciences Computer graphics and computer vision Artificial Intelligence
Research subject
Skövde Artificial Intelligence Lab (SAIL)
Identifiers
urn:nbn:se:his:diva-25867 (URN)978-91-989080-5-3 (ISBN)978-91-989080-6-0 (ISBN)
Public defence
2025-11-12, University of Skövde, Building D, Room D107, Skövde, 13:15 (English)
Opponent
Supervisors
Note

Tre av nio delarbeten ("under submission"; övriga se rubriken Delarbeten/List of papers):

6. Koen Vellenga, H. Joe Steinhauer, Göran Falkman, Jonas Andersson, and Anders Sjögren (2025b). “Last Layer Hamiltonian Monte Carlo”

7. Koen Vellenga, H. Joe Steinhauer, Jonas Andersson, and Anders Sjögren (2025). “Latent Uncertainty Representations for Video-based Driver Action and Intention Recognition”

8. Koen Vellenga (2025). “Multi-Objective Architecture Search for Driver Action and Intention Recognition using Probabilistic Deep Neural Networks”

Available from: 2025-09-30 Created: 2025-09-29 Last updated: 2026-01-08Bibliographically approved

Open Access in DiVA

fulltext(58324 kB)165 downloads
File information
File name FULLTEXT02.pdfFile size 58324 kBChecksum SHA-512
8f6dfc3a19778d8970853bc0de1998635480813fbd7bc09d22b798ae242fecf4c18ac6e050eab832da9f79b753e6e4c9c0bdaa48eba3bdaacfc99cb03bd5fda1
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Vellenga, KoenKarlsson, AlexanderSteinhauer, H. JoeFalkman, Göran

Search in DiVA

By author/editor
Vellenga, KoenKarlsson, AlexanderSteinhauer, H. JoeFalkman, GöranSjögren, Anders
By organisation
School of InformaticsInformatics Research Environment
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar
Total: 245 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 729 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf