his.sePublications
Change search
Link to record
Permanent link

Direct link
BETA
Publications (10 of 57) Show all publications
Windridge, D., Svensson, H. & Thill, S. (2020). On the utility of dreaming: A general model for how learning in artificial agents can benefit from data hallucination. Adaptive Behavior, Article ID UNSP 1059712319896489.
Open this publication in new window or tab >>On the utility of dreaming: A general model for how learning in artificial agents can benefit from data hallucination
2020 (English)In: Adaptive Behavior, ISSN 1059-7123, E-ISSN 1741-2633, article id UNSP 1059712319896489Article in journal (Refereed) Epub ahead of print
Abstract [en]

We consider the benefits of dream mechanisms - that is, the ability to simulate new experiences based on past ones - in a machine learning context. Specifically, we are interested in learning for artificial agents that act in the world, and operationalize "dreaming" as a mechanism by which such an agent can use its own model of the learning environment to generate new hypotheses and training data. We first show that it is not necessarily a given that such a data-hallucination process is useful, since it can easily lead to a training set dominated by spurious imagined data until an ill-defined convergence point is reached. We then analyse a notably successful implementation of a machine learning-based dreaming mechanism by Ha and Schmidhuber (Ha, D., & Schmidhuber, J. (2018). World models. arXiv e-prints, arXiv:1803.10122). On that basis, we then develop a general framework by which an agent can generate simulated data to learn from in a manner that is beneficial to the agent. This, we argue, then forms a general method for an operationalized dream-like mechanism. We finish by demonstrating the general conditions under which such mechanisms can be useful in machine learning, wherein the implicit simulator inference and extrapolation involved in dreaming act without reinforcing inference error even when inference is incomplete.

Place, publisher, year, edition, pages
Sage Publications, 2020
Keywords
Artificial dream mechanisms, data simulation, machine learning, reinforcement learning
National Category
Computer Sciences
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-18160 (URN)10.1177/1059712319896489 (DOI)000506780000001 ()2-s2.0-85077601986 (Scopus ID)
Available from: 2020-01-23 Created: 2020-01-23 Last updated: 2020-04-22Bibliographically approved
Bartlett, M. E., Costescu, C., Baxter, P. & Thill, S. (2020). Requirements for Robotic Interpretation of Social Signals “in the Wild”: Insights from Diagnostic Criteria of Autism Spectrum Disorder. Information, 11(2), Article ID 81.
Open this publication in new window or tab >>Requirements for Robotic Interpretation of Social Signals “in the Wild”: Insights from Diagnostic Criteria of Autism Spectrum Disorder
2020 (English)In: Information, E-ISSN 2078-2489, Vol. 11, no 2, article id 81Article in journal (Refereed) Published
Abstract [en]

The last few decades have seen widespread advances in technological means to characterise observable aspects of human behaviour such as gaze or posture. Among others, these developments have also led to significant advances in social robotics. At the same time, however, social robots are still largely evaluated in idealised or laboratory conditions, and it remains unclear whether the technological progress is sufficient to let such robots move “into the wild”. In this paper, we characterise the problems that a social robot in the real world may face, and review the technological state of the art in terms of addressing these. We do this by considering what it would entail to automate the diagnosis of Autism Spectrum Disorder (ASD). Just as for social robotics, ASD diagnosis fundamentally requires the ability to characterise human behaviour from observable aspects. However, therapists provide clear criteria regarding what to look for. As such, ASD diagnosis is a situation that is both relevant to real-world social robotics and comes with clear metrics. Overall, we demonstrate that even with relatively clear therapist-provided criteria and current technological progress, the need to interpret covert behaviour cannot yet be fully addressed. Our discussions have clear implications for ASD diagnosis, but also for social robotics more generally. For ASD diagnosis, we provide a classification of criteria based on whether or not they depend on covert information and highlight present-day possibilities for supporting therapists in diagnosis through technological means. For social robotics, we highlight the fundamental role of covert behaviour, show that the current state-of-the-art is unable to charact

Place, publisher, year, edition, pages
MDPI, 2020
Keywords
autism spectrum disorder, diagnosis, technology, behaviour
National Category
Human Computer Interaction
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-18184 (URN)10.3390/info11020081 (DOI)000519542400049 ()2-s2.0-85081118497 (Scopus ID)
Note

This article belongs to the Special Issue Advances in Social Robots

Available from: 2020-02-03 Created: 2020-02-03 Last updated: 2020-04-22Bibliographically approved
Mahmoud, S., Svensson, H. & Thill, S. (2019). Cognitively-inspired episodic imagination for self-driving vehicles. In: Towards Cognitive Vehicles: perception, learning and decision making under real-world constraints. Is bio-inspiration helpful?: Proceedings. Paper presented at TCV2019: Towards Cognitive Vehicles: perception, learning and decision making under real-world constraints. Is bio-inspiration helpful? Workshop held as part of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2019). Macau, China, November 8, 2019. (pp. 28-31).
Open this publication in new window or tab >>Cognitively-inspired episodic imagination for self-driving vehicles
2019 (English)In: Towards Cognitive Vehicles: perception, learning and decision making under real-world constraints. Is bio-inspiration helpful?: Proceedings, 2019, p. 28-31Conference paper, Poster (with or without abstract) (Refereed)
Abstract [en]

The controller of an autonomous vehicle needsthe ability to learn how to act in different driving scenariosthat it may face. A significant challenge is that it is difficult,dangerous, or even impossible to experience and explore variousactions in situations that might be encountered in the realworld. Autonomous vehicle control would therefore benefitfrom a mechanism that allows the safe exploration of actionpossibilities and their consequences, as well as the ability tolearn from experience thus gained to improve driving skills.In this paper we demonstrate a methodology that allows alearning agent to create simulations of possible situations. Thesesimulations can be chained together in a sequence that allowsthe progressive improvement of the agent’s performance suchthat the agent is able to appropriately deal with novel situationsat the end of training. This methodology takes inspirationfrom the human ability to imagine hypothetical situations usingepisodic simulation; we therefore refer to this methodology asepisodic imagination.An interesting question in this respect is what effect thestructuring of such a sequence of episodic imaginations hason performance. Here, we compare a random process to astructured one and initial results indicate  that a structuredsequence outperforms a random one.

National Category
Robotics
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-18175 (URN)
Conference
TCV2019: Towards Cognitive Vehicles: perception, learning and decision making under real-world constraints. Is bio-inspiration helpful? Workshop held as part of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2019). Macau, China, November 8, 2019.
Funder
EU, Horizon 2020, 41365
Available from: 2020-01-28 Created: 2020-01-28 Last updated: 2020-02-24Bibliographically approved
Thill, S. & Riveiro, M. (2019). Memento hominibus: on the fundamental role of end users in real-world interactions with neuromorphic systems. In: Proceedings of the Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019: . Paper presented at Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019, 26 – 28 August, University of Edinburgh, United Kingdom.
Open this publication in new window or tab >>Memento hominibus: on the fundamental role of end users in real-world interactions with neuromorphic systems
2019 (English)In: Proceedings of the Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019, 2019Conference paper, Published paper (Refereed)
National Category
Computer and Information Sciences
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-17786 (URN)
Conference
Workshop on Robust Artificial Intelligence for Neurorobotics (RAI-NR) 2019, 26 – 28 August, University of Edinburgh, United Kingdom
Available from: 2019-10-11 Created: 2019-10-11 Last updated: 2019-12-17Bibliographically approved
Cao, H.-L., Esteban, P. G., Bartlett, M., Baxter, P. E., Belpaeme, T., Billing, E., . . . Ziemke, T. (2019). Robot-Enhanced Therapy: Development and Validation of a Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy. IEEE robotics & automation magazine, 26(2), 49-58
Open this publication in new window or tab >>Robot-Enhanced Therapy: Development and Validation of a Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy
Show others...
2019 (English)In: IEEE robotics & automation magazine, ISSN 1070-9932, E-ISSN 1558-223X, Vol. 26, no 2, p. 49-58Article in journal (Refereed) Published
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2019
National Category
Human Computer Interaction
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-16864 (URN)10.1109/MRA.2019.2904121 (DOI)000471680800008 ()2-s2.0-85064382580 (Scopus ID)
Projects
DREAM, FP7 grant #611391.
Available from: 2019-05-06 Created: 2019-05-06 Last updated: 2019-11-18Bibliographically approved
Bartlett, M., Edmunds, C. E. .., Belpaeme, T., Thill, S. & Lemaignan, S. (2019). What Can You See?: Identifying Cues on Internal States From the Movements of Natural Social Interactions. Frontiers in Robotics and AI, 6(49)
Open this publication in new window or tab >>What Can You See?: Identifying Cues on Internal States From the Movements of Natural Social Interactions
Show others...
2019 (English)In: Frontiers in Robotics and AI, E-ISSN 2296-9144, Vol. 6, no 49Article in journal (Refereed) Published
Abstract [en]

In recent years, the field of Human-Robot Interaction (HRI) has seen an increasingdemand for technologies that can recognize and adapt to human behaviors and internalstates (e.g., emotions and intentions). Psychological research suggests that humanmovements are important for inferring internal states. There is, however, a need to betterunderstand what kind of information can be extracted from movement data, particularlyin unconstrained, natural interactions. The present study examines which internal statesand social constructs humans identify from movement in naturalistic social interactions.Participants either viewed clips of the full scene or processed versions of it displaying2D positional data. Then, they were asked to fill out questionnaires assessing their socialperception of the viewed material. We analyzed whether the full scene clips were moreinformative than the 2D positional data clips. First, we calculated the inter-rater agreementbetween participants in both conditions. Then, we employed machine learning classifiersto predict the internal states of the individuals in the videos based on the ratingsobtained. Although we found a higher inter-rater agreement for full scenes comparedto positional data, the level of agreement in the latter case was still above chance,thus demonstrating that the internal states and social constructs under study wereidentifiable in both conditions. A factor analysis run on participants’ responses showedthat participants identified the constructs interaction imbalance, interaction valence andengagement regardless of video condition. The machine learning classifiers achieveda similar performance in both conditions, again supporting the idea that movementalone carries relevant information. Overall, our results suggest it is reasonable to expecta machine learning algorithm, and consequently a robot, to successfully decode andclassify a range of internal states and social constructs using low-dimensional data (suchas the movements and poses of observed individuals) as input.

Place, publisher, year, edition, pages
Frontiers Research Foundation, 2019
Keywords
social psychology, human-robot interaction, machine learning, social interaction, recognition
National Category
Human Computer Interaction
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-17301 (URN)10.3389/frobt.2019.00049 (DOI)000473169300001 ()2-s2.0-85068522657 (Scopus ID)
Available from: 2019-06-26 Created: 2019-06-26 Last updated: 2019-12-02Bibliographically approved
Thill, S. (2019). What we need from an embodied cognitive architecture. In: Maria Isabel Aldinhas Ferreira, João Silva Sequeira, Rodrigo Ventura (Ed.), Cognitive Architectures: (pp. 43-57). Cham: Springer
Open this publication in new window or tab >>What we need from an embodied cognitive architecture
2019 (English)In: Cognitive Architectures / [ed] Maria Isabel Aldinhas Ferreira, João Silva Sequeira, Rodrigo Ventura, Cham: Springer, 2019, p. 43-57Chapter in book (Refereed)
Abstract [en]

Given that original purpose of cognitive architectures was to lead to a unified theory of cognition, this chapter considers the possible contributions that cognitive architectures can make to embodied theories of cognition in particular. This is not a trivial question since the field remains very much divided about what embodied cognition actually means, and we will see some example positions in this chapter. It is then argued that a useful embodied cognitive architecture would be one that can demonstrate (a) what precisely the role of the body in cognition actually is, and (b) whether a body is constitutively needed at all for some (or all) cognitive processes. It is proposed that such questions can be investigated if the cognitive architecture is designed so that consequences of varying the precise embodiment on higher cognitive mechanisms can be explored. This is in contrast with, for example, those cognitive architectures in robotics that are designed for specific bodies first; or architectures in cognitive science that implement embodiment as an add-on to an existing framework (because then, that framework is by definition not constitutively shaped by the embodiment). The chapter concludes that the so-called semantic pointer architecture by Eliasmith and colleagues may be one framework that satisfies our desiderata and may be well-suited for studying theories of embodied cognition further.

Place, publisher, year, edition, pages
Cham: Springer, 2019
Series
Intelligent Systems, Control and Automation: Science and Engineering, ISSN 2213-8986, E-ISSN 2213-8994 ; 94
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
Interaction Lab (ILAB); INF302 Autonomous Intelligent Systems
Identifiers
urn:nbn:se:his:diva-16167 (URN)10.1007/978-3-319-97550-4_4 (DOI)000465469800005 ()2-s2.0-85051464325 (Scopus ID)978-3-319-97549-8 (ISBN)978-3-319-97550-4 (ISBN)
Available from: 2018-09-07 Created: 2018-09-07 Last updated: 2019-06-11Bibliographically approved
Thill, S., Riveiro, M., Lagerstedt, E., Lebram, M., Hemeren, P., Habibovic, A. & Klingegård, M. (2018). Driver adherence to recommendations from support systems improves if the systems explain why they are given: A simulator study. Transportation Research Part F: Traffic Psychology and Behaviour, 56, 420-435
Open this publication in new window or tab >>Driver adherence to recommendations from support systems improves if the systems explain why they are given: A simulator study
Show others...
2018 (English)In: Transportation Research Part F: Traffic Psychology and Behaviour, ISSN 1369-8478, E-ISSN 1873-5517, Vol. 56, p. 420-435Article in journal (Refereed) Published
Abstract [en]

This paper presents a large-scale simulator study on driver adherence to recommendationsgiven by driver support systems, specifically eco-driving support and navigation support.123 participants took part in this study, and drove a vehicle simulator through a pre-defined environment for a duration of approximately 10 min. Depending on the experi-mental condition, participants were either given no eco-driving recommendations, or asystem whose provided support was either basic (recommendations were given in theform of an icon displayed in a manner that simulates a heads-up display) or informative(the system additionally displayed a line of text justifying its recommendations). A naviga-tion system that likewise provided either basic or informative support, depending on thecondition, was also provided.

Effects are measured in terms of estimated simulated fuel savings as well as engine brak-ing/coasting behaviour and gear change efficiency. Results indicate improvements in allvariables. In particular, participants who had the support of an eco-driving system spenta significantly higher proportion of the time coasting. Participants also changed gears atlower engine RPM when using an eco-driving support system, and significantly more sowhen the system provided justifications. Overall, the results support the notion that pro-viding reasons why a support system puts forward a certain recommendation improvesadherence to it over mere presentation of the recommendation.

Finally, results indicate that participants’ driving style was less eco-friendly if the navi-gation system provided justifications but the eco-system did not. This may be due to par-ticipants considering the two systems as one whole rather than separate entities withindividual merits. This has implications for how to design and evaluate a given driver sup-port system since its effectiveness may depend on the performance of other systems in thevehicle.

Keywords
Driver behaviour, System awareness, Eco-friendly behaviour, Driver recommendation systems
National Category
Psychology Human Computer Interaction Information Systems
Research subject
Interaction Lab (ILAB); Skövde Artificial Intelligence Lab (SAIL); INF301 Data Science; INF302 Autonomous Intelligent Systems
Identifiers
urn:nbn:se:his:diva-15279 (URN)10.1016/j.trf.2018.05.009 (DOI)000437997700037 ()2-s2.0-85048505654 (Scopus ID)
Projects
TIEB
Funder
Swedish Energy Agency
Available from: 2018-06-04 Created: 2018-06-04 Last updated: 2019-11-19Bibliographically approved
Lagerstedt, E. & Thill, S. (2018). Perception of Agent Properties in Humans and Machines. In: : . Paper presented at 41st European Conference on Visual Perception ECVP 2018, 26–30 August 2018, Trieste, Italy (pp. 124-124). , 48
Open this publication in new window or tab >>Perception of Agent Properties in Humans and Machines
2018 (English)Conference paper, Poster (with or without abstract) (Refereed)
Series
PERCEPTION, ISSN 0301-0066, E-ISSN 1468-4233
National Category
Psychology (excluding Applied Psychology)
Research subject
Interaction Lab (ILAB); INF302 Autonomous Intelligent Systems
Identifiers
urn:nbn:se:his:diva-16131 (URN)000468288300466 ()
Conference
41st European Conference on Visual Perception ECVP 2018, 26–30 August 2018, Trieste, Italy
Projects
Dreams4Cars
Funder
EU, Horizon 2020, 731593
Available from: 2018-09-03 Created: 2018-09-03 Last updated: 2019-06-07Bibliographically approved
Windridge, D. & Thill, S. (2018). Representational fluidity in embodied (artificial) cognition. Biosystems (Amsterdam. Print), 172, 9-17
Open this publication in new window or tab >>Representational fluidity in embodied (artificial) cognition
2018 (English)In: Biosystems (Amsterdam. Print), ISSN 0303-2647, E-ISSN 1872-8324, Vol. 172, p. 9-17Article in journal (Refereed) Published
Abstract [en]

Theories of embodied cognition agree that the body plays some role in human cognition, but disagree on the precise nature of this role. While it is (together with the environment) fundamentally engrained in the so-called 4E (or multi-E) cognition stance, there also exists interpretations wherein the body is merely an input/output interface for cognitive processes that are entirely computational.

In the present paper, we show that even if one takes such a strong computationalist position, the role of the body must be more than an interface to the world. To achieve human cognition, the computational mechanisms of a cognitive agent must be capable not only of appropriate reasoning over a given set of symbolic representations; they must in addition be capable of updating the representational framework itself (leading to the titular representational fluidity). We demonstrate this by considering the necessary properties that an artificial agent with these abilities need to possess.

The core of the argument is that these updates must be falsifiable in the Popperian sense while simultaneously directing representational shifts in a direction that benefits the agent. We show that this is achieved by the progressive, bottom-up symbolic abstraction of low-level sensorimotor connections followed by top-down instantiation of testable perception-action hypotheses.

We then discuss the fundamental limits of this representational updating capacity, concluding that only fully embodied learners exhibiting such a priori perception-action linkages are able to sufficiently ground spontaneously-generated symbolic representations and exhibit the full range of human cognitive capabilities. The present paper therefore has consequences both for the theoretical understanding of human cognition, and for the design of autonomous artificial agents.

Place, publisher, year, edition, pages
Elsevier, 2018
Keywords
Embodied cognition, Representational frameworks, Computationalism, Representational updating
National Category
Computer Sciences
Research subject
Interaction Lab (ILAB); INF302 Autonomous Intelligent Systems
Identifiers
urn:nbn:se:his:diva-16038 (URN)10.1016/j.biosystems.2018.07.007 (DOI)000448100100002 ()30092339 (PubMedID)2-s2.0-85051533418 (Scopus ID)
Available from: 2018-08-08 Created: 2018-08-08 Last updated: 2019-11-20Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0003-1177-4119

Search in DiVA

Show all publications