Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
What did you expect?: A human-centered approach to investigating and reducing the social robot expectation gap
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Interaction Lab (iLab))ORCID iD: 0000-0001-8642-336X
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

We live in a complex world where we proactively plan and execute various behaviors by forming expectations in real time. Expectations are beliefs regarding the future state of affairs and they play an integral part of our perception, attention, and behavior. Over time, our expectations become more accurate as we interact with the world and others around us. People interact socially with other people by inferring others' purposes, intentions, preferences, beliefs, emotions, thoughts, and goals. Similar inferences may occur when we interact with social robots. With anthropomorphic design, these robots are designed to mimic people physically and behaviorally. As a result, users predominantly infer agency in social robots, often leading to mismatched expectations of the robots' capabilities, which ultimately influences the user experience. 

In this thesis, the role and relevance of users' expectations in first-hand social human-robot interaction (sHRI) was investigated. There are two major findings. First, in order to study expectations in sHRI, the social robot expectation gap evaluation framework was developed. This framework supports the systematic study and evaluation of expectations over time, considering the unique context where the interaction is unfolding. Use of the framework can inform sHRI researchers and designers on how to manage users’ expectations, not only in the design, but also during evaluation and presentation of social robots. Expectations can be managed by identifying what kinds of expectations users have and aligning these through design and dissemination which ultimately creates more transparent and successful interactions and collaborations. The framework is a tool for achieving this goal. Second, results show that previous experience has a strong impact on users’ expectations. People have different expectations of social robots and view social robots as both human-like and as machines. Expectations of social robots can vary according to the source of the expectation, with those who had previous direct experiences of robots having different expectations than those who relied on indirect experiences to generate expectations.    

One consequence of these results is that expectations can be a confounding variable in sHRI research. Previous experience with social robots can prime users in future interactions with social robots. These findings highlight the unique experiences users have, even when faced with the same robot. Users' expectations and how they change over time shapes the users’ individual needs and preferences and should therefore be considered in the interpretation of sHRI. In doing so, the social robot expectation gap can be reduced.

Abstract [sv]

Vi lever i en komplex värld och för att kunna hantera denna komplexitet formar vi förväntningar. Förväntningar är antaganden om framtida tillstånd och är en vital del av vår perception, uppmärksamhet och beteende. Genom att interagera med omvärlden och andra människor blir våra förväntningar mer precisa och korrekta över tid. I en social interaktion behöver vi förstå den andra personens syften, avsikter, preferenser, övertygelser, känslor, tankar och mål. Sociala robotar är utformade för att skapa liknande inferenser när användare interagerar med dem. Detta kan leda till missbedömningar mellan vad vi förväntar oss av sociala robotar och vad dessa artefakter är kapabla till, vilket påverkar användarupplevelsen av sociala robotar.

I den här avhandlingen presenteras den forskning som har utförts för att studera rollen och relevansen av människors förväntningar i social människa-robotinteraktion (sMRI). Resultaten kan delas in i två större fynd. Det första fyndet är ett utvärderingsramverk som ämnar att systematiskt studera användares förväntningar av sociala robotar i en interaktion, med fokus på hur förväntningar ändras över tid i en interaktion, med interaktionens unika kontext i åtanke. Ramverket är menat för designers av sociala robotar och forskare inom sMRI-fältet för att bättre studera, hantera, och förstå förväntningar, både i robotarnas design och i robotarnas agerande. Det andra fyndet består av de empiriska resultat som visar hur tidigare erfarenheter påverkar användares förväntningar. Förväntningarna baseras till stor del på vilka typer av tidigare erfarenheter användare har, där de med direkta erfarenheter av robotar har andra förväntningar än de med indirekta erfarenheter. Vidare visar resultaten att användare ser sociala robotar både som människolika och som maskiner samtidigt.

Förväntningar kan också ses som en bakomliggande variabel inom sMRI-forskning eftersom tidigare erfarenheter kan påverka deltagare i kommande interaktioner med sociala robotar. Resultaten visar även att användarupplevelsen är unik för varje användare, även om roboten är densamma, vilket bör tas i åtanke när resultat tolkas i en sMRI-kontext. Genom att ha förväntningar i åtanke kan vi minska det gap som uppstår mellan människors förväntningar av sociala robotar och robotarnas faktiska förmågor. På så sätt kan vi främja positiva användarupplevelser och förbättra interaktionen mellan människa och robot.

Place, publisher, year, edition, pages
Skövde: University of Skövde , 2024. , p. 220
Series
Dissertation Series ; 55
National Category
Robotics Interaction Technologies Social Psychology Ethics Social Psychology Computer Vision and Robotics (Autonomous Systems) Human Computer Interaction
Research subject
Interaction Lab (ILAB)
Identifiers
URN: urn:nbn:se:his:diva-23414ISBN: 978-91-987906-9-6 (print)OAI: oai:DiVA.org:his-23414DiVA, id: diva2:1817878
Public defence
2024-01-19, G207, Högskolevägen 3, Skövde, 13:00 (English)
Opponent
Supervisors
Note

Ett av sju delarbeten (övriga se rubriken Delarbeten/List of papers):

VII Lindblom, Jessica, Rosén, Julia, Lamb, Maurice, and Billing, Erik (Manuscript). “Disentangling People’s Experiences and Expectations when Interacting with the Social Robot Pepper: A Qualitative Analysis”. In: Manuscript for scientific journal, pp. 1–41.

Available from: 2023-12-07 Created: 2023-12-07 Last updated: 2024-02-29Bibliographically approved
List of papers
1. Reporting of Ethical Conduct in Human-Robot Interaction Research
Open this publication in new window or tab >>Reporting of Ethical Conduct in Human-Robot Interaction Research
2021 (English)In: Advances in Human Factors in Robots, Unmanned Systems and Cybersecurity: Proceedings of the AHFE 2021 Virtual Conferences on Human Factors in Robots, Drones and Unmanned Systems, and Human Factors in Cybersecurity, July 25-29, 2021, USA / [ed] Matteo Zallio; Carlos Raymundo Ibañez; Jesus Hechavarria Hernandez, Cham: Springer, 2021, p. 87-94Conference paper, Published paper (Refereed)
Abstract [en]

The field of Human-Robot Interaction (HRI) is progressively maturing into a distinct discipline with its own research practices and traditions. Aiming to support this development, we analyzed how ethical conduct was reported and discussed in HRI research involving human participants. A literature study of 73 papers from three major HRI publication outlets was performed. The analysis considered how often the following five principles of ethical conduct were reported: ethical board approval, informed consent, data protection and privacy, deception, and debriefing. These five principles were selected as they belong to all major and relevant ethical guidelines for the HRI field. The results show that overall, ethical conduct is rarely reported, with four out of five principles mentioned in less than one third of all papers. The most frequently mentioned aspect was informed consent, which was reported in 49% of the articles. In this work, we aim to stimulate increased acknowledgment and discussion of ethical conduct reporting within the HRI field.

Place, publisher, year, edition, pages
Cham: Springer, 2021
Series
Lecture Notes in Networks and Systems (LNNS), ISSN 2367-3370, E-ISSN 2367-3389 ; 268
Keywords
Human-Robot Interaction, Ethics, Methodology
National Category
Human Computer Interaction Robotics Ethics
Research subject
INF302 Autonomous Intelligent Systems; Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-20255 (URN)10.1007/978-3-030-79997-7_11 (DOI)2-s2.0-85112020768 (Scopus ID)978-3-030-79996-0 (ISBN)978-3-030-79997-7 (ISBN)
Conference
International Conference on Applied Human Factors and Ergonomics (AHFE 2021), USA, July 25-29, 2021
Available from: 2021-08-02 Created: 2021-08-02 Last updated: 2023-12-07Bibliographically approved
2. Expectations in Human-Robot Interaction
Open this publication in new window or tab >>Expectations in Human-Robot Interaction
2021 (English)In: Advances in Neuroergonomics and Cognitive Engineering: Proceedings of the AHFE 2021 Virtual Conferences on Neuroergonomics and Cognitive Engineering, Industrial Cognitive Ergonomics and Engineering Psychology, and Cognitive Computing and Internet of Things, July 25-29, 2021, USA / [ed] Hasan Ayaz; Umer Asgher; Lucas Paletta, Cham: Springer, 2021, p. 98-105Conference paper, Published paper (Refereed)
Abstract [en]

It is acknowledged that humans expect social robots to interact in a similar way as in human-human interaction. To create successful interactions between humans and social robots, it is envisioned that the social robot should be viewed as an interaction partner rather than an inanimate thing. This implies that the robot should act autonomously, being able to ‘perceive’ and ‘anticipate’ the human’s actions as well as its own actions ‘here and now’. Two crucial aspects that affect the quality of social human-robot interaction is the social robot’s physical embodiment and its performed behaviors. In any interaction, before, during or after, there are certain expectations of what the social robot is capable of. The role of expectations is a key research topic in the field of Human-Robot Interaction (HRI); if a social robot does not meet the expectations during interaction, the human (user) may shift from viewing the robot as an interaction partner to an inanimate thing. The aim of this work is to unravel the role and relevance of humans’ expectations of social robots and why it is important area of study in HRI research. Moreover, I argue that the field of HRI can greatly benefit from incorporating approaches and methods from the field of User Experience (UX) in its efforts to gain a deeper understanding of human users’ expectations of social robots and making sure that the matching of these expectations and reality is better aligned.

Place, publisher, year, edition, pages
Cham: Springer, 2021
Series
Lecture Notes in Networks and Systems, ISSN 2367-3370, E-ISSN 2367-3389 ; 259
Keywords
User experience, Human-robot interaction, Expectations
National Category
Human Computer Interaction
Research subject
INF302 Autonomous Intelligent Systems; Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-20254 (URN)10.1007/978-3-030-80285-1_12 (DOI)2-s2.0-85112052093 (Scopus ID)978-3-030-80284-4 (ISBN)978-3-030-80285-1 (ISBN)
Conference
International Conference on Applied Human Factors and Ergonomics (AHFE 2021), USA, July 25-29, 2021.
Available from: 2021-08-02 Created: 2021-08-02 Last updated: 2023-12-07Bibliographically approved
3. The Social Robot Expectation Gap Evaluation Framework
Open this publication in new window or tab >>The Social Robot Expectation Gap Evaluation Framework
2022 (English)In: Human-Computer Interaction: Technological Innovation: Thematic Area, HCI 2022 Held as Part of the 24th HCI International Conference, HCII 2022 Virtual Event, June 26 – July 1, 2022 Proceedings, Part II / [ed] Masaaki Kurosu, Cham: Springer Nature Switzerland AG , 2022, p. 590-610Conference paper, Published paper (Refereed)
Abstract [en]

Social robots are designed in manners that encourage users to interact and communicate with them in socially appropriate ways, which implies that these robots should copy many social human behaviors to succeed in social settings. However, this approach has implications for what humans subsequently expect from these robots. There is a mismatch between expected capabilities and actual capabilities of social robots. Expectations of social robots are thus of high relevance for the field of Human-Robot Interaction (HRI). While there is recent interest of expectations in the HRI field there is no widely adapted or well formulated evaluation framework that offers a deeper understanding of how these expectations affect the success of the interaction. With basis in social psychology, user experience, and HRI, we have developed an evaluation framework for studying users’ expectations of social robots. We have identified three main factors of expectations for assessing HRI: affect, cognitive processing, and behavior and performance. In our framework, we propose several data collection techniques and specific metrics for assessing these factors. The framework and its procedure enables analysis of the collected data via triangulation to identify problems and insights, which can grant us a richer understanding of the complex facets of expectations, including if the expectations were confirmed or disconfirmed in the interaction. Ultimately, by gaining a richer understanding of how expectations affect HRI, we can narrow the social robot expectation gap and create more successful interactions between humans and social robots in society. 

Place, publisher, year, edition, pages
Cham: Springer Nature Switzerland AG, 2022
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 13303
Keywords
Human robot interaction, Social psychology, Evaluation framework, Expectation, Expectations gaps, Human behaviors, Humans-robot interactions, Interaction fields, Social robots, Social settings, Users' experiences, Man machine systems, Expectations, Human-robot interaction, User experience
National Category
Human Computer Interaction Robotics
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-21622 (URN)10.1007/978-3-031-05409-9_43 (DOI)000870114200043 ()2-s2.0-85133213973 (Scopus ID)978-3-031-05408-2 (ISBN)978-3-031-05409-9 (ISBN)
Conference
Thematic Area, HCI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 – July 1, 2022
Note

© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

© 2022 Springer Nature Switzerland AG. Part of Springer Nature.

Available from: 2022-07-14 Created: 2022-07-14 Last updated: 2023-12-07Bibliographically approved
4. Applying the Social Robot Expectation Gap Evaluation Framework
Open this publication in new window or tab >>Applying the Social Robot Expectation Gap Evaluation Framework
2023 (English)In: Human-Computer Interaction: Thematic Area, HCI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part III / [ed] Masaaki Kurosu; Ayako Hashizume, Cham: Springer, 2023, p. 169-188Conference paper, Published paper (Refereed)
Abstract [en]

Expectations shape our experience with the world, including our interaction with technology. There is a mismatch between whathumans expect of social robots and what they are actually capable of.Expectations are dynamic and can change over time. We have previ- AQ1ously developed a framework for studying these expectations over timein human-robot interaction (HRI). In this work, we applied the socialrobot expectation gap evaluation framework in an HRI scenario from aUX evaluation perspective, by analyzing a subset of data collected froma larger experiment. The framework is based on three factors of expectation: affect, cognitive processing, as well as behavior and performance. Four UX goals related to a human-robot interaction scenario were evaluated. Results show that expectations change over time with an overallimproved UX in the second interaction. Moreover, even though some UX goals were partly fulfilled, there are severe issues with the conversation between the user and the robot, ranging from the quality of theinteraction to the users’ utterances not being recognized by the robot.This work takes the initial steps towards disentangling how expectations work and change over time in HRI. Future work includes expanding the metrics to study expectations and to further validate the framework.

Place, publisher, year, edition, pages
Cham: Springer, 2023
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 14013
Keywords
Human-robot interaction, Social robots, Expectations, User experience, Evaluation, Expectation gap
National Category
Human Computer Interaction
Research subject
Interaction Lab (ILAB); INF302 Autonomous Intelligent Systems
Identifiers
urn:nbn:se:his:diva-23092 (URN)10.1007/978-3-031-35602-5_13 (DOI)001289342400013 ()2-s2.0-85173035452 (Scopus ID)978-3-031-35602-5 (ISBN)978-3-031-35601-8 (ISBN)
Conference
International Conference on Human-Computer Interaction HCI 2023, Thematic Area, HCI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023
Note

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023

Available from: 2023-08-15 Created: 2023-08-15 Last updated: 2024-09-27Bibliographically approved
5. Investigating NARS: Inconsistent Practice of Application and Reporting
Open this publication in new window or tab >>Investigating NARS: Inconsistent Practice of Application and Reporting
2023 (English)In: Proceedings of the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), IEEE, 2023, p. 922-927Conference paper, Published paper (Refereed)
Abstract [en]

The Negative Attitude toward Robots Scale (NARS) is one of the most common questionnaires used in the studies of human-robot interaction (HRI). It was established in 2004, and has since then been used in several domains to measure attitudes, both as main results and as a potential confounding factor. To better understand this important tool of HRI research, we reviewed the HRI literature with a specific focus on practice and reporting related to NARS. We found that the use of NARS is being increasingly reported, and that there is a large variation in how NARS is applied. The reporting is, however, often not done in sufficient detail, meaning that NARS results are often difficult to interpret, and comparing between studies or performing meta-analyses are even more difficult. After providing an overview of the current state of NARS in HRI, we conclude with reflections and recommendations on the practices and reporting of NARS.

Place, publisher, year, edition, pages
IEEE, 2023
Series
IEEE International Symposium on Robot and Human Interactive Communication proceedings, ISSN 1944-9445, E-ISSN 1944-9437
National Category
Robotics Human Aspects of ICT Interaction Technologies
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-23359 (URN)10.1109/RO-MAN57019.2023.10309650 (DOI)001108678600106 ()2-s2.0-85186997999 (Scopus ID)979-8-3503-3670-2 (ISBN)979-8-3503-3671-9 (ISBN)
Conference
IEEE International Workshop on Robot and Human Communication (ROMAN), August 28-31, 2023, Paradise Hotel, Busan, Korea
Available from: 2023-11-14 Created: 2023-11-14 Last updated: 2024-04-15Bibliographically approved
6. Previous Experience Matters: An in-Person Investigation of Expectations in Human–Robot Interaction
Open this publication in new window or tab >>Previous Experience Matters: An in-Person Investigation of Expectations in Human–Robot Interaction
2024 (English)In: International Journal of Social Robotics, ISSN 1875-4791, E-ISSN 1875-4805, Vol. 16, no 3, p. 447-460Article in journal (Refereed) Published
Abstract [en]

The human–robot interaction (HRI) field goes beyond the mere technical aspects of developing robots, often investigating how humans perceive robots. Human perceptions and behavior are determined, in part, by expectations. Given the impact of expectations on behavior, it is important to understand what expectations individuals bring into HRI settings and how those expectations may affect their interactions with the robot over time. For many people, social robots are not a common part of their experiences, thus any expectations they have of social robots are likely shaped by other sources. As a result, individual expectations coming into HRI settings may be highly variable. Although there has been some recent interest in expectations within the field, there is an overall lack of empirical investigation into its impacts on HRI, especially in-person robot interactions. To this end, a within-subject in-person study () was performed where participants were instructed to engage in open conversation with the social robot Pepper during two 2.5 min sessions. The robot was equipped with a custom dialogue system based on the GPT-3 large language model, allowing autonomous responses to verbal input. Participants’ affective changes towards the robot were assessed using three questionnaires, NARS, RAS, commonly used in HRI studies, and Closeness, based on the IOS scale. In addition to the three standard questionnaires, a custom question was administered to capture participants’ views on robot capabilities. All measures were collected three times, before the interaction with the robot, after the first interaction with the robot, and after the second interaction with the robot. Results revealed that participants to large degrees stayed with the expectations they had coming into the study, and in contrast to our hypothesis, none of the measured scales moved towards a common mean. Moreover, previous experience with robots was revealed to be a major factor of how participants experienced the robot in the study. These results could be interpreted as implying that expectations of robots are to large degrees decided before interactions with the robot, and that these expectations do not necessarily change as a result of the interaction. Results reveal a strong connection to how expectations are studied in social psychology and human-human interaction, underpinning its relevance for HRI research.

Place, publisher, year, edition, pages
Springer Nature, 2024
Keywords
Expectations, Previous experience, Social robot, Human–robot interaction, Experiment, Expectation gap, Pepper, GPT, Large language models
National Category
Robotics Human Computer Interaction Social Psychology
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-23641 (URN)10.1007/s12369-024-01107-3 (DOI)001172192700001 ()2-s2.0-85186211586 (Scopus ID)
Funder
University of Skövde
Note

CC BY 4.0 DEED

Published: 29 February 2024

Open access funding provided by University of Skövde.

Available from: 2024-02-29 Created: 2024-02-29 Last updated: 2024-06-13Bibliographically approved

Open Access in DiVA

fulltext(11156 kB)317 downloads
File information
File name FULLTEXT02.pdfFile size 11156 kBChecksum SHA-512
1645a67d7265f2bfabb886d1ae5223506d551548468dfcbee4d6d8fa1f2658734f573e946dbd5f34f1eec3d9410d43f1719992ff6231f4ae3ca703022e911d77
Type fulltextMimetype application/pdf

Authority records

Rosén, Julia

Search in DiVA

By author/editor
Rosén, Julia
By organisation
School of InformaticsInformatics Research Environment
RoboticsInteraction TechnologiesSocial PsychologyEthicsSocial PsychologyComputer Vision and Robotics (Autonomous Systems)Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 418 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 2336 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf