Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The Social Robot Expectation Gap Evaluation Framework
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Interaction Lab (iLab))ORCID iD: 0000-0001-8642-336x
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. Department of Information Technology, Uppsala University, Sweden. (Interaction Lab (iLab))ORCID iD: 0000-0003-0946-7531
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Interaction Lab (iLab))ORCID iD: 0000-0002-6568-9342
2022 (English)In: Human-Computer Interaction: Technological Innovation: Thematic Area, HCI 2022 Held as Part of the 24th HCI International Conference, HCII 2022 Virtual Event, June 26 – July 1, 2022 Proceedings, Part II / [ed] Masaaki Kurosu, Cham: Springer Nature Switzerland AG , 2022, p. 590-610Conference paper, Published paper (Refereed)
Abstract [en]

Social robots are designed in manners that encourage users to interact and communicate with them in socially appropriate ways, which implies that these robots should copy many social human behaviors to succeed in social settings. However, this approach has implications for what humans subsequently expect from these robots. There is a mismatch between expected capabilities and actual capabilities of social robots. Expectations of social robots are thus of high relevance for the field of Human-Robot Interaction (HRI). While there is recent interest of expectations in the HRI field there is no widely adapted or well formulated evaluation framework that offers a deeper understanding of how these expectations affect the success of the interaction. With basis in social psychology, user experience, and HRI, we have developed an evaluation framework for studying users’ expectations of social robots. We have identified three main factors of expectations for assessing HRI: affect, cognitive processing, and behavior and performance. In our framework, we propose several data collection techniques and specific metrics for assessing these factors. The framework and its procedure enables analysis of the collected data via triangulation to identify problems and insights, which can grant us a richer understanding of the complex facets of expectations, including if the expectations were confirmed or disconfirmed in the interaction. Ultimately, by gaining a richer understanding of how expectations affect HRI, we can narrow the social robot expectation gap and create more successful interactions between humans and social robots in society. 

Place, publisher, year, edition, pages
Cham: Springer Nature Switzerland AG , 2022. p. 590-610
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 13303
Keywords [en]
Human robot interaction, Social psychology, Evaluation framework, Expectation, Expectations gaps, Human behaviors, Humans-robot interactions, Interaction fields, Social robots, Social settings, Users' experiences, Man machine systems, Expectations, Human-robot interaction, User experience
National Category
Human Computer Interaction Robotics
Research subject
Interaction Lab (ILAB)
Identifiers
URN: urn:nbn:se:his:diva-21622DOI: 10.1007/978-3-031-05409-9_43ISI: 000870114200043Scopus ID: 2-s2.0-85133213973ISBN: 978-3-031-05408-2 (print)ISBN: 978-3-031-05409-9 (electronic)OAI: oai:DiVA.org:his-21622DiVA, id: diva2:1683159
Conference
Thematic Area, HCI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 – July 1, 2022
Note

© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

© 2022 Springer Nature Switzerland AG. Part of Springer Nature.

Available from: 2022-07-14 Created: 2022-07-14 Last updated: 2023-12-07Bibliographically approved
In thesis
1. What did you expect?: A human-centered approach to investigating and reducing the social robot expectation gap
Open this publication in new window or tab >>What did you expect?: A human-centered approach to investigating and reducing the social robot expectation gap
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

We live in a complex world where we proactively plan and execute various behaviors by forming expectations in real time. Expectations are beliefs regarding the future state of affairs and they play an integral part of our perception, attention, and behavior. Over time, our expectations become more accurate as we interact with the world and others around us. People interact socially with other people by inferring others' purposes, intentions, preferences, beliefs, emotions, thoughts, and goals. Similar inferences may occur when we interact with social robots. With anthropomorphic design, these robots are designed to mimic people physically and behaviorally. As a result, users predominantly infer agency in social robots, often leading to mismatched expectations of the robots' capabilities, which ultimately influences the user experience. 

In this thesis, the role and relevance of users' expectations in first-hand social human-robot interaction (sHRI) was investigated. There are two major findings. First, in order to study expectations in sHRI, the social robot expectation gap evaluation framework was developed. This framework supports the systematic study and evaluation of expectations over time, considering the unique context where the interaction is unfolding. Use of the framework can inform sHRI researchers and designers on how to manage users’ expectations, not only in the design, but also during evaluation and presentation of social robots. Expectations can be managed by identifying what kinds of expectations users have and aligning these through design and dissemination which ultimately creates more transparent and successful interactions and collaborations. The framework is a tool for achieving this goal. Second, results show that previous experience has a strong impact on users’ expectations. People have different expectations of social robots and view social robots as both human-like and as machines. Expectations of social robots can vary according to the source of the expectation, with those who had previous direct experiences of robots having different expectations than those who relied on indirect experiences to generate expectations.    

One consequence of these results is that expectations can be a confounding variable in sHRI research. Previous experience with social robots can prime users in future interactions with social robots. These findings highlight the unique experiences users have, even when faced with the same robot. Users' expectations and how they change over time shapes the users’ individual needs and preferences and should therefore be considered in the interpretation of sHRI. In doing so, the social robot expectation gap can be reduced.

Abstract [sv]

Vi lever i en komplex värld och för att kunna hantera denna komplexitet formar vi förväntningar. Förväntningar är antaganden om framtida tillstånd och är en vital del av vår perception, uppmärksamhet och beteende. Genom att interagera med omvärlden och andra människor blir våra förväntningar mer precisa och korrekta över tid. I en social interaktion behöver vi förstå den andra personens syften, avsikter, preferenser, övertygelser, känslor, tankar och mål. Sociala robotar är utformade för att skapa liknande inferenser när användare interagerar med dem. Detta kan leda till missbedömningar mellan vad vi förväntar oss av sociala robotar och vad dessa artefakter är kapabla till, vilket påverkar användarupplevelsen av sociala robotar.

I den här avhandlingen presenteras den forskning som har utförts för att studera rollen och relevansen av människors förväntningar i social människa-robotinteraktion (sMRI). Resultaten kan delas in i två större fynd. Det första fyndet är ett utvärderingsramverk som ämnar att systematiskt studera användares förväntningar av sociala robotar i en interaktion, med fokus på hur förväntningar ändras över tid i en interaktion, med interaktionens unika kontext i åtanke. Ramverket är menat för designers av sociala robotar och forskare inom sMRI-fältet för att bättre studera, hantera, och förstå förväntningar, både i robotarnas design och i robotarnas agerande. Det andra fyndet består av de empiriska resultat som visar hur tidigare erfarenheter påverkar användares förväntningar. Förväntningarna baseras till stor del på vilka typer av tidigare erfarenheter användare har, där de med direkta erfarenheter av robotar har andra förväntningar än de med indirekta erfarenheter. Vidare visar resultaten att användare ser sociala robotar både som människolika och som maskiner samtidigt.

Förväntningar kan också ses som en bakomliggande variabel inom sMRI-forskning eftersom tidigare erfarenheter kan påverka deltagare i kommande interaktioner med sociala robotar. Resultaten visar även att användarupplevelsen är unik för varje användare, även om roboten är densamma, vilket bör tas i åtanke när resultat tolkas i en sMRI-kontext. Genom att ha förväntningar i åtanke kan vi minska det gap som uppstår mellan människors förväntningar av sociala robotar och robotarnas faktiska förmågor. På så sätt kan vi främja positiva användarupplevelser och förbättra interaktionen mellan människa och robot.

Place, publisher, year, edition, pages
Skövde: University of Skövde, 2024. p. 220
Series
Dissertation Series ; 55
National Category
Robotics Interaction Technologies Social Psychology Ethics Social Psychology Computer Vision and Robotics (Autonomous Systems) Human Computer Interaction
Research subject
Interaction Lab (ILAB)
Identifiers
urn:nbn:se:his:diva-23414 (URN)978-91-987906-9-6 (ISBN)
Public defence
2024-01-19, G207, Högskolevägen 3, Skövde, 13:00 (English)
Opponent
Supervisors
Note

Ett av sju delarbeten (övriga se rubriken Delarbeten/List of papers):

VII Lindblom, Jessica, Rosén, Julia, Lamb, Maurice, and Billing, Erik (Manuscript). “Disentangling People’s Experiences and Expectations when Interacting with the Social Robot Pepper: A Qualitative Analysis”. In: Manuscript for scientific journal, pp. 1–41.

Available from: 2023-12-07 Created: 2023-12-07 Last updated: 2024-02-29Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Rosén, JuliaLindblom, JessicaBilling, Erik

Search in DiVA

By author/editor
Rosén, JuliaLindblom, JessicaBilling, Erik
By organisation
School of InformaticsInformatics Research Environment
Human Computer InteractionRobotics

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 303 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf