Högskolan i Skövde

his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Multiple Roles of Multimodality Among Interacting Agents
University of Skövde, School of Informatics. University of Skövde, Informatics Research Environment. (Interaction Lab)ORCID iD: 0000-0002-8937-8063
Donders Institute for Brain, Cognition, and Behaviour, Radboud University, The Netherlands.ORCID iD: 0000-0003-1177-4119
2023 (English)In: ACM Transactions on Human-Robot Interaction, E-ISSN 2573-9522, Vol. 12, no 2, article id 17Article in journal (Refereed) Published
Abstract [en]

The term ‘multimodality’ has come to take on several somewhat different meanings depending on the underlying theoretical paradigms and traditions, and the purpose and context of use. The term is closely related to embodiment, which in turn is also used in several different ways. In this paper, we elaborate on this connection and propose that a pragmatic and pluralistic stance is appropriate for multimodality. We further propose a distinction between first and second order effects of multimodality; what is achieved by multiple modalities in isolation and the opportunities that emerge when several modalities are entangled. This highlights questions regarding ways to cluster or interchange different modalities, for example through redundancy or degeneracy. Apart from discussing multimodality with respect to an individual agent, we further look to more distributed agents and situations where social aspects become relevant.

In robotics, understanding the various uses and interpretations of these terms can prevent miscommunication when designing robots, as well as increase awareness of the underlying theoretical concepts. Given the complexity of the different ways in which multimodality is relevant in social robotics, this can provide the basis for negotiating appropriate meanings of the term at a case by case basis.

Place, publisher, year, edition, pages
ACM Digital Library, 2023. Vol. 12, no 2, article id 17
Keywords [en]
Multimodality, Embodiment, Robotics, Sensors
National Category
Philosophy Human Aspects of ICT Robotics and automation
Research subject
Interaction Lab (ILAB)
Identifiers
URN: urn:nbn:se:his:diva-21986DOI: 10.1145/3549955ISI: 001020329300004Scopus ID: 2-s2.0-85164237637OAI: oai:DiVA.org:his-21986DiVA, id: diva2:1706835
Note

CC BY 4.0

Available from: 2022-10-27 Created: 2022-10-27 Last updated: 2025-02-05Bibliographically approved

Open Access in DiVA

fulltext(207 kB)116 downloads
File information
File name FULLTEXT01.pdfFile size 207 kBChecksum SHA-512
82ffd13e2ad8b7530a0278a69f2ba1bd88b6168cd2cfd9b8c37dc74ec1eb5528ccfc776bc767ec876ee22118461732c6f8a7f5d1b5000b92c3dba4805be17563
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Lagerstedt, ErikThill, Serge

Search in DiVA

By author/editor
Lagerstedt, ErikThill, Serge
By organisation
School of InformaticsInformatics Research Environment
In the same journal
ACM Transactions on Human-Robot Interaction
PhilosophyHuman Aspects of ICTRobotics and automation

Search outside of DiVA

GoogleGoogle Scholar
Total: 116 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 313 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • apa-cv
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf