6th Copenhagen Multimodality Day: Interacting with AI

Multimodality Day is an annual research seminar held at the University of Copenhagen. The aim of the seminar is to bring together researchers who study interaction from an ethnomethodological multimodal perspective. This seminar is founded and organized by Brian L. Due. 

This year’s focus is on A.I. and it is supported by the ongoing Velux project BlindTech. Questions can be raised to bdue@hum.ku.dk. 

Practical information

This one-day research seminar is being prepared and organized by the Centre for Interaction Research and Communication Design at the University of Copenhagen. The day is planned as a single-track research seminar. It is being organized as a hybrid format, where physical participation is possible on University of Copenhagen campus (if the current regulations allows so), and online participation and presentations via a video link.   

Register for the research seminar.

Participation is possible both with and without accepted paper presentations. Please note in the registration form if you will participate without presenting.

Programme

09:00 – 09:20: Croissant and coffee

09:30 – 10:30: Keynote speech

Professor Morana Alač, University of California, San Diego
On Video Ethnography: A look from a robot's eye

10:30 – 10:45: Break

10:45 – 12:15: Mobile robots in interaction

Mathias Broth, Linköping University, Barry Brown, Stockholm University, Erik Vinkhuizen, Senior Researcher at Nissan Motor Corporation and Erik Stayton, Massachusetts Institute of Technology
Doing the right thing at the wrong time: the dangerous driving of WAYMO

Philippe Sormani, University of Lausanne / CEMS, EHESS, Paris
Relocating the Mobot Multiple: Instructed Agency as a Tutorial Problem with Multimodal Affordances

Brian L. Due, University of Copenhagen
Robodog: Exploring the Spot robot as a guide dog for visually impaired people

12:15 – 13:15: Lunch

13:15 – 13:45: 

Jakub Mlynár, University of Applied Sciences of Western Switzerland, Andreas Liesenfeld, The Hong Kong Polytechnic
University, Renata Topinková, Czech Academy of Sciences, Wyke Stommel, Radboud University, Lynn de Rijk,
Radboud University and Saul Albert, Loughborough University
An artificial turn in social interaction research?

13:45 – 14:45:  Keynote speech

Professor Keiichi Yamazaki, Graduate School of Humanities and Social Sciences, Saitama University and Akiko Yamazaki, Associate  Professor, Graduate School of Media Sciences, Tokyo University of Technology
Ethnomethodology and robotic research

14:45 – 15:15: Coffee break

Session one

15:15 – 17:45:  Social robots in interaction

Antonia Krummheuer, University of Aalborg
Technical assistance? How multimodal interaction analysis can help to
understand and inform technical assistance in assistive shopping robots

Xinzhi XU, The Chinese University of Hong Kong
Customer’s abuse of service robots 

Hannah Pelikan, Leelo Keevallik and Mathias Broth, Linköping University
When a toy robot comes to life. The interactional achievement of agency

Ali Reza Majlesi1, Catrin Norrby1, Gustav Lymer1, Olov Engwall2, Ronald Cumbal Guerron2, Silvia Kunitz1, Sylvaine Tuncer, King’s College London (1 Stockholm University, 2 Royal Institute of Technology)
The emergence of trouble in turn taking in human-robot interactions: the case of projection and anticipation of turn completion

Sylvaine Tuncer, King’s College London, Christian Licoppe, Télécom ParisTech, Paul Luff, King's College London, and Christian Heath, King’s College London
The production and re-production of embodied action: recipient-design in human-robot interactions

Session two

15:15 – 17:45: Virtual robots in interaction

Anastasia Egorova, Public Opinion Foundation, and Nils Klowait, Russian Presidential Academy of National Economy and Public Administration
Conversational closing in the case of human-robot interaction

Jonas Ivarsson and Oskar Lindwall, University of Gothenburg 
Trust, Talk & Robots

Henrike Helmer and Silke Reineke, University of Mannheim
‘I did not catch what she said’ – Coordinating interaction with Virtual Assistants in cars

Louise Lüchow, University of Copenhagen
The Multi-Sensorial Perception of Spatial Relations: Blind Peoples Use of Smartphones

Saul Albert, Magnus Hamann, and Elizabeth Stokoe Loughborough University
The interactional coordination of virtual and personal assistants in a homecare setting

17:45 – 18:00: Closing

19:00: Dinner downtown

Travel

The seminar will take place at University of Copenhagen, Department of Nordic Studies and Linguistics, Denmark. If that is allowable at the time. Online presentations are welcome.   

Organizing and scientific committee

The Centre for Interaction Research and Communication Design, University of Copenhagen, is organizing the research seminar and the scientific committee consists of Brian L. Due and an anonymous reviewer.

Any comments or questions can be addressed to Brian Due at bdue@hum.ku.dk