Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perfor...

Descripción completa

Detalles Bibliográficos
Autores: Rivera Pinto, Andoni, Kildal, Johan, Lazkano Ortega, Elena
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universidad del País Vasco
Repositorio:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/49635
Acceso en línea:http://hdl.handle.net/10810/49635
Access Level:acceso abierto
Palabra clave:human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
id ES_ea7c4bf6a6e149bb4268fc045a3bfcd1
oai_identifier_str oai:addi.ehu.eus:10810/49635
network_acronym_str ES
network_name_str España
spelling Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot Rivera Pinto, Andoni Kildal, Johan Lazkano Ortega, Elena human–robot interaction cobot augmented reality mid-air haptics hologram multimodal In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial. MDPI http://hdl.handle.net/10810/49635
title Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
spellingShingle Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
Rivera Pinto, Andoni
human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
title_short Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_full Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_fullStr Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_full_unstemmed Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
title_sort Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot
author Rivera Pinto, Andoni
author_facet Rivera Pinto, Andoni
Kildal, Johan
Lazkano Ortega, Elena
author_role author
author2 Kildal, Johan
Lazkano Ortega, Elena
author2_role author
author
topic human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
topic_facet human–robot interaction
cobot
augmented reality
mid-air haptics
hologram
multimodal
description In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.
publishDate 2020
format article
url http://hdl.handle.net/10810/49635
eu_rights_str_mv openAccess
publisher MDPI
institution Universidad del País Vasco
collection Addi. Archivo Digital para la Docencia y la Investigación
reponame_str Addi. Archivo Digital para la Docencia y la Investigación
instname_str Universidad del País Vasco
_version_ 1878442413565935616
publishDateSort 2020
author_browse Kildal, Johan
Lazkano Ortega, Elena
Rivera Pinto, Andoni
publisherStr MDPI
score 6,9303427