Smart Beamforming in Verbal Human-Machine Interaction for Humanoid Robots

The ongoing industrial revolution involves an increasing need for human-machine communication in all areas of everyday life. Efficient and flawless human-machine communication becomes a large challenge in crowded environments.The communication scheme used in present robotic and humanoid systems usua...

Full description

Saved in:
Bibliographic Details
Published in:IEEE robotics and automation letters Vol. 8; no. 8; pp. 4689 - 4696
Main Authors: Klin, Bartlomiej, Podpora, Michal, Beniak, Ryszard, Gardecki, Arkadiusz, Rut, Joanna
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.08.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Acoustics
Array signal processing
Beamforming
Communication
design and human factors
Humanoid
Humanoid robots
long term interaction
Man-machine systems
multi-modal perception for HRI
natural dialog for HRI
Oral communication
Robot vision systems
Robots
Sensors
Software-hardware integration for robot systems
Speech recognition
Visual perception
Visual signals
ISSN:2377-3766, 2377-3766
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The ongoing industrial revolution involves an increasing need for human-machine communication in all areas of everyday life. Efficient and flawless human-machine communication becomes a large challenge in crowded environments.The communication scheme used in present robotic and humanoid systems usually does not assume simultaneous interaction with multiple interlocutors (e.g. robot and two talking persons) as well as the associated mechanisms for distinguishing between speakers, which is being simplified to non-overlapping, sequential exchange of questions and answers between two interlocutors. This article presents a novel framework outlines to improve human-machine communication in the humanoid robot area. Concepts of acoustic-visual beamforming are already known, the implementation of which is an acoustic camera. However, according to the authors, combining acoustic and visual perception requires significant changes in the approach to the design of robotic systems in order to be able to take full advantage of the multi-talker capability. The perception of an interlocutor is more natural when a human is able to perceive multi-channel information. This provides the acoustic-visual sensors to be able to support beamforming of audio signal and assign these signals to every interlocutor in the engagement zone of a humanoid robot. This can be useful in a time regime adequate for a conversation.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2377-3766
2377-3766
DOI:10.1109/LRA.2023.3288381