English
Related papers

Related papers: Hearing the Robot's Mind: Sonification for Explici…

200 papers

SIREN is a flexible, extensible, and customizable web-based general-purpose interface for auditory data display (sonification). Designed as a digital audio workstation for sonification, synthesizers written in JavaScript using the Web Audio…

Sound · Computer Science 2024-04-01 Tristan Peng , Hongchan Choi , Jonathan Berger

Voice-based artificial intelligence is increasingly expected to adhere to human social conventions, but can it learn implicit cues that are not explicitly programmed? This study investigates whether state-of-the-art text-to-speech systems…

Computation and Language · Computer Science 2025-11-17 Eyal Rabin , Zohar Elyoseph , Rotem Israel-Fishelson , Adi Dali , Ravit Nussinson

While interacting with another person, our reactions and behavior are much affected by the emotional changes within the temporal context of the interaction. Our intrinsic affective appraisal comprising perception, self-assessment, and the…

Human-Computer Interaction · Computer Science 2019-08-05 Pablo Barros , Stefan Wermter , Alessandra Sciutti

In Security Operations Centres (SOCs) security practitioners work using a range of tools to detect and mitigate malicious computer-network activity. Sonification, in which data is represented as sound, is said to have potential as an…

Human-Computer Interaction · Computer Science 2018-07-19 Louise M. Axon , Bushra Alahmadi , Jason R. C. Nurse , Michael Goldsmith , Sadie Creese

Speech emotion recognition (SER) is an important aspect of effective human-robot collaboration and received a lot of attention from the research community. For example, many neural network-based architectures were proposed recently and…

Robotics · Computer Science 2018-04-09 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Children with Autism Spectrum Disorder find robots easier to communicate with than humans. Thus, robots have been introduced in autism therapies. However, due to the environmental complexity, the used robots often have to be controlled…

Robotics · Computer Science 2022-05-19 Michał Stolarz , Alex Mitrevski , Mohammad Wasil , Paul G. Plöger

There are many examples of cases where access to improved models of human behavior and cognition has allowed creation of robots which can better interact with humans, and not least in road vehicle automation this is a rapidly growing area…

Robotics · Computer Science 2022-08-25 Gustav Markkula , Mehmet Dogar

In recent years, the demand for social robots has grown, requiring them to adapt their behaviors based on users' states. Accurately assessing user experience (UX) in human-robot interaction (HRI) is crucial for achieving this adaptability.…

Robotics · Computer Science 2025-08-01 Ryo Miyoshi , Yuki Okafuji , Takuya Iwamoto , Junya Nakanishi , Jun Baba

Social robots have emerged as valuable contributors to individuals' well-being coaching. Notably, their integration into long-term human coaching trials shows particular promise, emphasizing a complementary role alongside human coaches…

Human-Computer Interaction · Computer Science 2025-09-05 Atikkhan Faridkhan Nilgar , Manuel Dietrich , Kristof Van Laerhoven

Nonverbal visual symbols and displays play an important role in communication when humans and robots work collaboratively. However, few studies have investigated how different types of non-verbal cues affect objective task performance,…

Robotics · Computer Science 2025-12-15 Matthew Ebisu , Hang Yu , Reuben Aronson , Elaine Short

Indirect speech acts (ISAs) are a natural pragmatic feature of human communication, allowing requests to be conveyed implicitly while maintaining subtlety and flexibility. Although advancements in speech recognition have enabled natural…

Human-Computer Interaction · Computer Science 2025-02-21 Yan Zhang , Tharaka Sachintha Ratnayake , Cherie Sew , Jarrod Knibbe , Jorge Goncalves , Wafa Johal

Human collaborators coordinate effectively their actions through both verbal and non-verbal communication. We believe that the the same should hold for human-robot teams. We propose a formalism that enables a robot to decide optimally…

Robotics · Computer Science 2017-06-16 Stefanos Nikolaidis , Minae Kwon , Jodi Forlizzi , Siddhartha Srinivasa

Owing to the recent success of Large Language Models, Modern A.I has been much focused on linguistic interactions with humans but less focused on non-linguistic forms of communication between man and machine. In the present paper, we test…

Being able to recognize emotions in human users is considered a highly desirable trait in Human-Robot Interaction (HRI) scenarios. However, most contemporary approaches rarely attempt to apply recognized emotional features in an active…

Human-Computer Interaction · Computer Science 2018-07-27 Nikhil Churamani , Alexander Sutherland , Pablo Barros

As robots enter everyday spaces like offices, the sounds they create affect how they are perceived. We present Music Mode, a novel mapping between a robot's joint motions and sounds, programmed by artists and engineers to make the robot…

Robotics · Computer Science 2024-04-02 Catie Cuan , Emre Fisher , Allison Okamura , Tom Engbersen

Emerging applications of robotics, and concerns about their impact, require the research community to put human-centric objectives front-and-center. To meet this challenge, we advocate an interdisciplinary approach, socially cognizant…

Recognition of social signals, from human facial expressions or prosody of speech, is a popular research topic in human-robot interaction studies. There is also a long line of research in the spoken dialogue community that investigates user…

Robotics · Computer Science 2017-06-12 Jekaterina Novikova , Christian Dondrup , Ioannis Papaioannou , Oliver Lemon

Sound plays a crucial role in enhancing user experience and immersiveness in Augmented Reality (AR). However, current platforms lack support for AR sound authoring due to limited interaction types, challenges in collecting and specifying…

Human-Computer Interaction · Computer Science 2024-08-13 Xia Su , Jon E. Froehlich , Eunyee Koh , Chang Xiao

When we go for a walk with friends, we can observe an interesting effect: From step lengths to arm movements - our movements unconsciously align; they synchronize. Prior research found that this synchronization is a crucial aspect of human…

Human-Computer Interaction · Computer Science 2023-05-01 Wieslaw Bartkowski , Andrzej Nowak , Filip Ignacy Czajkowski , Albrecht Schmidt , Florian Müller

Telepresence robots offer presence, embodiment, and mobility to remote users, making them promising options for homebound K-12 students. It is difficult, however, for robot operators to know how well they are being heard in remote and noisy…