English
Related papers

Related papers: Multimodal Anomaly Detection for Human-Robot Inter…

200 papers

We explore new aspects of assistive living on smart human-robot interaction (HRI) that involve automatic recognition and online validation of speech and gestures in a natural interface, providing social features for HRI. We introduce a…

Multimedia · Computer Science 2017-11-07 A. Zlatintsi , I. Rodomagoulakis , P. Koutras , A. C. Dometios , V. Pitsikalis , C. S. Tzafestas , P. Maragos

Reliably detecting anomalies in a given set of images is a task of high practical relevance for visual quality inspection, surveillance, or medical image analysis. Autoencoder neural networks learn to reconstruct normal images, and hence…

Machine Learning · Computer Science 2019-01-21 Laura Beggel , Michael Pfeiffer , Bernd Bischl

Multi-task learning based video anomaly detection methods combine multiple proxy tasks in different branches to detect video anomalies in different situations. Most existing methods either do not combine complementary tasks to effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Mohammad Baradaran , Robert Bergevin

Human-robot interaction (HRI) research is progressively addressing multi-party scenarios, where a robot interacts with more than one human user at the same time. Conversely, research is still at an early stage for human-robot collaboration.…

Machine Learning · Computer Science 2023-11-16 Francesco Semeraro , Jon Carberry , Angelo Cangelosi

Shared dynamics models are important for capturing the complexity and variability inherent in Human-Robot Interaction (HRI). Therefore, learning such shared dynamics models can enhance coordination and adaptability to enable successful…

Robots are becoming increasingly popular in a wide range of environments due to their exceptional work capacity, precision, efficiency, and scalability. This development has been further encouraged by advances in Artificial Intelligence,…

Human-Computer Interaction · Computer Science 2023-12-14 Daniel Weber

ffective Human-Robot Interaction (HRI) is crucial for enhancing accessibility and usability in real-world robotics applications. However, existing solutions often rely on gesture- only or language-only commands, making interaction…

Human-Computer Interaction · Computer Science 2026-05-19 Yuzhi Lai , Shenghai Yuan , Peizheng Li , Boya Zhang , Benjamin Kiefer , Tianchen Deng , Andreas Zell

Multi-step manipulation tasks where robots interact with their environment and must apply process forces based on the perceived situation remain challenging to learn and prone to execution errors. Accurately simulating these tasks is also…

Robotics · Computer Science 2025-05-08 Christoph Willibald , Dongheui Lee

Anomaly detection and localization without any manual annotations and prior knowledge is a challenging task under the setting of unsupervised learning. The existing works achieve excellent performance in the anomaly detection, but with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Honghui Chen , Pingping Chen , Huan Mao , Mengxi Jiang

Anomaly detection is a core capability for robotic perception and industrial inspection, yet most existing benchmarks are collected under controlled conditions with fixed viewpoints and stable illumination, failing to reflect real…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Kaichen Zhou , Xinhai Chang , Taewhan Kim , Jiadong Zhang , Yang Cao , Chufei Peng , Fangneng Zhan , Hao Zhao , Hao Dong , Kai Ming Ting , Ye Zhu

Anomaly detection is facing with emerging challenges in many important industry domains, such as cyber security and online recommendation and advertising. The recent trend in these areas calls for anomaly detection on time-evolving data…

Machine Learning · Computer Science 2019-07-16 Zheng Gao , Lin Guo , Chi Ma , Xiao Ma , Kai Sun , Hang Xiang , Xiaoqiang Zhu , Hongsong Li , Xiaozhong Liu

Video anomaly detection (VAD) has been paid increasing attention due to its potential applications, its current dominant tasks focus on online detecting anomalies% at the frame level, which can be roughly interpreted as the binary or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Peng Wu , Jing Liu , Xiangteng He , Yuxin Peng , Peng Wang , Yanning Zhang

Human drivers can recognise fast abnormal driving situations to avoid accidents. Similar to humans, automated vehicles are supposed to perform anomaly detection. In this work, we propose the spatio-temporal graph auto-encoder for learning…

Robotics · Computer Science 2021-10-29 Julian Wiederer , Arij Bouazizi , Marco Troina , Ulrich Kressel , Vasileios Belagiannis

Video anomaly detection is an essential but challenging task. The prevalent methods mainly investigate the reconstruction difference between normal and abnormal patterns but ignore the semantics consistency between appearance and motion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Xiangyu Huang , Caidan Zhao , Zhiqiang Wu

Video anomaly detection deals with the recognition of abnormal events in videos. Apart from the visual signal, video anomaly detection has also been addressed with the use of skeleton sequences. We propose a holistic representation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Alexandros Stergiou , Brent De Weerdt , Nikos Deligiannis

We propose self-supervised deep algorithms to detect anomalies in heterogeneous autonomous systems using frontal camera video and IMU readings. Given that the video and IMU data are not synchronized, each of them are analyzed separately.…

Video anomaly detection is a challenging task because most anomalies are scarce and non-deterministic. Many approaches investigate the reconstruction difference between normal and abnormal patterns, but neglect that anomalies do not…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Guodong Shen , Yuqi Ouyang , Victor Sanchez

Video anomaly detection aims to find the events in a video that do not conform to the expected behavior. The prevalent methods mainly detect anomalies by snippet reconstruction or future frame prediction error. However, the error is highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Congqi Cao , Yue Lu , Yanning Zhang

This paper presents an improved system based on our prior work, designed to create explanations for autonomous robot actions during Human-Robot Interaction (HRI). Previously, we developed a system that used Large Language Models (LLMs) to…

Human intuition allows to detect abnormal driving scenarios in situations they never experienced before. Like humans detect those abnormal situations and take countermeasures to prevent collisions, self-driving cars need anomaly detection…

Robotics · Computer Science 2022-09-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis