English
Related papers

Related papers: Situation-Aware Environment Perception Using a Mul…

200 papers

Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in…

Robotics · Computer Science 2026-05-13 Tharun Sethuraman , Subham Agrawal , Nils Dengler , Jorge de Heuvel , Teena Hassan , Maren Bennewitz

Autonomous vehicles rely on a variety of sensors to gather information about their surrounding. The vehicle's behavior is planned based on the environment perception, making its reliability crucial for safety reasons. The active LiDAR…

Robotics · Computer Science 2023-06-07 Mariella Dreissig , Dominik Scheuble , Florian Piewak , Joschka Boedecker

In this paper we introduce a general estimation methodology for learning a model of human perception and control in a sensorimotor control task based upon a finite set of demonstrations. The model's structure consists of i the agent's…

Machine Learning · Computer Science 2025-05-02 Ran Wei , Anthony D. McDonald , Alfredo Garcia , Gustav Markkula , Johan Engstrom , Matthew O'Kelly

This paper introduces a multi-agent framework for comprehensive highway scene understanding, designed around a mixture-of-experts strategy. In this framework, a large generic vision-language model (VLM), such as GPT-4o, is contextualized…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yunxiang Yang , Ningning Xu , Jidong J. Yang

Accurately predicting human behaviors is crucial for mobile robots operating in human-populated environments. While prior research primarily focuses on predicting actions in single-human scenarios from an egocentric view, several robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Utsav Panchal , Yuchen Liu , Luigi Palmieri , Ilche Georgievski , Marco Aiello

Road traffic accidents remain a significant global concern, with the majority attributed to human factors such as driver distraction and fatigue. This study proposes a camera-based approach to derive useful indicators to assess driver…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Carmelo Scribano , Giovanni Cappelletti , Elia Giacobazzi , Giorgia Franchini , Paolo Burgio , Marko Bertogna

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

In urban cities, visual information on and along roadways is likely to distract drivers and lead to missing traffic signs and other accident-prone (AP) features. To avoid accidents due to missing these visual cues, this paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sumit Mishra , Praveen Kumar Rajendran , Luiz Felipe Vecchietti , Dongsoo Har

Accurately and promptly predicting accidents among surrounding traffic agents from camera footage is crucial for the safety of autonomous vehicles (AVs). This task presents substantial challenges stemming from the unpredictable nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haicheng Liao , Haoyu Sun , Huanming Shen , Chengyue Wang , Kahou Tam , Chunlin Tian , Li Li , Chengzhong Xu , Zhenning Li

Comprehensive environment perception is essential for autonomous vehicles to operate safely. It is crucial to detect both dynamic road users and static objects like traffic signs or lanes as these are required for safe motion planning.…

Robotics · Computer Science 2025-12-17 Jörg Gamerdinger , Sven Teufel , Georg Volk , Oliver Bringmann

We present a LiDAR-based and real-time capable 3D perception system for automated driving in urban domains. The hierarchical system design is able to model stationary and movable parts of the environment simultaneously and under real-time…

Robotics · Computer Science 2020-05-08 Jens Rieken , Markus Maurer

Recognizing the surrounding environment at low latency is critical in autonomous driving. In real-time environment, surrounding environment changes when processing is over. Current detection models are incapable of dealing with changes in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Wonwoo Jo , Kyungshin Lee , Jaewon Baik , Sangsun Lee , Dongho Choi , Hyunkyoo Park

Human decision-making heavily relies on active sensing, a well-documented cognitive behaviour for evidence gathering to accommodate ever-changing environments. However, its operational mechanism in the real world remains non-trivial.…

Artificial Intelligence · Computer Science 2026-01-09 Hongliang Lu , Yunmeng Liu , Junjie Yang

The field of autonomous driving has grown tremendously over the past few years, along with the rapid progress in sensor technology. One of the major purposes of using sensors is to provide environment perception for vehicle understanding,…

Robotics · Computer Science 2020-08-07 Zhi Yan , Li Sun , Tomas Krajnik , Yassine Ruichek

In recent years, there has been a notable increase in the development of autonomous vehicle (AV) technologies aimed at improving safety in transportation systems. While AVs have been deployed in the real-world to some extent, a full-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shounak Sural , Naren , Ragunathan Rajkumar

This work proposes a perception system for autonomous vehicles and advanced driver assistance specialized on unpaved roads and off-road environments. In this research, the authors have investigated the behavior of Deep Learning algorithms…

It will be increasingly common for robots to operate in cluttered human-centered environments such as homes, workplaces, and hospitals, where the robot is often tasked to maintain perception constraints, such as monitoring people or…

Robotics · Computer Science 2026-03-05 Qingxi Meng , Emiliano Flores , Thai Duong , Vaibhav Unhelkar , Lydia E. Kavraki

Autonomous systems (AS) are systems that can adapt and change their behavior in response to unanticipated events and include systems such as aerial drones, autonomous vehicles, and ground/aquatic robots. AS require a wide array of sensors,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Yifan Zhang , Arnav Vaibhav Malawade , Xiaofang Zhang , Yuhui Li , DongHwan Seong , Mohammad Abdullah Al Faruque , Sitao Huang

Several researchers have focused on studying driver cognitive behavior and mental load for in-vehicle interaction while driving. Adaptive interfaces that vary with mental and perceptual load levels could help in reducing accidents and…

Human-Computer Interaction · Computer Science 2022-09-30 Amr Gomaa , Alexandra Alles , Elena Meiser , Lydia Helene Rupp , Marco Molz , Guillermo Reyes

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar