English
Related papers

Related papers: Multimodal Perception System for Real Open Environ…

200 papers

One of the core challenges in open-plan workspaces is to ensure a good level of concentration for the workers while performing their tasks. Hence, being able to infer concentration levels of workers will allow building designers, managers,…

Computers and Society · Computer Science 2020-05-29 Mohammad Saiedur Rahaman , Jonathan Liono , Yongli Ren , Jeffrey Chan , Shaw Kudo , Tim Rawling , Flora D. Salim

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Effective fusion of complementary information captured by multi-modal sensors (visible and infrared cameras) enables robust pedestrian detection under various surveillance situations (e.g. daytime and nighttime). In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Yanpeng Cao , Dayan Guan , Yulun Wu , Jiangxin Yang , Yanlong Cao , Michael Ying Yang

Predicting the motion of other road agents enables autonomous vehicles to perform safe and efficient path planning. This task is very complex, as the behaviour of road agents depends on many factors and the number of possible future…

With the increasing presence of service robots and autonomous vehicles in human environments, navigation systems need to evolve beyond simple destination reach to incorporate social awareness. This paper introduces GSON, a novel group-based…

Robotics · Computer Science 2025-07-30 Shangyi Luo , Peng Sun , Ji Zhu , Yuhong Deng , Cunjun Yu , Anxing Xiao , Xueqian Wang

Predicting the future interaction of objects when they come into contact with their environment is key for autonomous agents to take intelligent and anticipatory actions. This paper presents a perception framework that fuses visual and…

Machine Learning · Computer Science 2021-01-21 Sahand Rezaei-Shoshtari , Francois Robert Hogan , Michael Jenkin , David Meger , Gregory Dudek

By the year 2023, the global population of individuals with impaired vision has surpassed 220 million. People with impaired vision will find it difficult while finding path or avoiding obstacles, and must ask for auxiliary tools for help.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Feifan Yan , Tianle Zeng , Meixi He

Inertial navigation systems for pedestrians are infrastructure-less and can achieve sub-meter accuracy in the short/medium period. However, when low-cost inertial measurement units (IMU) are employed for their implementation, they suffer…

Robotics · Computer Science 2015-03-30 Francesco Montorsi , Fabrizio Pancaldi , Giorgio M. Vitetta

Trajectory forecasting, or trajectory prediction, of multiple interacting agents in dynamic scenes, is an important problem for many applications, such as robotic systems and autonomous driving. The problem is a great challenge because of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yanliang Zhu , Dongchun Ren , Mingyu Fan , Deheng Qian , Xin Li , Huaxia Xia

Lower limb prosthesis can benefit from embedded systems capable of applying computer vision techniques to enhance autonomous control and context awareness for intelligent decision making. In order to fill in the gap of current literature of…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Rafael L. da Silva , Nathan Starliper , Boxuan Zhong , He Helen Huang , Edgar Lobaton

For autonomous navigation and robotic applications, sensing the environment correctly is crucial. Many sensing modalities for this purpose exist. In recent years, one such modality that is being used is in-air imaging sonar. It is ideal in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Wouter Jansen , Dennis Laurijssen , Robin Kerstens , Walter Daems , Jan Steckel

Road surface classification (RSC) is a key enabler for environment-aware predictive maintenance systems. However, existing RSC techniques often fail to generalize beyond narrow operational conditions due to limited sensing modalities and…

Individuals who are differently-able in vision cannot proceed with their day-to-day activities as smoothly as other people do. Especially independent walking is a hard target to achieve with their visual impairment. Assistive electronic…

Human-Computer Interaction · Computer Science 2025-01-28 Chathurika S. Silva , Prasad Wimalaratne

The growing demand for intelligent environments unleashes an extraordinary cycle of privacy-aware applications that makes individuals' life more comfortable and safe. Examples of these applications include pedestrian tracking systems in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Masakazu Ohno , Riki Ukyo , Tatsuya Amano , Hamada Rizk , Hirozumi Yamaguchi

Current control strategies for powered lower limb prostheses often lack awareness of the environment and the user's intended interactions with it. This limitation becomes particularly apparent in complex terrains. Obstacle negotiation, a…

Robotics · Computer Science 2025-07-03 Haosen Xing , Haoran Ma , Sijin Zhang , Hartmut Geyer

Four-wheel Independent Steering (4WIS) vehicles have attracted increasing attention for their superior maneuverability. Human drivers typically choose to cross or drive over the low-profile obstacles (e.g., plastic bags) to efficiently…

Robotics · Computer Science 2026-04-08 Jingjia Teng , Yang Li , Yougang Bian , Manjiang Hu , Yingbai Hu , Guofa Li , Jianqiang Wang

Rapid advancements in driver-assistance technology will lead to the integration of fully autonomous vehicles on our roads that will interact with other road users. To address the problem that driverless vehicles make interaction through eye…

We tackle the problem of perceptive locomotion in dynamic environments. In this problem, a quadrupedal robot must exhibit robust and agile walking behaviors in response to environmental clutter and moving obstacles. We present a…

Robotics · Computer Science 2023-02-21 Mingyo Seo , Ryan Gupta , Yifeng Zhu , Alexy Skoutnev , Luis Sentis , Yuke Zhu

Assistive robotic devices, like soft lower-limb exoskeletons or exosuits, are widely spreading with the promise of helping people in everyday life. To make such systems adaptive to the variety of users wearing them, it is desirable to endow…

In this paper, a multi-modal 360$^{\circ}$ framework for 3D object detection and tracking for autonomous vehicles is presented. The process is divided into four main stages. First, images are fed into a CNN network to obtain instance…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jorge Beltrán , Carlos Guindel , Irene Cortés , Alejandro Barrera , Armando Astudillo , Jesús Urdiales , Mario Álvarez , Farid Bekka , Vicente Milanés , Fernando García