English
Related papers

Related papers: Deep Occupancy-Predictive Representations for Auto…

200 papers

Autonomous agents embedded in a physical environment need the ability to recognize objects and their properties from sensory data. Such a perceptual ability is often implemented by supervised machine learning models, which are pre-trained…

Understanding and anticipating human activity is an important capability for intelligent systems in mobile robotics, autonomous driving, and video surveillance. While learning from demonstrations with on-site collected trajectory data is a…

Robotics · Computer Science 2021-02-18 Andrey Rudenko , Luigi Palmieri , Johannes Doellinger , Achim J. Lilienthal , Kai O. Arras

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

This paper addresses the problem of learning instantaneous occupancy levels of dynamic environments and predicting future occupancy levels. Due to the complexity of most real-world environments, such as urban streets or crowded areas, the…

Robotics · Computer Science 2019-12-05 Vitor Guizilini , Ransalu Senanayake , Fabio Ramos

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

Robotics · Computer Science 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

Understanding the geometric relationships between objects in a scene is a core capability in enabling both humans and autonomous agents to navigate in new environments. A sparse, unified representation of the scene topology will allow…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Zachary Seymour , Niluthpol Chowdhury Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Occluded traffic agents pose a significant challenge for autonomous vehicles, as hidden pedestrians or vehicles can appear unexpectedly, yet this problem remains understudied. Existing learning-based methods, while capable of inferring the…

Robotics · Computer Science 2026-01-30 Anna Rothenhäusler , Markus Mazzola , Andreas Look , Raghu Rajan , Joschka Bödecker

We focus on the problem of predicting future states of entities in complex, real-world driving scenarios. Previous research has used low-level signals to predict short time horizons, and has not addressed how to leverage key assets relied…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 Joey Hong , Benjamin Sapp , James Philbin

Temporal prediction is critical for making intelligent and robust decisions in complex dynamic environments. Motion prediction needs to model the inherently uncertain future which often contains multiple potential outcomes, due to…

Machine Learning · Computer Science 2019-12-10 Yichuan Charlie Tang , Ruslan Salakhutdinov

Making the right decision in traffic is a challenging task that is highly dependent on individual preferences as well as the surrounding environment. Therefore it is hard to model solely based on expert knowledge. In this work we use Deep…

Machine Learning · Computer Science 2020-02-04 Peter Wolf , Karl Kurzer , Tobias Wingert , Florian Kuhnt , J. Marius Zöllner

Trajectory modelling had been the principal research area for understanding and anticipating human behaviour. Predicting the dynamic path by observing the agent and its surrounding environment are essential for applications such as…

Robotics · Computer Science 2020-03-03 Tin Lai , Weiming Zhi , Fabio Ramos

We introduce environment predictive coding, a self-supervised approach to learn environment-level representations for embodied agents. In contrast to prior work on self-supervised learning for images, we aim to jointly encode a series of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Santhosh K. Ramakrishnan , Tushar Nagarajan , Ziad Al-Halah , Kristen Grauman

In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay.…

Networking and Internet Architecture · Computer Science 2017-09-22 Giorgio Stampa , Marta Arias , David Sanchez-Charles , Victor Muntes-Mulero , Albert Cabellos

Creating accurate spatial representations that take into account uncertainty is critical for autonomous robots to safely navigate in unstructured environments. Although recent LIDAR based mapping techniques can produce robust occupancy…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Anthony Tompkins , Ransalu Senanayake , Fabio Ramos

Connected automated driving has the potential to significantly improve urban traffic efficiency, e.g., by alleviating issues due to occlusion. Cooperative behavior planning can be employed to jointly optimize the motion of multiple…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

Machine Learning · Computer Science 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

We are concerned with the question of how an agent can acquire its own representations from sensory data. We restrict our focus to learning representations for long-term planning, a class of problems that state-of-the-art learning methods…

Machine Learning · Computer Science 2022-05-05 Steven James , Benjamin Rosman , George Konidaris

The exploration of high-speed movement by robots or road traffic agents is crucial for autonomous driving and navigation. Trajectory prediction at high speeds requires considering historical features and interactions with surrounding…

Robotics · Computer Science 2024-05-14 Yao Liu , Ruoyu Wang , Yuanjiang Cao , Quan Z. Sheng , Lina Yao