English
Related papers

Related papers: Driving from Vision through Differentiable Optimal…

200 papers

In this paper, we present a novel information processing architecture for safe deep learning-based visual navigation of autonomous systems. The proposed information processing architecture is used to support a perceptual attention-based…

Robotics · Computer Science 2019-10-17 Keuntaek Lee , Gabriel Nakajima An , Viacheslav Zakharov , Evangelos A. Theodorou

We present a parallelized differentiable traffic simulator based on the Intelligent Driver Model (IDM), a car-following framework that incorporates driver behavior as key variables. Our vehicle simulator efficiently models vehicle motion,…

Robotics · Computer Science 2025-02-19 Sanghyun Son , Laura Zheng , Brian Clipp , Connor Greenwell , Sujin Philip , Ming C. Lin

Safety in obstacle avoidance is critical for autonomous driving. While model predictive control (MPC) is widely used, simplified prediction models such as linearized or single-track vehicle models introduce discrepancies between predicted…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Shiming Fang , Xilin Li , Changzhi Wu , Kaiyan Yu

The paper presents a strategy for the control of anautonomous racing car on a pre-mapped track. Using a dynamic model of the vehicle, the optimal racing line is computed, taking track boundaries into account. With the optimal racing line as…

Differentiable optimal control, particularly differentiable nonlinear model predictive control (NMPC), provides a powerful framework that enjoys the complementary benefits of machine learning and control theory. A key enabler of…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Yuankun Chen , Zifei Nie , Xun Gong , Yunfeng Hu , Hong Chen

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Model predictive control (MPC) is an effective method for controlling robotic systems, particularly autonomous aerial vehicles such as quadcopters. However, application of MPC can be computationally demanding, and typically requires…

Machine Learning · Computer Science 2016-02-17 Tianhao Zhang , Gregory Kahn , Sergey Levine , Pieter Abbeel

Neural networks have been increasingly employed in Model Predictive Controller (MPC) to control nonlinear dynamic systems. However, MPC still poses a problem that an achievable update rate is insufficient to cope with model uncertainty and…

Robotics · Computer Science 2022-07-15 Taekyung Kim , Hojin Lee , Seongil Hong , Wonsuk Lee

Motion planning for autonomous vehicles requires spatio-temporal motion plans (i.e. state trajectories) to account for dynamic obstacles. This requires a trajectory tracking control process which faithfully tracks planned trajectories. In…

Robotics · Computer Science 2018-11-13 Peng Liu , Brian Paden , Umit Ozguner

For driver observation frameworks, clean datasets collected in controlled simulated environments often serve as the initial training ground. Yet, when deployed under real driving conditions, such simulator-trained models quickly face the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Walter Morales-Alvarez , Novel Certad , Alina Roitberg , Rainer Stiefelhagen , Cristina Olaverri-Monreal

In recent years, visual sensors have been quickly improving towards mimicking the visual information acquisition process of human brain by responding to illumination changes as they occur in time rather than at fixed time intervals. In this…

Image and Video Processing · Electrical Eng. & Systems 2025-09-24 Catarina Brites , João Ascenso

Understanding and modeling human driver behavior is crucial for advanced vehicle development. However, unique driving styles, inconsistent behavior, and complex decision processes render it a challenging task, and existing approaches often…

Robotics · Computer Science 2020-02-18 Stefan Löckel , Jan Peters , Peter van Vliet

The complex tasks such as surveillance, construction, search and rescue can benefit of the maneuverability of multirotor Micro Aerial Vehicles (MAVs) to obtain robust, cooperative system behavior and formation control is a prominent…

Systems and Control · Computer Science 2019-04-09 I. Kagan Erunsal , Rodrigo Ventura , Alcherio Martinoli

In this work we are the first to present an offline policy gradient method for learning imitative policies for complex urban driving from a large corpus of real-world demonstrations. This is achieved by building a differentiable data-driven…

Robotics · Computer Science 2021-09-29 Oliver Scheel , Luca Bergamini , Maciej Wołczyk , Błażej Osiński , Peter Ondruska

In many specific scenarios, accurate and effective system identification is a commonly encountered challenge in the model predictive control (MPC) formulation. As a consequence, the overall system performance could be significantly weakened…

Multiagent Systems · Computer Science 2023-03-21 Jun Ma , Zilong Cheng , Wenxin Wang , Abdullah Al Mamun , Clarence W. de Silva , Tong Heng Lee

This work focuses on the design of a deep learning-based autonomous driving system deployed and tested on the real-world MIT Racecar to assess its effectiveness in driving scenarios. The Deep Neural Network (DNN) translates raw image inputs…

Robotics · Computer Science 2025-04-29 Hidayet Ersin Dursun , Yusuf Güven , Tufan Kumbasar

Motion trajectory planning is one crucial aspect for automated vehicles, as it governs the own future behavior in a dynamically changing environment. A good utilization of a vehicle's characteristics requires the consideration of the…

Optimization and Control · Mathematics 2018-07-31 Franz Gritschneder , Knut Graichen , Klaus Dietmayer

For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting…

Human-Computer Interaction · Computer Science 2020-10-08 Zheng Wang , Rencheng Zheng , Edric John Cruz Nacpil , Kimihiko Nakano

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla