English
Related papers

Related papers: Conditional Driving from Natural Language Instruct…

200 papers

This paper develops a novel car-following control method to reduce voluntary driver interventions and improve traffic stability in Automated Vehicles (AVs). Through a combination of experimental and empirical analysis, we show how voluntary…

Human-Computer Interaction · Computer Science 2024-04-10 Xinzhi Zhong , Yang Zhou , Varshini Kamaraj , Zhenhao Zhou , Wissam Kontar , Dan Negrut , John D. Lee , Soyoung Ahn

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiageng Mao , Junjie Ye , Yuxi Qian , Marco Pavone , Yue Wang

The focus of this paper is to propose a driver model that incorporates human reasoning levels as actions during interactions with other drivers. Different from earlier work using game theoretical human reasoning levels, we propose a dynamic…

Multiagent Systems · Computer Science 2021-01-19 Cevahir Köprülü , Yıldıray Yıldız

Neural network-based systems can now learn to locate the referents of words and phrases in images, answer questions about visual scenes, and execute symbolic instructions as first-person actors in partially-observable worlds. To achieve…

Computation and Language · Computer Science 2019-10-02 Felix Hill , Stephen Clark , Karl Moritz Hermann , Phil Blunsom

In this paper, we present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving…

Robotics · Computer Science 2022-09-13 Dian Chen , Philipp Krähenbühl

For autonomous vehicles to safely share the road with human drivers, autonomous vehicles must abide by specific "road rules" that human drivers have agreed to follow. "Road rules" include rules that drivers are required to follow by law --…

Machine Learning · Computer Science 2021-11-22 Avik Pal , Jonah Philion , Yuan-Hong Liao , Sanja Fidler

Modern robotics applications that involve human-robot interaction require robots to be able to communicate with humans seamlessly and effectively. Natural language provides a flexible and efficient medium through which robots can exchange…

Robotics · Computer Science 2016-10-12 Andrea F. Daniele , Mohit Bansal , Matthew R. Walter

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

Systems and Control · Electrical Eng. & Systems 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

Simulation of conflict situations for autonomous driving research is crucial for understanding and managing interactions between Automated Vehicles (AVs) and human drivers. This paper presents a set of exemplary conflict scenarios in CARLA…

Human-Computer Interaction · Computer Science 2025-03-24 Tsvetomila Mihaylova , Stefan Reitmann , Elin A. Topp , Ville Kyrki

This paper presents a novel approach to modeling human driving behavior, designed for use in evaluating autonomous vehicle control systems in a simulation environments. Our methodology leverages a hierarchical forward-looking, risk-aware…

Robotics · Computer Science 2024-08-20 Nathan Ludlow , Yiwei Lyu , John Dolan

In this paper, we present a robotic navigation algorithm with natural language interfaces, which enables a robot to safely walk through a changing environment with moving persons by following human instructions such as "go to the restaurant…

Robotics · Computer Science 2018-09-13 Zhe Hu , Jia Pan , Tingxiang Fan , Ruigang Yang , Dinesh Manocha

Autonomous driving has long relied on modular "Perception-Decision-Action" pipelines, where hand-crafted interfaces and rule-based components often break down in complex or long-tailed scenarios. Their cascaded design further propagates…

Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if…

Robotics · Computer Science 2021-11-05 Rohan Chandra , Aniket Bera , Dinesh Manocha

Driving requires reacting to a wide variety of complex environment conditions and agent behaviors. Explicitly modeling each possible scenario is unrealistic. In contrast, imitation learning can, in theory, leverage data from large fleets of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Felipe Codevilla , Eder Santana , Antonio M. López , Adrien Gaidon

Imitation learning is a popular approach for teaching motor skills to robots. However, most approaches focus on extracting policy parameters from execution traces alone (i.e., motion trajectories and perceptual data). No adequate…

Robotics · Computer Science 2020-10-26 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Stefan Lee , Chitta Baral , Heni Ben Amor

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

To maximize safety and driving comfort, autonomous driving systems can benefit from implementing foresighted action choices that take different potential scenario developments into account. While artificial scene prediction methods are…

Robotics · Computer Science 2022-04-15 Chao Wang , Thomas H. Weisswange , Matti Krueger , Christiane B. Wiebel-Herboth

Despite the rapid improvement of autonomous driving technology in recent years, automotive manufacturers must resolve liability issues to commercialize autonomous passenger car of SAE J3016 Level 3 or higher. To cope with the product…

Robotics · Computer Science 2022-11-21 Ho Suk , Taewoo Kim , Hyungbin Park , Pamul Yadav , Junyong Lee , Shiho Kim