English
Related papers

Related papers: Driving by the Rules: A Benchmark for Integrating …

200 papers

Autonomous vehicles demand detailed maps to maneuver reliably through traffic, which need to be kept up-to-date to ensure a safe operation. A promising way to adapt the maps to the ever-changing road-network is to use crowd-sourced data…

Robotics · Computer Science 2024-10-11 Markus Herb , Nassir Navab , Federico Tombari

If a Large Language Model (LLM) were to take a driving knowledge test today, would it pass? Beyond standard spatial and visual question-answering (QA) tasks on current autonomous driving benchmarks, driving knowledge tests require a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maolin Wei , Wanzhou Liu , Eshed Ohn-Bar

We present BehAV, a novel approach for autonomous robot navigation in outdoor scenes guided by human instructions and leveraging Vision Language Models (VLMs). Our method interprets human commands using a Large Language Model (LLM) and…

Hybrid traffic laws represent an innovative approach to managing mixed environments of connected autonomous vehicles (CAVs) and human-driven vehicles (HDVs) by introducing separate sets of regulations for each vehicle type. These laws are…

Multiagent Systems · Computer Science 2025-02-19 Tal Kraicer , Jack Haddad , Erez Karaps , Moshe Tennenholtz

Lane merging is one of the critical tasks for self-driving cars, and how to perform lane-merge maneuvers effectively and safely has become one of the important standards in measuring the capability of autonomous driving systems. However,…

Robotics · Computer Science 2024-03-21 Pengfei Lin , Ehsan Javanmardi , Yuze Jiang , Manabu Tsukada

End-to-end autonomous driving offers a streamlined alternative to the traditional modular pipeline, integrating perception, prediction, and planning within a single framework. While Deep Reinforcement Learning (DRL) has recently gained…

Artificial Intelligence · Computer Science 2024-09-27 Siyi Lu , Lei He , Shengbo Eben Li , Yugong Luo , Jianqiang Wang , Keqiang Li

Highway merging scenarios featuring mixed traffic conditions pose significant modeling and control challenges for connected and automated vehicles (CAVs) interacting with incoming on-ramp human-driven vehicles (HDVs). In this paper, we…

Machine Learning · Computer Science 2023-04-04 Nishanth Venkatesh , Viet-Anh Le , Aditya Dave , Andreas A. Malikopoulos

In autonomous driving, High Definition (HD) maps provide a complete lane model that is not limited by sensor range and occlusions. However, the generation and upkeep of HD maps involves periodic data collection and human annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Michael Mink , Thomas Monninger , Steffen Staab

Traffic state estimation (TSE) bifurcates into two categories, model-driven and data-driven (e.g., machine learning, ML), while each suffers from either deficient physics or small data. To mitigate these limitations, recent studies…

Machine Learning · Computer Science 2021-09-22 Rongye Shi , Zhaobin Mo , Kuang Huang , Xuan Di , Qiang Du

Traffic signs are essential map features globally in the era of autonomous driving and smart cities. To develop accurate and robust algorithms for traffic sign detection and classification, a large-scale and diverse benchmark dataset is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Christian Ertler , Jerneja Mislej , Tobias Ollmann , Lorenzo Porzi , Gerhard Neuhold , Yubin Kuang

Appropriate traffic regulations, e.g. planned road closure, are important in congested events. Crowd simulators have been used to find appropriate regulations by simulating multiple scenarios with different regulations. However, this…

Physics and Society · Physics 2018-10-24 Tomoharu Iwata , Takuma Otsuka , Hitoshi Shimizu , Hiroshi Sawada , Futoshi Naya , Naonori Ueda

Driving safety and responsibility determination are indispensable pieces of the puzzle for autonomous driving. They are also deeply related to the allocation of right-of-way and the determination of accident liability. Therefore,…

Robotics · Computer Science 2024-09-05 Pengfei Lin , Ehsan Javanmardi , Yuze Jiang , Dou Hu , Shangkai Zhang , Manabu Tsukada

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Over the years, reinforcement learning has emerged as a popular approach to develop signal control and vehicle platooning strategies either independently or in a hierarchical way. However, jointly controlling both in real-time to alleviate…

Machine Learning · Computer Science 2025-08-13 Xianyue Peng , Shenyang Chen , Hang Gao , Hao Wang , H. Michael Zhang

State-of-the-art algorithms successfully localize and recognize traffic signs over existing datasets, which are limited in terms of challenging condition type and severity. Therefore, it is not possible to estimate the performance of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Dogancan Temel , Tariq Alshawi , Min-Hung Chen , Ghassan AlRegib

Online scene perception and topology reasoning are critical for autonomous vehicles to understand their driving environments, particularly for mapless driving systems that endeavor to reduce reliance on costly High-Definition (HD) maps.…

Robotics · Computer Science 2025-06-27 Muleilan Pei , Jiayao Shan , Peiliang Li , Jieqi Shi , Jing Huo , Yang Gao , Shaojie Shen

This paper uses supervised learning, random search and deep reinforcement learning (DRL) methods to control large signalized intersection networks. The traffic model is Cellular Automaton rule 184, which has been shown to be a…

Artificial Intelligence · Computer Science 2025-04-07 Jorge A. Laval , Hao Zhou

Existing web-generation benchmarks rely on text prompts or static screenshots as input. However, videos naturally convey richer signals such as interaction flow, transition timing, and motion continuity, which are essential for faithful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuhong Dai , Yanlin Lai , Mitt Huang , Hangyu Guo , Dingming Li , Hongbo Peng , Haodong Li , Yingxiu Zhao , Haoran Lyu , Zheng Ge , Xiangyu Zhang , Daxin Jiang

Neural networks have proven to be very powerful at computer vision tasks. However, they often exhibit unexpected behaviours, violating known requirements expressing background knowledge. This calls for models (i) able to learn from the…

Machine Learning · Computer Science 2023-06-21 Eleonora Giunchiglia , Mihaela Cătălina Stoian , Salman Khan , Fabio Cuzzolin , Thomas Lukasiewicz

Vision-Language Navigation (VLN) requires agents to follow natural language instructions in partially observed 3D environments, motivating map representations that aggregate spatial context beyond local perception. However, most existing…