English
Related papers

Related papers: VehicleWorld: A Highly Integrated Multi-Device Env…

200 papers

Despite over 3.5 million Android apps and 200+ million Android Auto-compatible vehicles, only a few hundred apps support Android Auto due to platform-specific compliance requirements. Android Auto mandates service-based architectures in…

Software Engineering · Computer Science 2026-01-28 Moshood Fakorede , Umar Farooq

Multimodal agents have demonstrated strong performance in general GUI interactions, but their application in automotive systems has been largely unexplored. In-vehicle GUIs present distinct challenges: drivers' limited attention, strict…

Robotics · Computer Science 2025-09-30 Junfeng Yan , Biao Wu , Meng Fang , Ling Chen

Video world models have achieved remarkable success in simulating environmental dynamics in response to actions by users or agents. They are modeled as action-conditioned video generation models that take historical frames and current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Haoyu Wu , Jiwen Yu , Yingtian Zou , Xihui Liu

A major challenge for autonomous vehicles is interacting with other traffic participants safely and smoothly. A promising approach to handle such traffic interactions is equipping autonomous vehicles with interaction-aware controllers…

Robotics · Computer Science 2022-06-22 Olger Siebinga , Arkady Zgonnikov , David Abbink

A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Existing mobile-agent benchmarks have made important progress on evaluation, but they do not…

Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Royden Wagner , Ömer Sahin Tas , Marlon Steiner , Fabian Konstantinidis , Hendrik Königshof , Marvin Klemp , Carlos Fernandez , Christoph Stiller

Augmenting automated vehicles to wirelessly detect and respond to external events before they are detectable by onboard sensors is crucial for developing context-aware driving strategies. To this end, we present an automated vehicle…

Vision-centric autonomous driving has recently raised wide attention due to its lower cost. Pre-training is essential for extracting a universal representation. However, current vision-centric pre-training typically relies on either 2D or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Chen Min , Dawei Zhao , Liang Xiao , Jian Zhao , Xinli Xu , Zheng Zhu , Lei Jin , Jianshu Li , Yulan Guo , Junliang Xing , Liping Jing , Yiming Nie , Bin Dai

Automated scientific discovery promises to accelerate progress across scientific domains. However, developing and evaluating an AI agent's capacity for end-to-end scientific reasoning is challenging as running real-world experiments is…

Behavior prediction remains one of the most challenging tasks in the autonomous vehicle (AV) software stack. Forecasting the future trajectories of nearby agents plays a critical role in ensuring road safety, as it equips AVs with the…

Artificial Intelligence · Computer Science 2021-11-16 Francis Indaheng , Edward Kim , Kesav Viswanadha , Jay Shenoy , Jinkyu Kim , Daniel J. Fremont , Sanjit A. Seshia

The evolution of automotive technologies towards more integrated and sophisticated systems requires a shift from traditional distributed architectures to centralized vehicle architectures. This work presents a novel framework that addresses…

Software Engineering · Computer Science 2025-03-10 Sven Kirchner , Nils Purschke , Chengdong Wu , Muhammed Aqib Khan , Divye Dixit , Alois C. Knoll

This paper aims to enhance the performance of Vehicular Platooning (VP) systems integrated with Wireless Federated Learning (WFL). In highly dynamic environments, vehicular platoons experience frequent communication changes and resource…

Networking and Internet Architecture · Computer Science 2025-07-02 Beining Wu , Jun Huang , Qiang Duan , Liang Dong , Zhipeng Cai

Conventional road-situation detection methods achieve strong performance in predefined scenarios but fail in unseen cases and lack semantic interpretation, which is crucial for reliable traffic recommendations. This work introduces a…

Robotics · Computer Science 2025-11-11 Kailin Tong , Selim Solmaz , Kenan Mujkic , Gottfried Allmer , Bo Leng

Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the…

Large language models are increasingly expected to serve as general-purpose agents that interact with external, stateful tool environments. The Model Context Protocol (MCP) and broader agent skills offer a unified interface for connecting…

Within the field of automated driving, a clear trend in environment perception tends towards more sensors, higher redundancy, and overall increase in computational power. This is mainly driven by the paradigm to perceive the entire…

Robotics · Computer Science 2023-01-27 Matti Henning , Johannes Müller , Fabian Gies , Michael Buchholz , Klaus Dietmayer

To enable autonomous driving in interactive traffic scenarios, various model predictive control (MPC) formulations have been proposed, each employing different interaction models. While higher-fidelity models enable more intelligent…

Robotics · Computer Science 2025-12-09 Shuhao Qi , Qiling Aori , Luyao Zhang , Mircea Lazar , Sofie Haesaert

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

Assessing drivers' interaction capabilities is crucial for understanding human driving behavior and enhancing the interactive abilities of autonomous vehicles. In scenarios involving strong interaction, existing metrics focused on…

Robotics · Computer Science 2024-05-07 Jiaqi Liu , Peng Hang , Xiangwang Hu , Jian Sun

We introduce TerminalWorld, a scalable data engine that automatically reverse-engineers high-fidelity evaluation tasks from "in-the-wild" terminal recordings. Processing 80,870 terminal recordings, the engine yields a full benchmark of…

Artificial Intelligence · Computer Science 2026-05-22 Zhaoyang Chu , Jiarui Hu , Xingyu Jiang , Pengyu Zou , Han Li , Chao Peng , Peter O'Hearn , Earl T. Barr , Mark Harman , Federica Sarro , He Ye