English
Related papers

Related papers: Reason--Imagine--Act: Closed-Loop LLM Decision Mak…

200 papers

With the rapid advancement of artificial intelligence, there is an increasing demand for intelligent robots capable of assisting humans in daily tasks and performing complex operations. Such robots not only require task planning…

Robotics · Computer Science 2025-05-01 Huihui Guo , Huilong Pi , Yunchuan Qin , Zhuo Tang , Kenli Li

The rise of multi-modal large language models(MLLMs) has spurred their applications in autonomous driving. Recent MLLM-based methods perform action by learning a direct mapping from perception to action, neglecting the dynamics of the world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Julong Wei , Shanshuai Yuan , Pengfei Li , Qingda Hu , Zhongxue Gan , Wenchao Ding

Safety-critical planning in complex environments, particularly at urban intersections, remains a fundamental challenge for autonomous driving. Existing methods, whether rule-based or data-driven, frequently struggle to capture complex scene…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Generative AI is increasingly important in software engineering, including safety engineering, where its use ensures that software does not cause harm to people. This also leads to high quality requirements for generative AI. Therefore, the…

Software Engineering · Computer Science 2024-04-25 Florian Geissler , Karsten Roscher , Mario Trapp

This paper presents AutoRAN, the first framework to automate the hijacking of internal safety reasoning in large reasoning models (LRMs). At its core, AutoRAN pioneers an execution simulation paradigm that leverages a weaker but…

Machine Learning · Computer Science 2026-04-17 Jiacheng Liang , Tanqiu Jiang , Yuhui Wang , Rongyi Zhu , Fenglong Ma , Ting Wang

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Human-AI joint planning in Unmanned Aerial Vehicles (UAVs) typically relies on control handover when facing environmental uncertainties, which is often inefficient and cognitively demanding for non-expert operators. To address this, we…

Robotics · Computer Science 2026-03-10 Zeyu Fang , Beomyeol Yu , Cheng Liu , Zeyuan Yang , Rongqian Chen , Yuxin Lin , Mahdi Imani , Tian Lan

Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpretation, and action generation, these systems enable more…

Robotics · Computer Science 2026-03-19 Gerhard Yu , Fuyuki Ishikawa , Oluwafemi Odu , Alvine Boaye Belle

Real-world autonomous driving must adhere to complex human social rules that extend beyond legally codified traffic regulations. Many of these semantic constraints, such as yielding to emergency vehicles, complying with traffic officers'…

Robotics · Computer Science 2026-01-06 Qian Cheng , Weitao Zhou , Cheng Jing , Nanshan Deng , Junze Wen , Zhaoyang Liu , Kun Jiang , Diange Yang

Large language models (LLMs) have shown exceptional performance as general-purpose assistants, excelling across a variety of reasoning tasks. This achievement represents a significant step toward achieving artificial general intelligence…

Artificial Intelligence · Computer Science 2024-08-13 Xiaoyu Tan , Yongxin Deng , Xihe Qiu , Weidi Xu , Chao Qu , Wei Chu , Yinghui Xu , Yuan Qi

The utilization of Large Language Models (LLMs) to power human-like agents has shown remarkable potential in simulating individual mobility pattern. However, a significant gap remains in modeling cohorts of agents in dynamic and interactive…

Physics and Society · Physics 2026-03-16 Chengbo Zhang , Zuopeng Xiao

Large Language Models (LLMs) are increasingly used to power autonomous agents for complex, multi-step tasks. However, human-agent interaction remains pointwise and reactive: users approve or correct individual actions to mitigate immediate…

Human-Computer Interaction · Computer Science 2026-03-13 Gaole He , Brian Y. Lim

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically…

Cryptography and Security · Computer Science 2026-03-17 Yu Pan , Wenlong Yu , Tiejun Wu , Xiaohu Ye , Qiannan Si , Guangquan Xu , Bin Wu

This study introduces a novel approach for traffic control systems by using Large Language Models (LLMs) as traffic controllers. The study utilizes their logical reasoning, scene understanding, and decision-making capabilities to optimize…

Computation and Language · Computer Science 2024-11-19 Sari Masri , Huthaifa I. Ashqar , Mohammed Elhenawy

With the growing deployment of Vision-Language Models (VLMs) in real-world applications, previously overlooked safety risks are becoming increasingly evident. In particular, seemingly innocuous multimodal inputs can combine to reveal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Youngjin Na , Sangheon Jeong , Youngwan Lee , Jian Lee , Dawoon Jeong , Youngman Kim

The realization of intelligent robots, operating autonomously and interacting with other intelligent agents, human or artificial, requires the integration of environment perception, reasoning, and action. Classic Artificial Intelligence…

Robotics · Computer Science 2025-12-15 Kanisorn Sangchai , Methasit Boonpun , Withawin Kraipetchara , Paulo Garcia

In this demo, we present AERA Chat, an automated and explainable educational assessment system designed for interactive and visual evaluations of student responses. This system leverages large language models (LLMs) to generate automated…

Computation and Language · Computer Science 2024-12-19 Jiazheng Li , Artem Bobrov , David West , Cesare Aloisi , Yulan He

While Large Reasoning Models (LRMs) have demonstrated exceptional logical capabilities in mathematical domains, their application to the legal field remains hindered by the strict requirements for procedural rigor and adherence to legal…

Artificial Intelligence · Computer Science 2026-01-13 Yujin Zhou , Chuxue Cao , Jinluan Yang , Lijun Wu , Conghui He , Sirui Han , Yike Guo

Large Reasoning Models (LRMs) excel at complex reasoning but are traditionally evaluated in static, "frozen world" settings: model responses are assumed to be instantaneous, and the context of a request is presumed to be immutable over the…

Computation and Language · Computer Science 2025-10-17 Tsung-Han Wu , Mihran Miroyan , David M. Chan , Trevor Darrell , Narges Norouzi , Joseph E. Gonzalez

A fundamental requirement for real-world robotic deployment is the ability to understand and respond to natural language instructions. Existing language-conditioned manipulation tasks typically assume that instructions are perfectly aligned…