English
Related papers

Related papers: TRACE: A Self-Improving Framework for Robot Behavi…

200 papers

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Pre-trained vision-language-action (VLA) models offer a promising foundation for generalist robot policies, but often produce brittle behaviors or unsafe failures when deployed zero-shot in out-of-distribution scenarios. We present…

Robotics · Computer Science 2025-11-14 Cyrus Neary , Omar G. Younis , Artur Kuramshin , Ozgur Aslan , Glen Berseth

Pre-trained visual language models (VLM) have shown excellent performance in image caption tasks. However, it sometimes shows insufficient reasoning ability. In contrast, large language models (LLMs) emerge with powerful reasoning…

Computation and Language · Computer Science 2023-05-23 Yueting Yang , Xintong Zhang , Wenjuan Han

Traditional conversational travel recommender systems primarily optimize for user relevance and convenience, often reinforcing popular, overcrowded destinations and carbon-intensive travel choices. To address this, we present TRACE (Tourism…

Information Retrieval · Computer Science 2026-04-17 Ashmi Banerjee , Adithi Satish , Wolfgang Wörndl , Yashar Deldjoo

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani

Temporal causal representation learning methods assume that causal mechanisms switch instantaneously between discrete domains, yet real-world systems often exhibit continuous mechanism transitions. For example, a vehicle's dynamics evolve…

Machine Learning · Computer Science 2026-01-30 Shicheng Fan , Kun Zhang , Lu Cheng

The field of Language Reasoning Models (LRMs) has been very active over the past few years with advances in training and inference techniques enabling LRMs to reason longer, and more accurately. However, a growing body of studies show that…

Computation and Language · Computer Science 2026-04-24 Yannis Belkhiter , Seshu Tirupathi , Giulio Zizzo , John D. Kelleher

Vision-Language-Action models have demonstrated remarkable capabilities in predicting agent movements within virtual environments and real-world scenarios based on visual observations and textual instructions. Although recent research has…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Maxim A. Patratskiy , Alexey K. Kovalev , Aleksandr I. Panov

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

Robotics · Computer Science 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Latent Action Models (LAMs) have rapidly gained traction as an important component in the pre-training pipelines of leading Vision-Language-Action models. However, they fail when observations contain action-correlated distractors, often…

Predicting the future trajectories of dynamic traffic actors is a cornerstone task in autonomous driving. Though existing notable efforts have resulted in impressive performance improvements, a gap persists in scene cognitive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhengxing Lan , Hongbo Li , Lingshan Liu , Bo Fan , Yisheng Lv , Yilong Ren , Zhiyong Cui

Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions. For example, in a search and rescue mission, a legged robot could climb over debris, crawl through gaps, and…

Robotics · Computer Science 2024-07-04 Annie S. Chen , Alec M. Lessing , Andy Tang , Govind Chada , Laura Smith , Sergey Levine , Chelsea Finn

We present AutoTraces, an autoregressive vision-language-trajectory model for robot trajectory forecasting in humam-populated environments, which harnesses the inherent reasoning capabilities of large language models (LLMs) to model complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Teng Wang , Yanting Lu , Ruize Wang

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

Robotics · Computer Science 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan

Vision-language models (VLMs) achieve strong performance on multimodal benchmarks, but may still lack robust control over basic visual operations. We study \textit{line tracing}, where a model must follow a selected visual path through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hyesoo Hong , Minsoo Kim , Wonje Jeung , Sangyeon Yoon , Dongjae Jeon , Albert No

While generative robot policies have demonstrated significant potential in learning complex, multimodal behaviors from demonstrations, they still exhibit diverse failures at deployment-time. Policy steering offers an elegant solution to…

Robotics · Computer Science 2025-05-05 Yilin Wu , Ran Tian , Gokul Swamy , Andrea Bajcsy

We introduce a novel self-improving framework that enhances Embodied Visual Tracking (EVT) with Vision-Language Models (VLMs) to address the limitations of current active visual tracking systems in recovering from tracking failure. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kui Wu , Shuhang Xu , Hao Chen , Churan Wang , Zhoujun Li , Yizhou Wang , Fangwei Zhong

We present a Temporal Rule-Anchored Chain-of-Evidence (TRACE) on knowledge graphs for interpretable stock movement prediction that unifies symbolic relational priors, dynamic graph exploration, and LLM-guided decision making in a single…

Computational Engineering, Finance, and Science · Computer Science 2026-03-16 Qianggang Ding , Haochen Shi , Luis Castejón Lozano , Miguel Conner , Juan Abia , Luis Gallego-Ledesma , Joshua Fellowes , Gerard Conangla Planes , Adam Elwood , Bang Liu

Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as…

Artificial Intelligence · Computer Science 2026-05-01 Yang Zhang , Jiangyuan Zhao , Chenyou Fan , Fangzheng Yan , Tian Li , Haitong Tang , Sen Fu , Xuan'er Wu , Qizhen Weng , Weinan Zhang , Xiu Li , Chi Zhang , Chenjia Bai , Xuelong Li

LLM agents increasingly operate through multi-turn tool use and environment interaction, where safety risks often emerge from intermediate steps long before they surface in the final outcome. Reactive auditing is therefore insufficient:…

Computation and Language · Computer Science 2026-05-28 Jiaqian Li , Yanshu Li , Boxuan Zhang , Ruixiang Tang , Kuan-Hao Huang