English
Related papers

Related papers: TRACE: A Self-Improving Framework for Robot Behavi…

200 papers

Long-horizon robotic manipulation requires plans that are both logically coherent and geometrically grounded. Existing Vision-Language-Action policies usually hide planning in latent states or expose only one modality: text-only…

Artificial Intelligence · Computer Science 2026-05-04 Jinkun Liu , Haohan Chi , Lingfeng Zhang , Yifan Xie , YuAn Wang , Long Chen , Hangjun Ye , Xiaoshuai Hao , Wenbo Ding

As LLMs are increasingly used as judges in code applications, they should be evaluated in realistic interactive settings that capture partial context and ambiguous intent. We present TRACE (Tool for Rubric Analysis in Code Evaluation), a…

Software Engineering · Computer Science 2026-05-15 Aditya Mittal , Ryan Shar , Zichu Wu , Shyam Agarwal , Tongshuang Wu , Chris Donahue , Ameet Talwalkar , Wayne Chi , Valerie Chen

Recently, some studies have integrated Multimodal Large Language Models into robotic manipulation, constructing vision-language-action models (VLAs) to interpret multimodal information and predict SE(3) poses. While VLAs have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chenxuan Li , Jiaming Liu , Guanqun Wang , Xiaoqi Li , Sixiang Chen , Liang Heng , Chuyan Xiong , Jiaxin Ge , Renrui Zhang , Kaichen Zhou , Shanghang Zhang

Although large vision-language-action (VLA) models pretrained on extensive robot datasets offer promising generalist policies for robotic learning, they still struggle with spatial-temporal dynamics in interactive robotics, making them less…

Model Predictive Control (MPC) is a widely adopted control paradigm that leverages predictive models to estimate future system states and optimize control inputs accordingly. However, while MPC excels in planning and control, it lacks the…

Robotics · Computer Science 2025-04-08 Jiaming Chen , Wentao Zhao , Ziyu Meng , Donghui Mao , Ran Song , Wei Pan , Wei Zhang

Recent advances in natural language processing highlight two key factors for improving reasoning in large language models (LLMs): (i) allocating more test-time compute tends to help on harder problems but often introduces redundancy in the…

Computation and Language · Computer Science 2025-11-04 Riccardo Alberghi , Elizaveta Demyanenko , Luca Biggio , Luca Saglietti

Existing Multimodal Large Language Models (MLLMs) struggle with 3D spatial reasoning, as they fail to construct structured abstractions of the 3D environment depicted in video inputs. To bridge this gap, drawing inspiration from cognitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiacheng Hua , Yishu Yin , Yuhang Wu , Tai Wang , Yifei Huang , Miao Liu

Constructing valid and informative conformal prediction regions for multi-dimensional outputs remains a fundamental challenge. While conformal prediction provides finite-sample, distribution-free coverage guarantees, its practical…

Machine Learning · Statistics 2026-05-11 Zhenhan Fang , Aixin Tan , Jian Huang

Recent advancements in vision-language-action (VLA) models have shown promise in robotic manipulation, yet they continue to struggle with long-horizon, multi-step tasks. Existing methods lack internal reasoning mechanisms that can identify…

Recent advances in reasoning-focused Large Language Models (LLMs) have introduced Chain-of-Thought (CoT) traces - intermediate reasoning steps generated before a final answer. These traces, as in DeepSeek R1, guide inference and train…

Computation and Language · Computer Science 2026-04-20 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Reasoning Vision Language Action (VLA) models improve robotic instruction-following by generating step-by-step textual plans before low-level actions, an approach inspired by Chain-of-Thought (CoT) reasoning in language models. Yet even…

Robotics · Computer Science 2026-01-15 Yilin Wu , Anqi Li , Tucker Hermans , Fabio Ramos , Andrea Bajcsy , Claudia Pérez-D'Arpino

Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is still constrained, especially when employing Chain-of-Thought prompting techniques. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Congzhi Zhang , Jiawei Peng , Zhenglin Wang , Yilong Lai , Haowen Sun , Heng Chang , Fei Ma , Weijiang Yu

Robotic systems often face execution failures due to unexpected obstacles, sensor errors, or environmental changes. Traditional failure recovery methods rely on predefined strategies or human intervention, making them less adaptable. This…

Robotics · Computer Science 2025-03-24 Faseeh Ahmad , Hashim Ismail , Jonathan Styrud , Maj Stenmark , Volker Krueger

We propose VLM-Social-Nav, a novel Vision-Language Model (VLM) based navigation approach to compute a robot's motion in human-centered environments. Our goal is to make real-time decisions on robot actions that are socially compliant with…

Robotics · Computer Science 2024-11-27 Daeun Song , Jing Liang , Amirreza Payandeh , Amir Hossain Raj , Xuesu Xiao , Dinesh Manocha

While Vision-Language Models (VLMs) are set to transform robotic navigation, existing methods often underutilize their reasoning capabilities. To unlock the full potential of VLMs in robotics, we shift their role from passive observers to…

Robotics · Computer Science 2025-11-13 Mobin Habibpour , Fatemeh Afghah

Post-training alignment of large language models (LLMs) relies on large-scale human annotations guided by policy specifications that change over time. Cultural shifts, value reinterpretations, and regulatory or industrial updates make…

Computation and Language · Computer Science 2026-05-12 Aakash Sen Sharma , Debdeep Sanyal , Manodeep Ray , Vivek Srivastava , Shirish Karande , Murari Mandal

Delayed feedback poses a core challenge for online CVR prediction, forcing a trade-off between label accuracy and data freshness. Existing methods address this through delay modeling or sample reweighting, yet neglect how post-click…

Machine Learning · Computer Science 2026-04-28 Xinyue Zhang , Yuanhao Ding , Xiang Ao

Accurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems. While vision-language models (VLMs) have shown significant potential in various autonomous driving tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yujin Wang , Quanfeng Liu , Zhengxin Jiang , Tianyi Wang , Junfeng Jiao , Hongqing Chu , Bingzhao Gao , Hong Chen

Detecting Internet routing instability is a critical yet challenging task, particularly when relying solely on endpoint active measurements. This study introduces TRACE, a MachineLearning (ML)pipeline designed to identify route changes…

Networking and Internet Architecture · Computer Science 2026-04-06 Raul Suzuki , Rodrigo Moreira , Pedro Henrique A. Damaso de Melo , Larissa F. Rodrigues Moreira , Flávio de Oliveira Silva

Retrieval-Augmented Generation (RAG) delivers substantial value in knowledge-intensive applications. However, its generated responses often lack transparent reasoning paths that trace back to source evidence from retrieved documents. This…

Computation and Language · Computer Science 2026-01-30 Jingyi Ren , Yekun Xu , Xiaolong Wang , Weitao Li , Ante Wang , Weizhi Ma , Yang Liu