English
Related papers

Related papers: Unified Noise Steering for Efficient Human-Guided …

200 papers

Activation-based control steers large language models (LLMs) by intervening on their internal representations during inference, and has emerged as an effective paradigm for controlling behaviors such as persona and style. However, existing…

Computation and Language · Computer Science 2026-05-29 Yingdong Shi , Ruiming Zhang , Changming Li , Zhiyu Yang , Kaixing Zhang , Jingyi Yu , Kan Ren

Vision-Language-Action (VLA) models pre-trained on large, diverse datasets show remarkable potential for general-purpose robotic manipulation. However, a primary bottleneck remains in adapting these models to downstream tasks, especially…

Robotics · Computer Science 2025-09-08 Yang Zhang , Chenwei Wang , Ouyang Lu , Yuan Zhao , Yunfei Ge , Zhenglong Sun , Xiu Li , Chi Zhang , Chenjia Bai , Xuelong Li

Vision-language-action models (VLAs) have garnered significant attention for their potential in advancing robotic manipulation. However, previous approaches predominantly rely on the general comprehension capabilities of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yuqi Wang , Xinghang Li , Wenxuan Wang , Junbo Zhang , Yingyan Li , Yuntao Chen , Xinlong Wang , Zhaoxiang Zhang

Recent advances in vision-language-action (VLA) models have motivated the extension of their capabilities to embodied settings, where reinforcement learning (RL) offers a principled way to optimize task success through interaction. However,…

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

Vision-Language-Action (VLA) models have recently emerged in autonomous driving, with the promise of leveraging rich world knowledge to improve the cognitive capabilities of driving systems. However, adapting such models for driving tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yongkang Li , Lijun Zhou , Sixu Yan , Bencheng Liao , Tianyi Yan , Kaixin Xiong , Long Chen , Hongwei Xie , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Haiyang Sun , Xinggang Wang

Vision-language-action (VLA) models aim to understand natural language instructions and visual observations and to execute corresponding actions as an embodied agent. Recent work integrates future images into the understanding-acting loop,…

Robotics · Computer Science 2026-03-26 Jiayi Chen , Wenxuan Song , Pengxiang Ding , Ziyang Zhou , Han Zhao , Feilong Tang , Donglin Wang , Haoang Li

Why do pretrained diffusion or flow-matching policies fail when the same task is performed near an obstacle, on a shifted support surface, or amid mild clutter? Such failures rarely reflect missing motor skills; instead, they expose a…

Robotics · Computer Science 2026-02-05 Shuo Liu , Ishneet Sukhvinder Singh , Yiqing Xu , Jiafei Duan , Ranjay Krishna

Large language model (LLM) steering has emerged as a promising paradigm for controlling model behavior at inference time through targeted manipulation of hidden states, offering a lightweight alternative to expensive retraining. However,…

Computation and Language · Computer Science 2026-03-03 Haolei Xu , Xinyu Mei , Yuchen Yan , Rui Zhou , Wenqi Zhang , Weiming Lu , Yueting Zhuang , Yongliang Shen

Vision-language-action (VLA) models demonstrate strong generalization in robotic manipulation but face challenges in complex, real-world tasks. While supervised fine-tuning with demonstrations is constrained by data quality, reinforcement…

Robotics · Computer Science 2025-09-18 Piaopiao Jin , Qi Wang , Guokang Sun , Ziwen Cai , Pinjia He , Yangwei You

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jiaming Liu , Hao Chen , Pengju An , Zhuoyang Liu , Renrui Zhang , Chenyang Gu , Xiaoqi Li , Ziyu Guo , Sixiang Chen , Mengzhen Liu , Chengkai Hou , Mengdi Zhao , KC alex Zhou , Pheng-Ann Heng , Shanghang Zhang

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Lifelong learning is critical for embodied agents in open-world environments, where reinforcement learning fine-tuning has emerged as an important paradigm to enable Vision-Language-Action (VLA) models to master dexterous manipulation…

Artificial Intelligence · Computer Science 2026-02-04 Qixin Zeng , Shuo Zhang , Hongyin Zhang , Renjie Wang , Han Zhao , Libang Zhao , Runze Li , Donglin Wang , Chao Huang

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

Robotics · Computer Science 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

Robotic real-world reinforcement learning (RL) with vision-language-action (VLA) models is bottlenecked by sparse, handcrafted rewards and inefficient exploration. We introduce VLAC, a general process reward model built upon InternVL and…

Reinforcement learning (RL) enables high-frequency, closed-loop control for robotic manipulation, but scaling to long-horizon tasks with sparse or imperfect rewards remains difficult due to inefficient exploration and poor credit…

Machine Learning · Computer Science 2026-04-16 Angelo Moroncelli , Roberto Zanetti , Marco Maccarini , Loris Roveda

Vision-language-action (VLA) models have emerged as generalist robotic controllers capable of mapping visual observations and natural language instructions to continuous action sequences. However, VLAs provide no calibrated measure of…

Robotics · Computer Science 2026-04-21 Lingling Chen , Zongyao Lyu , William J. Beksi

Autoregressive vision-language-action (VLA) models have recently demonstrated strong capabilities in robotic manipulation. However, their core process of action tokenization often involves a trade-off between reconstruction fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yicheng Liu , Shiduo Zhang , Zibin Dong , Baijun Ye , Tianyuan Yuan , Xiaopeng Yu , Linqi Yin , Chenhao Lu , Junhao Shi , Luca Jiang-Tao Yu , Liangtao Zheng , Tao Jiang , Jingjing Gong , Xipeng Qiu , Hang Zhao

Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics. Yet, unlike VLMs in the vision-language domain, VLAs for robotics require finetuning to contend with varying…

‹ Prev 1 2 3 10 Next ›