English
Related papers

Related papers: Let's Reward Step-by-Step: Step-Aware Contrastive …

200 papers

Vision-Language Navigation (VLN) requires the agent to follow language instructions to reach a target position. A key factor for successful navigation is to align the landmarks implied in the instruction with diverse visual observations.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Bingqian Lin , Yunshuang Nie , Ziming Wei , Yi Zhu , Hang Xu , Shikui Ma , Jianzhuang Liu , Xiaodan Liang

Lifelong learning is critical for embodied agents in open-world environments, where reinforcement learning fine-tuning has emerged as an important paradigm to enable Vision-Language-Action (VLA) models to master dexterous manipulation…

Artificial Intelligence · Computer Science 2026-02-04 Qixin Zeng , Shuo Zhang , Hongyin Zhang , Renjie Wang , Han Zhao , Libang Zhao , Runze Li , Donglin Wang , Chao Huang

Vision Language Navigation in Continuous Environments (VLN-CE) represents a frontier in embodied AI, demanding agents to navigate freely in unbounded 3D spaces solely guided by natural language instructions. This task introduces distinct…

Artificial Intelligence · Computer Science 2024-09-24 Zhiyuan Li , Yanfeng Lu , Yao Mu , Hong Qiao

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

Robotics · Computer Science 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar

Vision--language models (VLMs) are increasingly aligned via Group Relative Policy Optimization (GRPO)-style training. However, relying solely on terminal outcome rewards yields sparse credit assignment in multi-step reasoning, weakening the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Feiding , Yongkang Zhang , Yuhao Liao , Zijian Zeng , Chunzheng Zhu , Yaozong Zheng , Yafei Liu , Yeling Peng , Youwei Wang , Sibo Wang , Huiming Yang , Linglin Liao , Shunzhi Yang

Recent advances in vision-language navigation (VLN) were mainly attributed to emerging large language models (LLMs). These methods exhibited excellent generalization capabilities in instruction understanding and task reasoning. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiangyu Dong , Haoran Zhao , Jiang Gao , Haozhou Li , Xiaoguang Ma , Yaoming Zhou , Fuhai Chen , Juan Liu

Large Language Models have achieved strong performance on reasoning tasks with objective answers by generating step-by-step solutions, but diagnosing where a multi-step reasoning trace might fail remains difficult. Confidence estimation…

Computation and Language · Computer Science 2026-05-20 Xiaoou Liu , Tiejin Chen , Dengjia Zhang , Yaqing Wang , Lu Cheng , Hua Wei

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to navigate unknown, continuous spaces based on natural language instructions. Compared to discrete settings, VLN-CE poses two core perception challenges.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Lu Yue , Dongliang Zhou , Liang Xie , Erwei Yin , Feitian Zhang

State-of-the-art (SOTA) reinforcement learning (RL) methods have enabled vision-language model (VLM) agents to learn from interaction with online environments without human supervision. However, these methods often struggle with learning…

Machine Learning · Computer Science 2025-05-22 Qingyuan Wu , Jianheng Liu , Jianye Hao , Jun Wang , Kun Shao

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

Continual Reinforcement Learning (CRL) for Vision-Language-Action (VLA) models is a promising direction toward self-improving embodied agents that can adapt in openended, evolving environments. However, conventional wisdom from continual…

Machine Learning · Computer Science 2026-03-13 Jiaheng Hu , Jay Shim , Chen Tang , Yoonchang Sung , Bo Liu , Peter Stone , Roberto Martin-Martin

The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments. This challenging task demands that the agent be aware of which instruction was completed, which…

Artificial Intelligence · Computer Science 2019-01-11 Chih-Yao Ma , Jiasen Lu , Zuxuan Wu , Ghassan AlRegib , Zsolt Kira , Richard Socher , Caiming Xiong

Vision-and-Language Navigation (VLN) tasks agents with locating specific objects in unseen environments using natural language instructions and visual cues. Many existing VLN approaches typically follow an 'observe-and-reason' schema, that…

Robotics · Computer Science 2026-02-04 Yanjia Huang , Mingyang Wu , Renjie Li , Zhengzhong Tu

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang

Vision-and-Language Navigation (VLN) is a challenging task in the field of artificial intelligence. Although massive progress has been made in this task over the past few years attributed to breakthroughs in deep vision and language models,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Wenda Qin , Teruhisa Misu , Derry Wijaya

Large Language Models (LLMs) often struggle with problems that require multi-step reasoning. For small-scale open-source models, Reinforcement Learning with Verifiable Rewards (RLVR) fails when correct solutions are rarely sampled even…

Computation and Language · Computer Science 2026-03-02 Yihe Deng , I-Hung Hsu , Jun Yan , Zifeng Wang , Rujun Han , Gufeng Zhang , Yanfei Chen , Wei Wang , Tomas Pfister , Chen-Yu Lee

Pretrained visual-language models have extensive world knowledge and are widely used in visual and language navigation (VLN). However, they are not sensitive to indoor scenarios for VLN tasks. Another challenge for VLN is how the agent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ting Liu , Yue Hu , Wansen Wu , Youkai Wang , Kai Xu , Quanjun Yin

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Jiaheng Liu , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Sign language translation (SLT) converts continuous sign videos into spoken-language text, yet it remains challenging due to the intrinsic modality mismatch between visual signs and written text, particularly in gloss-free settings. Recent…

Computation and Language · Computer Science 2026-04-27 Changhao Lai , Rui Zhao , Xuewen Zhong , Jinsong Su , Yidong Chen

Developing Vision-and-Language Navigation (VLN) agents typically assumes a \textit{train-once-deploy-once} strategy, which is unrealistic as deployed agents continually encounter novel environments. To address this, we propose the Continual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Seongjun Jeong , Gi-Cheon Kang , Seongho Choi , Joochan Kim , Byoung-Tak Zhang