English
Related papers

Related papers: OmniNFT: Modality-wise Omni Diffusion Reinforcemen…

200 papers

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

Information Retrieval · Computer Science 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

Recent advances in large language models, particularly following GPT-4o, have sparked increasing interest in developing omni-modal models capable of understanding more modalities. While some open-source alternatives have emerged, there is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zuyan Liu , Yuhao Dong , Jiahui Wang , Ziwei Liu , Winston Hu , Jiwen Lu , Yongming Rao

Large-scale pre-trained Vision-Language Models (VLMs) have become essential for transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, diminishing their performance on…

Machine Learning · Computer Science 2025-03-27 Yuncheng Guo , Xiaodong Gu

The potential of offline reinforcement learning (RL) is that high-capacity models trained on large, heterogeneous datasets can lead to agents that generalize broadly, analogously to similar advances in vision and NLP. However, recent works…

Machine Learning · Computer Science 2023-04-19 Aviral Kumar , Rishabh Agarwal , Xinyang Geng , George Tucker , Sergey Levine

Reinforcement fine-tuning (RFT) has shown promise for training LLM agents to perform multi-turn decision-making based on environment feedback. However, most existing evaluations remain largely in-domain: training and testing are conducted…

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Unified multi-modal encoders that bind vision, audio, and other sensors into a shared embedding space are attractive building blocks for robot perception and decision-making. However, on-robot deployment exposes the vision branch to…

Robotics · Computer Science 2025-09-19 Yuhong Lu

Despite the broad application of deep reinforcement learning (RL), transferring and adapting the policy to unseen but similar environments is still a significant challenge. Recently, the language-conditioned policy is proposed to facilitate…

Machine Learning · Computer Science 2023-03-10 Shaohui Peng , Xing Hu , Rui Zhang , Jiaming Guo , Qi Yi , Ruizhi Chen , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Enhancing reasoning in Large Multimodal Models (LMMs) faces unique challenges from the complex interplay between visual perception and logical reasoning, particularly in compact 3B-parameter architectures where architectural constraints…

Computation and Language · Computer Science 2025-03-12 Yingzhe Peng , Gongrui Zhang , Miaosen Zhang , Zhiyuan You , Jie Liu , Qipeng Zhu , Kai Yang , Xingzhong Xu , Xin Geng , Xu Yang

The standard post-training recipe for large multimodal models (LMMs) applies supervised fine-tuning (SFT) on curated demonstrations followed by reinforcement learning with verifiable rewards (RLVR). However, SFT introduces distributional…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Sudong Wang , Weiquan Huang , Xiaomin Yu , Zuhao Yang , Hehai Lin , Keming Wu , Chaojun Xiao , Chen Chen , Wenxuan Wang , Beier Zhu , Yunjian Zhang , Chengwei Qin

Meta reinforcement learning (Meta-RL) methods such as RL$^2$ have emerged as promising approaches for learning data-efficient RL algorithms tailored to a given task distribution. However, they show poor asymptotic performance and struggle…

Machine Learning · Computer Science 2025-07-29 Abhinav Bhatia , Samer B. Nashed , Shlomo Zilberstein

Enhancing the complex reasoning capabilities of Large Language Models (LLMs) attracts widespread attention. While reinforcement learning (RL) has shown superior performance for improving complex reasoning, its impact on cross-lingual…

Computation and Language · Computer Science 2025-09-30 Shulin Huang , Yiran Ding , Junshu Pan , Yue Zhang

Large vision-language models are steadily gaining personalization capabilities at the cost of fine-tuning or data augmentation. We present two models for image generation using model-agnostic learning that align semantic priors with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Aboli Marathe

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

Machine Learning · Computer Science 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou

Scalable robot policy pre-training has been hindered by the high cost of collecting high-quality demonstrations for each platform. In this study, we address this issue by uniting offline reinforcement learning (offline RL) with…

Artificial Intelligence · Computer Science 2026-02-23 Haruki Abe , Takayuki Osa , Yusuke Mukuta , Tatsuya Harada

Policy loss estimation remains a fundamental and long-standing challenge in reinforcement learning (RL) for diffusion language models (dLLMs). We introduce Reinforcement Learning from Denoising Feedback (RLDF), a novel training paradigm…

Computation and Language · Computer Science 2026-05-26 Qi He , Huan Chen , Ya Guo , Huijia Zhu , Yi R. Fung , Baojian Zhou

Multimodal representation learning seeks to create a unified representation space by integrating diverse data modalities to improve multimodal understanding. Traditional methods often depend on pairwise contrastive learning, which relies on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Motion retrieval is crucial for motion acquisition, offering superior precision, realism, controllability, and editability compared to motion generation. Existing approaches leverage contrastive learning to construct a unified embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Shiyao Yu , Zi-An Wang , Kangning Yin , Zheng Tian , Mingyuan Zhang , Weixin Si , Shihao Zou

Multimodal spatiotemporal learning on real-world experimental data is constrained by two challenges: within-modality measurements are sparse, irregular, and noisy (QA/QC artifacts) but cross-modally correlated; the set of available…

Machine Learning · Computer Science 2025-11-05 Kevin Valencia , Thilina Balasooriya , Xihaier Luo , Shinjae Yoo , David Keetae Park