English
Related papers

Related papers: Metis-SPECS: Decoupling Multimodal Learning via Se…

200 papers

This paper explores meta-learning in sequential recommendation to alleviate the item cold-start problem. Sequential recommendation aims to capture user's dynamic preferences based on historical behavior sequences and acts as a key component…

Information Retrieval · Computer Science 2020-12-11 Yujia Zheng , Siyi Liu , Zekun Li , Shu Wu

Sequential recommenders have made great strides in capturing a user's preferences. Nevertheless, the cold-start recommendation remains a fundamental challenge as they typically involve limited user-item interactions for personalization.…

Information Retrieval · Computer Science 2023-08-22 Minchang Kim , Yongjin Yang , Jung Hyun Ryu , Taesup Kim

Supervised fine-tuning (SFT) is fundamental to adapting large language models, yet training on complete datasets incurs prohibitive costs with diminishing returns. Existing data selection methods suffer from severe domain specificity:…

Computation and Language · Computer Science 2026-02-02 Junyou Su , He Zhu , Xiao Luo , Liyu Zhang , Hong-Yu Zhou , Yun Chen , Peng Li , Yang Liu , Guanhua Chen

Reinforcement learning from verifiable rewards (RLVR) suffers from sparse outcome signals, creating severe exploration bottlenecks on complex reasoning tasks. Recent on-policy self-distillation methods attempt to address this by utilizing…

Machine Learning · Computer Science 2026-05-20 Yang Li , Erik Nijkamp , Semih Yavuz , Shafiq Joty

Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how to ground language to observations is difficult due to…

Machine Learning · Computer Science 2022-10-04 Victor Zhong , Jesse Mu , Luke Zettlemoyer , Edward Grefenstette , Tim Rocktäschel

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

Machine Learning · Computer Science 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Post-training with Reinforcement Learning (RL) has substantially improved reasoning in Large Language Models (LLMs) via test-time scaling. However, extending this paradigm to Multimodal LLMs (MLLMs) through verbose rationales yields limited…

Computation and Language · Computer Science 2026-02-16 Bangzheng Li , Jianmo Ni , Chen Qu , Ian Miao , Liu Yang , Xingyu Fu , Muhao Chen , Derek Zhiyuan Cheng

Pre-trained Vision-Language (VL) models such as CLIP have demonstrated their excellent performance across numerous downstream tasks. A recent method, Context Optimization (CoOp), further improves the performance of VL models on downstream…

Computation and Language · Computer Science 2024-12-23 Biao Liu , Wenyi Fang , Xiaoyu Wu , Yang Zheng , Zheng Hu , Bo Yuan

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

This study investigates the effectiveness of reinforcement learning (RL) fine-tuning techniques on a compact language model (Qwen2.5-0.5B Base) for two challenging tasks: instruction following and mathematical reasoning. We compare…

Computation and Language · Computer Science 2025-07-29 Yifu Han , Geo Zhang

RLHF has emerged as a predominant approach for aligning artificial intelligence systems with human preferences, demonstrating exceptional and measurable efficacy in instruction following tasks; however, it exhibits insufficient compliance…

Artificial Intelligence · Computer Science 2025-05-20 Ruopei Sun , Jianfeng Cai , Jinhua Zhu , Kangwen Zhao , Dongyun Xue , Wengang Zhou , Li Li , Houqiang Li

An internet network service provider manages its network with multiple objectives, such as high quality of service (QoS) and minimum computing resource usage. To achieve these objectives, a reinforcement learning-based (RL) algorithm has…

Networking and Internet Architecture · Computer Science 2025-06-17 DongNyeong Heo , Daniela Noemi Rim , Heeyoul Choi

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

Vision-Language-Action Models (VLAs) have demonstrated remarkable generalization capabilities in real-world experiments. However, their success rates are often not on par with expert policies, and they require fine-tuning when the setup…

Robotics · Computer Science 2025-08-05 Tobias Jülg , Wolfram Burgard , Florian Walter

We systematically evaluate Parameter-Efficient Fine-Tuning (PEFT) methods under the paradigm of Reinforcement Learning with Verifiable Rewards (RLVR). RLVR incentivizes language models to enhance their reasoning capabilities through…

Machine Learning · Computer Science 2026-01-01 Qingyu Yin , Yulun Wu , Zhennan Shen , Sunbowen Li , Zhilin Wang , Yanshu Li , Chak Tou Leong , Jiale Kang , Jinjin Gu

Offline preference-based reinforcement learning (RL), which focuses on optimizing policies using human preferences between pairs of trajectory segments selected from an offline dataset, has emerged as a practical avenue for RL applications.…

Machine Learning · Computer Science 2024-07-08 Chen-Xiao Gao , Shengjun Fang , Chenjun Xiao , Yang Yu , Zongzhang Zhang

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu

The adaptation of large-scale Vision-Language Models (VLMs) through post-training reveals a pronounced generalization gap: models fine-tuned with Reinforcement Learning (RL) consistently achieve superior out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Wei Li , Yanan Sun

Reinforcement Learning (RL) has recently emerged as a powerful technique for improving image and video generation in Diffusion and Flow Matching models, specifically for enhancing output quality and alignment with prompts. A critical step…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Feng Wang , Zihao Yu

We offer a novel perspective on reward modeling by formulating it as a policy discriminator, which quantifies the difference between two policies to generate a reward signal, guiding the training policy towards a target policy with desired…