English
Related papers

Related papers: Metis-SPECS: Decoupling Multimodal Learning via Se…

200 papers

Cold-start issues have been more and more challenging for providing accurate recommendations with the fast increase of users and items. Most existing approaches attempt to solve the intractable problems via content-aware recommendations…

Information Retrieval · Computer Science 2022-04-04 Yan Zhang , Changyu Li , Ivor W. Tsang , Hui Xu , Lixin Duan , Hongzhi Yin , Wen Li , Jie Shao

The efficacy of multimodal learning in remote sensing (RS) is severely undermined by missing modalities. The challenge is exacerbated by the RS highly heterogeneous data and huge scale variation. Consequently, paradigms proven effective in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

Partial observability is a notorious challenge in reinforcement learning (RL), due to the need to learn complex, history-dependent policies. Recent empirical successes have used privileged expert distillation--which leverages availability…

Machine Learning · Computer Science 2025-10-06 Yuda Song , Dhruv Rohatgi , Aarti Singh , J. Andrew Bagnell

Reinforcement learning (RL) plays a central role in improving the reasoning and alignment of large language models, yet its efficiency critically depends on how training data are selected. Existing online selection strategies predominantly…

Machine Learning · Computer Science 2026-03-03 Xinyu Zhou , Boyu Zhu , Haotian Zhang , Huiming Wang , Zhijiang Guo

Preference-based finetuning of vision--language models (VLMs) is brittle: trivially wrong negatives inject uninformative gradients that destabilize training. We recast alignment as \textbf{learning-dynamics--aware optimization} and…

Machine Learning · Computer Science 2025-10-15 Jusheng Zhang , Kaitong Cai , Jing Yang , Keze Wang

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

Machine Learning · Computer Science 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

This paper proposes the DistillCSE framework, which performs contrastive learning under the self-training paradigm with knowledge distillation. The potential advantage of DistillCSE is its self-enhancing feature: using a base model to…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu

Semantic segmentation in remote sensing images is crucial for various applications, yet its performance is heavily reliant on large-scale, high-quality pixel-wise annotations, which are notoriously expensive and time-consuming to acquire.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Jiayi Song , Kaiyu Li , Xiangyong Cao , Deyu Meng

Test-time scaling has proven effective in further enhancing the performance of pretrained Large Language Models (LLMs). However, mainstream post-training methods (i.e., reinforcement learning (RL) with chain-of-thought (CoT) reasoning)…

Machine Learning · Computer Science 2025-08-19 Yuyang Xu , Yi Cheng , Haochao Ying , Zhuoyun Du , Renjun Hu , Xing Shi , Wei Lin , Jian Wu

The push to compress and impart the proficiency of Large Language Models (LLMs) into more deployable and efficient Small Language Models (SLMs) has benefited from improvements in knowledge distillation (KD) techniques. These techniques…

Artificial Intelligence · Computer Science 2025-07-02 Shreyansh Padarha

The ability of LLMs to represent diverse perspectives is critical as they increasingly impact society. However, recent studies reveal that alignment algorithms such as RLHF and DPO significantly reduce the diversity of LLM outputs. Not only…

Computation and Language · Computer Science 2025-11-13 Stewart Slocum , Asher Parker-Sartori , Dylan Hadfield-Menell

Reinforcement learning (RL) has been effective for post-training autoregressive (AR) language models, but extending these methods to diffusion language models (DLMs) is challenging due to intractable sequence-level likelihoods. Existing…

In LLM Reinforcement Fine-Tuning (RFT), curriculum learning drives both efficiency and performance. Yet, current methods externalize curriculum judgment via handcrafted heuristics or auxiliary models, risking misalignment with the policy's…

Machine Learning · Computer Science 2026-05-13 Han Zheng , Yining Ma , Karthick Gunasekaran , Bharathan Balaji , Zheng Du , Shiv Vitaladevuni , Cathy Wu

Prompt learning as a parameter-efficient method that has been widely adopted to adapt Vision-Language Models (VLMs) to downstream tasks. While hard-prompt design requires domain expertise and iterative optimization, soft-prompt methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zherui Zhang , Jiaxin Wu , Changwei Wang , Rongtao Xu , Longzhao Huang , Wenhao Xu , Wenbo Xu , Li Guo , Shibiao Xu

Process Reinforcement Learning~(PRL) has demonstrated considerable potential in enhancing the reasoning capabilities of Large Language Models~(LLMs). However, introducing additional process reward models incurs substantial computational…

Machine Learning · Computer Science 2025-07-04 Wu Fei , Hao Kong , Shuxian Liang , Yang Lin , Yibo Yang , Jing Tang , Lei Chen , Xiansheng Hua

Preference optimization is widely used to align large language models (LLMs) with human preferences. However, many margin-based methods also suppress the chosen response when they try to suppress the rejected one, and there is no general…

Machine Learning · Computer Science 2026-05-04 Wei Chen , Yubing Wu , Junmei Yang , Delu Zeng , Qibin Zhao , John Paisley , Min Chen , Zhou Wang

Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in shaping robot behavior by expressing preferences on different sequences of state-action pairs. However,…

Robotics · Computer Science 2024-02-26 Simon Holk , Daniel Marta , Iolanda Leite

Training reasoning language models (LMs) with reinforcement learning (RL) for one-hot correctness inherently relies on the LM being able to explore and solve its task with some chance at initialization. Furthermore, a key use case of…

Machine Learning · Computer Science 2025-10-30 Edoardo Cetin , Tianyu Zhao , Yujin Tang

Continual self-supervised learning (CSSL) methods have gained increasing attention in remote sensing (RS) due to their capability to learn new tasks sequentially from continuous streams of unlabeled data. Existing CSSL methods, while…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Lars Möllenbrok , Behnood Rasti , Begüm Demir

Federated Learning (FL) stands as a prominent distributed learning paradigm among multiple clients to achieve a unified global model without privacy leakage. In contrast to FL, Personalized federated learning aims at serving for each client…

Machine Learning · Computer Science 2026-03-24 Tao Feng , Jie Zhang , Xiangjian Li , Rong Huang , Huashan Liu , Zhijie Wang