English
Related papers

Related papers: GRCF: Two-Stage Groupwise Ranking and Calibration …

200 papers

Multimodal sentiment analysis relies on textual, acoustic, and visual signals, yet real-world data often suffer from modality missing and quality imbalance. Existing methods generate features for modality missing from available ones, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chenglizhao Chen , Yuchen Cao , Xinyu Liu , Mengke Song , Guisheng Zhang , Xiaomin Yu

Group Relative Policy Optimization (GRPO) has emerged as an effective method for training reasoning models. While it computes advantages based on group mean, GRPO treats each output as an independent sample during the optimization and…

Artificial Intelligence · Computer Science 2026-03-16 Yu Li , Tian Lan , Zhengling Qi

In a multi-stage recommendation system, reranking plays a crucial role in modeling intra-list correlations among items. A key challenge lies in exploring optimal sequences within the combinatorial space of permutations. Recent research…

Information Retrieval · Computer Science 2025-10-30 Zhijie Lin , Zhuofeng Li , Chenglei Dai , Wentian Bao , Shuai Lin , Enyun Yu , Haoxiang Zhang , Liang Zhao

Centralized multimodal learning commonly compresses language, acoustic, and visual signals into a single fused representation for prediction. While effective, this paradigm suffers from two limitations: modality dominance, where…

Machine Learning · Computer Science 2026-05-12 Chunlei Meng , Pengbin Feng , Rong Fu , Hoi Leong Lee , Xiaojing Du , Zhaolu Kang , Zeyu Zhang , Weilin Zhou , Chun Ouyang , Zhongxue Gan

Training multi-modal large language models (MLLMs) that align with human intentions is a long-term challenge. Traditional score-only reward models for alignment suffer from low accuracy, weak generalization, and poor interpretability,…

Artificial Intelligence · Computer Science 2025-05-27 Jiayi Zhou , Jiaming Ji , Boyuan Chen , Jiapeng Sun , Wenqi Chen , Donghai Hong , Sirui Han , Yike Guo , Yaodong Yang

Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progress of multimodal large language models (MLLMs) via supervised fine-tuning, their "black-box"…

Computation and Language · Computer Science 2026-04-14 Miaosen Luo , Zhenhao Yang , Jieshen Long , Jinghu Sun , Yichu Liu , Sijie Mai

Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain…

Machine Learning · Computer Science 2026-04-14 Yang Zhao , Hepeng Wang , Xiao Ding , Yangou Ouyang , Bibo Cai , Kai Xiong , Jinglong Gao , Zhouhao Sun , Li Du , Bing Qin , Ting Liu

Group Relative Policy Optimisation (GRPO) enhances large language models by estimating advantages across a group of sampled trajectories. However, mapping these trajectory-level advantages to policy updates requires aggregating token-level…

The evolution of Large Language Models (LLMs) has catalyzed a paradigm shift from superficial instruction following to rigorous long-horizon reasoning. While Group Relative Policy Optimization (GRPO) has emerged as a pivotal mechanism for…

Artificial Intelligence · Computer Science 2026-01-01 Xuan Xie , Xuan Wang , Wenjie Wang , Shuai Chen , Wei Lin

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

Computation and Language · Computer Science 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian

Group Relative Policy Optimization (GRPO) is a promising policy-based approach for Large Language Model alignment, yet its performance is often limited by training instability and suboptimal convergence. In this paper, we identify and…

Machine Learning · Computer Science 2025-12-12 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino , Paolo Mori

Over recent decades, extensive research has aimed to overcome the restrictive underlying assumptions required for a Generalized Linear Model to generate accurate and meaningful predictions. These efforts include regularizing coefficients,…

Machine Learning · Computer Science 2025-05-16 Yuval Ben Dror

Explainable speech quality assessment requires moving beyond Mean Opinion Scores (MOS) to analyze underlying perceptual dimensions. To address this, we introduce a novel post-training method that tailors the foundational Audio Large…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-12 Elizaveta Kostenok , Mathieu Salzmann , Milos Cernak

In terms of human-computer interaction, it is becoming more and more important to correctly understand the user's emotional state in a conversation, so the task of multimodal emotion recognition (MER) started to receive more attention.…

Computation and Language · Computer Science 2024-01-04 Wei Ai , FuChen Zhang , Tao Meng , YunTao Shou , HongEn Shao , Keqin Li

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Although Large Language Models (LLMs) have made remarkable progress, current preference optimization methods still struggle to align directional consistency while preserving reasoning diversity. To address this limitation, we propose…

Computation and Language · Computer Science 2026-05-12 Mengyi Deng , Zhiwei Li , Xin Li , Tingyu Zhu , Yulan Yuan , Zhijiang Guo , Wei Wang

In recommendation systems, the traditional multi-stage paradigm, which includes retrieval and ranking, often suffers from information loss between stages and diminishes performance. Recent advances in generative models, inspired by natural…

Information Retrieval · Computer Science 2025-04-24 Luankang Zhang , Kenan Song , Yi Quan Lee , Wei Guo , Hao Wang , Yawen Li , Huifeng Guo , Yong Liu , Defu Lian , Enhong Chen

Multimodal Sentiment Analysis (MSA) is an important research area that aims to understand and recognize human sentiment through multiple modalities. The complementary information provided by multimodal fusion promotes better sentiment…

Contrastive learning has gained widespread adoption for retrieval tasks due to its minimal requirement for manual annotations. However, popular training frameworks typically learn from binary (positive/negative) relevance, making them…

Information Retrieval · Computer Science 2025-04-29 Tianyu Zhu , Myong Chol Jung , Jesse Clark

Adapting large language models (LLMs) for specific tasks usually involves fine-tuning through reinforcement learning with human feedback (RLHF) on preference data. While these data often come from diverse labelers' groups (e.g., different…

Computation and Language · Computer Science 2024-05-31 Shyam Sundhar Ramesh , Yifan Hu , Iason Chaimalas , Viraj Mehta , Pier Giuseppe Sessa , Haitham Bou Ammar , Ilija Bogunovic
‹ Prev 1 2 3 10 Next ›