English
Related papers

Related papers: DecoupledESC: Enhancing Emotional Support Generati…

200 papers

Large Language Models (LLMs) have become pivotal in advancing natural language processing, yet their potential to perpetuate biases poses significant concerns. This paper introduces a new framework employing Direct Preference Optimization…

Computation and Language · Computer Science 2024-07-22 Ahmed Allam

In the realm of recommendation systems, users exhibit a diverse array of behaviors when interacting with items. This phenomenon has spurred research into learning the implicit semantic relationships between these behaviors to enhance…

Information Retrieval · Computer Science 2024-08-22 Hao Wang , Yongqiang Han , Kefan Wang , Kai Cheng , Zhen Wang , Wei Guo , Yong Liu , Defu Lian , Enhong Chen

In the domain of complex reasoning tasks, such as mathematical reasoning, recent advancements have proposed the use of Direct Preference Optimization (DPO) to suppress output of dispreferred responses, thereby enhancing the long-chain…

Computation and Language · Computer Science 2025-10-27 Weibin Liao , Xu Chu , Yasha Wang

Diffusion models have achieved impressive results in generative tasks such as text-to-image synthesis, yet they often struggle to fully align outputs with nuanced user intent and maintain consistent aesthetic quality. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dohyun Kim , Seungwoo Lyu , Seung Wook Kim , Paul Hongsuck Seo

In large language model (LLM)-based recommendation systems, direct preference optimization (DPO) effectively aligns recommendations with user preferences, requiring multi-negative objective functions to leverage abundant implicit-feedback…

Information Retrieval · Computer Science 2026-05-04 Xingyu Hu , Kai Zhang , Jiancan Wu , Shuli Wang , Chi Wang , Wenshuai Chen , Yinhua Zhu , Haitao Wang , Xingxing Wang , Xiang Wang

Effective training of language models (LMs) for mathematical reasoning tasks demands high-quality supervised fine-tuning data. Besides obtaining annotations from human experts, a common alternative is sampling from larger and more powerful…

Computation and Language · Computer Science 2024-07-26 Tianduo Wang , Shichen Li , Wei Lu

Direct Preference Optimization (DPO) using an implicit reward model has proven to be an effective alternative to reinforcement learning from human feedback (RLHF) for fine-tuning preference aligned large language models (LLMs). However, the…

Computation and Language · Computer Science 2024-09-30 Guoxin Chen , Minpeng Liao , Chengxi Li , Kai Fan

Aligning Large Language Models (LLMs) with human feedback is crucial for their development. Existing preference optimization methods such as DPO and KTO, while improved based on Reinforcement Learning from Human Feedback (RLHF), are…

Computation and Language · Computer Science 2024-12-23 Shuo Xie , Fangzhi Zhu , Jiahui Wang , Lulu Wen , Wei Dai , Xiaowei Chen , Junxiong Zhu , Kai Zhou , Bo Zheng

Direct alignment methods typically train large language models (LLMs) by contrasting the likelihoods of preferred and dispreferred responses. While effective at capturing relative preferences, these methods are widely observed to suppress…

Computation and Language · Computer Science 2025-12-04 Kaiyang Guo , Yinchuan Li , Zhitang Chen

Diffusion models have achieved promising results for Structure-Based Drug Design (SBDD). Nevertheless, high-quality protein subpocket and ligand data are relatively scarce, which hinders the models' generation capabilities. Recently, Direct…

Biomolecules · Quantitative Biology 2026-02-11 Xiwei Cheng , Xiangxin Zhou , Yuwei Yang , Yu Bao , Quanquan Gu

Direct Preference Optimization (DPO) has recently emerged as a simple and effective alternative to reinforcement learning from human feedback (RLHF) for aligning large language models (LLMs) with user preferences. However, existing DPO…

Machine Learning · Computer Science 2025-10-10 Jason Bohne , Pawel Polak , David Rosenberg , Brian Bloniarz , Gary Kazantsev

Emotional Support Conversation (ESC) plays a critical role in mental health assistance by providing accessible psychological support in real-world applications. Large Language Models (LLMs) have shown strong empathetic abilities in ESC…

Computation and Language · Computer Science 2026-04-21 Lin Zhong , Renjin Zhu , Shujuan Ma , Jinhao Cui , Lingzhi Wang , Hao Chen , Qing Liao

Direct Preference Optimization (DPO) is a simple and efficient framework that has attracted substantial attention. However, it often struggles to meet its primary objectives -- increasing the generation probability of chosen responses while…

Artificial Intelligence · Computer Science 2025-06-17 Jay Hyeon Cho , JunHyeok Oh , Myunsoo Kim , Byung-Jun Lee

Use of the electroencephalogram (EEG) and machine learning approaches to recognize emotions can facilitate affective human computer interactions. However, the type of EEG data constitutes an obstacle for cross-individual EEG feature…

Machine Learning · Computer Science 2021-05-26 Xiaolong Zhong , Zhong Yin

Recent advancements in large language model alignment leverage token-level supervisions to perform fine-grained preference optimization. However, existing token-level alignment methods either optimize on all available tokens, which can be…

Computation and Language · Computer Science 2025-11-07 Kailai Yang , Zhiwei Liu , Qianqian Xie , Jimin Huang , Erxue Min , Sophia Ananiadou

Recommender systems aim to predict personalized rankings based on user preference data. With the rise of Language Models (LMs), LM-based recommenders have been widely explored due to their extensive world knowledge and powerful reasoning…

Information Retrieval · Computer Science 2024-11-08 Yuxin Chen , Junfei Tan , An Zhang , Zhengyi Yang , Leheng Sheng , Enzhi Zhang , Xiang Wang , Tat-Seng Chua

Emotional Support Conversation (ESC) aims to provide empathetic and effective emotional assistance through dialogue, addressing the growing demand for mental health support. This paper presents our solution for the NLPCC 2025 Task 8 ESC…

Artificial Intelligence · Computer Science 2025-12-12 Shiquan Wang , Ruiyu Fang , Zhongjiang He , Shuangyong Song , Yongxiang Li

Personalization and contextual coherence are two essential components in building effective persona-grounded dialogue systems. These aspects play a crucial role in enhancing user engagement and ensuring responses are more relevant and…

Computation and Language · Computer Science 2026-02-05 Saleh Afzoon , MohammadHossein Ahmadi , Usman Naseem , Amin Beheshti

We propose Process-Aware Policy Optimization (PAPO), a method that integrates process-level evaluation into Group Relative Policy Optimization (GRPO) through decoupled advantage normalization, to address two limitations of existing reward…

Artificial Intelligence · Computer Science 2026-04-06 Zelin Tan , Zhouliang Yu , Bohan Lin , Zijie Geng , Hejia Geng , Yudong Zhang , Mulei Zhang , Yang Chen , Shuyue Hu , Zhenfei Yin , Chen Zhang , Lei Bai

Data-driven evolutionary multi-objective optimization (EMO) has been recognized as an effective approach for multi-objective optimization problems with expensive objective functions. The current research is mainly developed for problems…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Renzhi Chen , Ke Li
‹ Prev 1 3 4 5 6 7 10 Next ›