English
Related papers

Related papers: Group Preference Alignment: Customized LLM Respons…

200 papers

While astonishingly capable, large Language Models (LLM) can sometimes produce outputs that deviate from human expectations. Such deviations necessitate an alignment phase to prevent disseminating untruthful, toxic, or biased information.…

Artificial Intelligence · Computer Science 2024-10-30 Long Tan Le , Han Shu , Tung-Anh Nguyen , Choong Seon Hong , Nguyen H. Tran

Understanding human behavior in urban environments is a crucial field within city sciences. However, collecting accurate behavioral data, particularly in newly developed areas, poses significant challenges. Recent advances in generative…

Artificial Intelligence · Computer Science 2025-09-08 Kai Hu , Parfait Atchade-Adelomou , Carlo Adornetto , Adrian Mora-Carrero , Luis Alonso-Pastor , Ariel Noyman , Yubo Liu , Kent Larson

Agentic reinforcement learning (Agentic RL) has achieved strong progress in tasks with clear success signals. However, many real-world agent applications require user-conditioned behavior: the same query may call for different planning…

Computation and Language · Computer Science 2026-05-25 Ranxu zhang , zeyang li , Jiacheng Huang , Rui Zhang , Xiaozhou Xu , sun zhe , Yanyong Zhang , Chao Wang

Finding an agreement among diverse opinions is a challenging topic in multiagent systems. Recently, large language models (LLMs) have shown great potential in addressing this challenge due to their remarkable capabilities in comprehending…

Computation and Language · Computer Science 2023-05-22 Shiyao Ding , Takayuki Ito

Learning Path Recommendation (LPR) is critical for personalized education, yet current methods often fail to account for historical interaction uncertainty (e.g., lucky guesses or accidental slips) and lack adaptability to diverse learning…

Information Retrieval · Computer Science 2026-04-17 Xiangrui Xiong , Hang Liang , Baiyang Chen , Zifei Pan , Yanli Lee

We present Preference Flow Matching (PFM), a new framework for preference-based reinforcement learning (PbRL) that streamlines the integration of preferences into an arbitrary class of pre-trained models. Existing PbRL methods require…

Machine Learning · Computer Science 2024-10-29 Minu Kim , Yongsik Lee , Sehyeok Kang , Jihwan Oh , Song Chong , Se-Young Yun

Large Language Models (LLMs) have shown remarkable capabilities across tasks, yet they often require additional prompting techniques when facing complex problems. While approaches like self-correction and response selection have emerged as…

Computation and Language · Computer Science 2025-04-15 Zichong Li , Xinyu Feng , Yuheng Cai , Zixuan Zhang , Tianyi Liu , Chen Liang , Weizhu Chen , Haoyu Wang , Tuo Zhao

While the flexible capabilities of large language models (LLMs) allow them to answer a range of queries based on existing learned knowledge, information retrieval to augment generation is an important tool to allow LLMs to answer questions…

Information Retrieval · Computer Science 2023-11-23 Guy Zyskind , Tobin South , Alex Pentland

Empowering large language models with long-term memory is crucial for building agents that adapt to users' evolving needs. Existing evaluations of this capability typically interleave preference-related dialogues with irrelevant…

Artificial Intelligence · Computer Science 2026-05-19 Shuochen Liu , Junyi Zhu , Long Shu , Junda Lin , Yuhao Chen , Haotian Zhang , Chao Zhang , Derong Xu , Jia Li , Bo Tang , Zhiyu Li , Feiyu Xiong , Enhong Chen , Tong Xu

Multimodal Large Language Model (MLLM) Personalization is a critical research problem that facilitates personalized dialogues with MLLMs targeting specific entities (known as personalized concepts). However, existing methods and benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Rongpei Hong , Jian Lang , Ting Zhong , Yong Wang , Fan Zhou

This study introduces GPTA, a Large Language Model assistance training framework, that enhances the training of downstream task models via prefix prompt. By minimizing data exposure to LLM, the framework addresses the security and legal…

Computation and Language · Computer Science 2024-04-02 Xiao Liu , Jiawei Zhang

Conversational recommendation frameworks have gained prominence as a dynamic paradigm for delivering personalized suggestions via interactive dialogues. The incorporation of advanced language understanding techniques has substantially…

Computation and Language · Computer Science 2025-03-17 Guanrong Li , Kuo Tian , Jinnan Qi , Qinghan Fu , Zhen Wu , Xinyu Dai

Large Language Models (LLMs) demonstrate significant advantages in leveraging structured world knowledge and multi-step reasoning capabilities. However, fundamental challenges arise when transforming LLMs into real-world recommender systems…

Information Retrieval · Computer Science 2025-11-25 Wencai Ye , Mingjie Sun , Shuhang Chen , Wenjin Wu , Peng Jiang

Personalized product search aims to retrieve and rank items that match users' preferences and search intent. Despite their effectiveness, existing approaches typically assume that users' query fully captures their real motivation. However,…

Information Retrieval · Computer Science 2025-05-20 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Ming He , Jianping Fan , Xiao Zhang , Jun Xu

There is a growing interest in developing automated agents that can work alongside humans. In addition to completing the assigned task, such an agent will undoubtedly be expected to behave in a manner that is preferred by the human. This…

Artificial Intelligence · Computer Science 2023-02-02 Utkarsh Soni , Nupur Thakur , Sarath Sreedharan , Lin Guan , Mudit Verma , Matthew Marquez , Subbarao Kambhampati

Although Large Language Models (LLMs) have made remarkable progress, current preference optimization methods still struggle to align directional consistency while preserving reasoning diversity. To address this limitation, we propose…

Computation and Language · Computer Science 2026-05-12 Mengyi Deng , Zhiwei Li , Xin Li , Tingyu Zhu , Yulan Yuan , Zhijiang Guo , Wei Wang

Large Language Models (LLMs) have recently demonstrated remarkable reasoning abilities, yet hallucinate on knowledge-intensive tasks. Retrieval-augmented generation (RAG) mitigates this issue by grounding answers in external sources, e.g.,…

Computation and Language · Computer Science 2026-01-29 Kaehyun Um , KyuHwan Yeom , Haerim Yang , Minyoung Choi , Hyeongjun Yang , Kyong-Ho Lee

The rapid development of large language model (LLM) alignment algorithms has resulted in a complex and fragmented landscape, with limited clarity on the effectiveness of different methods and their inter-connections. This paper introduces…

The growing number of Large Language Models (LLMs) with diverse capabilities and response styles provides users with a wider range of choices, which presents challenges in selecting appropriate LLMs, as user preferences vary in terms of…

Machine Learning · Computer Science 2025-11-24 Zhongjie Dai , Tao Feng , Jiaxuan You

Aligning with personalized preferences, which vary significantly across cultural, educational, and political differences, poses a significant challenge due to the computational costs and data demands of traditional alignment methods. In…

Computation and Language · Computer Science 2025-03-14 Ruizhe Chen , Xiaotian Zhang , Meng Luo , Wenhao Chai , Zuozhu Liu