English
Related papers

Related papers: HYDRA: Model Factorization Framework for Black-Box…

200 papers

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

Computation and Language · Computer Science 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

Personalized alignments for individual users have been a long-standing goal in large language models (LLMs). We introduce Drift, a novel framework that personalizes LLMs at decoding time with implicit user preferences. Traditional…

Computation and Language · Computer Science 2025-05-09 Minbeom Kim , Kang-il Lee , Seongho Joo , Hwaran Lee , Thibaut Thonet , Kyomin Jung

Large language models (LLMs) are increasingly integrated into users' daily lives, leading to a growing demand for personalized outputs. Previous work focuses on leveraging a user's own history, overlooking inter-user differences that are…

Computation and Language · Computer Science 2025-09-23 Yilun Qiu , Tianhao Shi , Xiaoyan Zhao , Fengbin Zhu , Yang Zhang , Fuli Feng

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

Machine Learning · Computer Science 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Large language models (LLMs) have recently shown strong reasoning capabilities beyond traditional language tasks, motivating their use for numerical optimization. This paper presents LLMize, an open-source Python framework that enables…

Machine Learning · Computer Science 2026-01-06 M. Rizki Oktavian

On online advertising platforms, newly introduced promotional ads face the cold-start problem, as they lack sufficient user feedback for model training. In this work, we propose LLM-HYPER, a novel framework that treats large language models…

The recent surge in large-scale foundation models has spurred the development of efficient methods for adapting these models to various downstream tasks. Low-rank adaptation methods, such as LoRA, have gained significant attention due to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Sanghyeon Kim , Hyunmo Yang , Younghyun Kim , Youngjoon Hong , Eunbyung Park

Purpose: Magnetic resonance fingerprinting (MRF) methods typically rely on dictio-nary matching to map the temporal MRF signals to quantitative tissue parameters. Such approaches suffer from inherent discretization errors, as well as high…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Pingfan Song , Yonina C. Eldar , Gal Mazor , Miguel Rodrigues

As LLMs become capable of complex tasks, there is growing potential for personalized interactions tailored to the subtle and idiosyncratic preferences of the user. We present a public benchmark, PersonalLLM, focusing on adapting LLMs to…

Machine Learning · Computer Science 2025-02-25 Thomas P. Zollo , Andrew Wei Tung Siah , Naimeng Ye , Ang Li , Hongseok Namkoong

This paper studies retrieval-augmented approaches for personalizing large language models (LLMs), which potentially have a substantial impact on various applications and domains. We propose the first attempt to optimize the retrieval models…

Computation and Language · Computer Science 2024-04-19 Alireza Salemi , Surya Kallumadi , Hamed Zamani

Effectively and efficiently adapting a pre-trained language model (PLM) for human-centered text understanding (HCTU) is challenging since user tokens are million-level in most personalized applications and do not have concrete explicit…

Computation and Language · Computer Science 2024-03-12 You Zhang , Jin Wang , Liang-Chih Yu , Dan Xu , Xuejie Zhang

Large language models (LLMs) have recently demonstrated strong potential for sequential recommendation. However, current LLM-based approaches face critical limitations in modeling users' long-term and diverse interests. First, due to…

Information Retrieval · Computer Science 2025-10-30 Jingyi Zhou , Cheng Chen , Kai Zuo , Manjie Xu , Zhendong Fu , Yibo Chen , Xu Tang , Yao Hu

Large language model (LLM) personalization aims to align model outputs with individuals' unique preferences and opinions. While recent efforts have implemented various personalization methods, a unified theoretical framework that can…

Computation and Language · Computer Science 2025-09-30 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Modern large language models (LLMs) are optimized for human-aligned responses using Reinforcement Learning from Human Feedback (RLHF). However, existing RLHF approaches assume a universal preference model and fail to account for individual…

Machine Learning · Computer Science 2025-03-11 Idan Shenfeld , Felix Faltings , Pulkit Agrawal , Aldo Pacchiano

In the field of Human-Robot Interaction (HRI), a fundamental challenge is to facilitate human understanding of robots. The emerging domain of eXplainable HRI (XHRI) investigates methods to generate explanations and evaluate their impact on…

Personalized large language models (LLMs) aim to tailor their outputs to user preferences. Recent advances in parameter-efficient fine-tuning (PEFT) methods have highlighted the effectiveness of adapting population-level LLMs to…

Computation and Language · Computer Science 2025-03-04 Linhai Zhang , Jialong Wu , Deyu Zhou , Yulan He

The high costs of customizing large language models (LLMs) fundamentally limit their adaptability to user-specific needs. Consequently, LLMs are increasingly offered as cloud-based services, a paradigm that introduces critical limitations:…

Computation and Language · Computer Science 2025-09-16 Jiaxuan Zhao , Naibin Gu , Yuchen Feng , Xiyu Liu , Peng Fu , Zheng Lin , Weiping Wang

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Most conventional recommendation methods (e.g., matrix factorization) represent user profiles as high-dimensional vectors. Unfortunately, these vectors lack interpretability and steerability, and often perform poorly in cold-start settings.…

Computation and Language · Computer Science 2024-02-27 Joyce Zhou , Yijia Dai , Thorsten Joachims

Large Language Models (LLMs) are increasingly deployed in domains such as education, mental health and customer support, where stable and consistent personas are critical for reliability. Yet, existing studies focus on narrative or…

Computation and Language · Computer Science 2026-01-26 Jivnesh Sandhan , Fei Cheng , Tushar Sandhan , Yugo Murawaki