English
Related papers

Related papers: PMG : Personalized Multimodal Generation with Larg…

200 papers

Personalized large language models (LLMs) are designed to tailor responses to individual user preferences. While Reinforcement Learning from Human Feedback (RLHF) is a commonly used framework for aligning LLMs with human preferences,…

Computation and Language · Computer Science 2024-12-10 Xinyu Li , Ruiyang Zhou , Zachary C. Lipton , Liu Leqi

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach,…

This paper presents a novel approach to aligning large language models (LLMs) with individual human preferences, sometimes referred to as Reinforcement Learning from \textit{Personalized} Human Feedback (RLPHF). Given stated preferences…

Artificial Intelligence · Computer Science 2024-07-08 Jin Peng Zhou , Katie Z Luo , Jingwen Gu , Jason Yuan , Kilian Q. Weinberger , Wen Sun

Learning from preference feedback is essential for aligning large language models (LLMs) with human values and improving the quality of generated responses. However, existing preference learning methods rely heavily on curated data from…

Computation and Language · Computer Science 2025-06-06 Zhaoxuan Tan , Zheng Li , Tianyi Liu , Haodong Wang , Hyokun Yun , Ming Zeng , Pei Chen , Zhihan Zhang , Yifan Gao , Ruijie Wang , Priyanka Nigam , Bing Yin , Meng Jiang

The widespread application of pre-trained language models (PLMs) in natural language processing (NLP) has led to increasing concerns about their explainability. Selective rationalization is a self-explanatory framework that selects…

Computation and Language · Computer Science 2025-01-07 Libing Yuan , Shuaibo Hu , Kui Yu , Le Wu

Different users find different images generated for the same prompt desirable. This gives rise to personalized image generation which involves creating images aligned with an individual's visual preference. Current generative models are,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Sogand Salehi , Mahdi Shafiei , Teresa Yeo , Roman Bachmann , Amir Zamir

Large Language Model (LLM) personalization holds great promise for tailoring responses by leveraging personal context and history. However, real-world users usually possess sparse interaction histories with limited personal context, such as…

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. While recent research has…

Computation and Language · Computer Science 2025-10-01 Sergio E. Zanotto , Segun Aroyehun

Predicting human daily behavior is challenging due to the complexity of routine patterns and short-term fluctuations. While data-driven models have improved behavior prediction by leveraging empirical data from various platforms and…

Machine Learning · Computer Science 2025-05-26 Haoxin Li , Jingtao Ding , Jiahui Gong , Yong Li

Personalized preference alignment for large language models (LLMs), the process of tailoring LLMs to individual users' preferences, is an emerging research direction spanning the area of NLP and personalization. In this survey, we present…

Recent advances in Generative Artificial Intelligence, particularly Large Language Models (LLMs), have stimulated growing interest in automating or assisting Business Process Modeling tasks using natural language. Several approaches have…

Software Engineering · Computer Science 2026-04-16 João Bettencourt , Sérgio Guerreiro

Large language models (LLMs) have shown promise in synthetic tabular data generation, yet existing methods struggle to preserve complex feature dependencies, particularly among categorical variables. This work introduces a…

Machine Learning · Computer Science 2025-05-07 Andrey Sidorenko

Simultaneous generation models write generation results while reading streaming inputs, necessitating a policy-maker to determine the appropriate output timing. Existing simultaneous generation methods generally adopt the traditional…

Computation and Language · Computer Science 2025-01-03 Shoutao Guo , Shaolei Zhang , Zhengrui Ma , Yang Feng

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

Retrieval-Augmented Generation (RAG), which integrates external knowledge into Large Language Models (LLMs), has proven effective in enabling LLMs to produce more accurate and reliable responses. However, it remains a significant challenge…

Computation and Language · Computer Science 2025-02-11 Yan Weng , Fengbin Zhu , Tong Ye , Haoyan Liu , Fuli Feng , Tat-Seng Chua

Personalized content filtering, such as recommender systems, has become a critical infrastructure to alleviate information overload. However, these systems merely filter existing content and are constrained by its limited diversity, making…

Information Retrieval · Computer Science 2025-02-05 Yiyan Xu , Wenjie Wang , Yang Zhang , Biao Tang , Peng Yan , Fuli Feng , Xiangnan He

Personalized LLMs can significantly enhance user experiences by tailoring responses to preferences such as helpfulness, conciseness, and humor. However, fine-tuning models to address all possible combinations of user preferences is…

Computation and Language · Computer Science 2026-05-11 Jinyan Su , Jinpeng Zhou , Claire Cardie , Wen Sun

Large Language Models (LLMs) have made remarkable advancements in the field of natural language processing. However, their increasing size poses challenges in terms of computational cost. On the other hand, Small Language Models (SLMs) are…

Computation and Language · Computer Science 2023-08-03 Zhen Guo , Peiqi Wang , Yanwei Wang , Shangdi Yu

With the recent advancement in large language models (LLMs), there is a growing interest in combining LLMs with multimodal learning. Previous surveys of multimodal large language models (MLLMs) mainly focus on multimodal understanding. This…