English
Related papers

Related papers: Personalized LLM Response Generation with Paramete…

200 papers

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

Artificial Intelligence · Computer Science 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

Fine-tuning large language models (LLMs) typically relies on producing large sets of input-output pairs. Yet for a given question, there can be many valid outputs. In practice, these outputs are often derived by distilling knowledge from…

Computation and Language · Computer Science 2025-08-28 Xuan Ren , Qi Chen , Lingqiao Liu

Fine-tuning large language models (LLMs) on downstream tasks requires substantial computational resources. Selective PEFT, a class of parameter-efficient fine-tuning (PEFT) methodologies, aims to mitigate these computational challenges by…

Computation and Language · Computer Science 2025-06-24 Aradhye Agarwal , Suhas K Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Personalization, the ability to tailor a system to individual users, is an essential factor in user experience with natural language processing (NLP) systems. With the emergence of Large Language Models (LLMs), a key question is how to…

Computation and Language · Computer Science 2023-11-01 Chris Richardson , Yao Zhang , Kellen Gillespie , Sudipta Kar , Arshdeep Singh , Zeynab Raeesy , Omar Zia Khan , Abhinav Sethy

A common approach to personalization in large language models (LLMs) is to incorporate a subset of the user memory into the prompt at inference time to guide the model's generation. Existing methods select these subsets primarily using…

Artificial Intelligence · Computer Science 2026-04-17 Jillian Fisher , Jennifer Neville , Chan Young Park

Personalized text generation requires a unique ability of large language models (LLMs) to learn from context that they often do not encounter during their standard training. One way to encourage LLMs to better use personalized context for…

Computation and Language · Computer Science 2025-01-09 Alireza Salemi , Cheng Li , Mingyang Zhang , Qiaozhu Mei , Weize Kong , Tao Chen , Zhuowan Li , Michael Bendersky , Hamed Zamani

In recent years, Large Language Models (LLMs) have emerged as a prominent area of interest across various research domains, including Process Mining (PM). Current applications in PM have predominantly centered on prompt engineering…

Computation and Language · Computer Science 2025-09-04 Rafael Seidi Oyamada , Jari Peeperkorn , Jochen De Weerdt , Johannes De Smedt

Reinforcement learning from human feedback (RLHF) is widely used to train large language models (LLMs). However, it is unclear whether LLMs accurately learn the underlying preferences in human feedback data. We coin the term \textit{Learned…

Machine Learning · Computer Science 2025-09-22 Luke Marks , Amir Abdullah , Clement Neo , Rauno Arike , David Krueger , Philip Torr , Fazl Barez

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Recent developments in Language Models (LMs) have shown their effectiveness in NLP tasks, particularly in knowledge-intensive tasks. However, the mechanisms underlying knowledge storage and memory access within their parameters remain…

Computation and Language · Computer Science 2024-07-23 Tongyao Zhu , Qian Liu , Liang Pang , Zhengbao Jiang , Min-Yen Kan , Min Lin

The entry of large language models (LLMs) into research and commercial spaces has led to a trend of ever-larger models, with initial promises of generalisability, followed by a widespread desire to downsize and create specialised models…

Computation and Language · Computer Science 2024-02-19 Niall Taylor , Upamanyu Ghose , Omid Rohanian , Mohammadmahdi Nouriborji , Andrey Kormilitzin , David Clifton , Alejo Nevado-Holgado

Large language models (LLMs) have demonstrated remarkable proficiency in a range of natural language processing tasks. Once deployed, LLMs encounter users with personalized factual knowledge, and such personalized knowledge is consistently…

Artificial Intelligence · Computer Science 2024-05-31 Jingwei Sun , Zhixu Du , Yiran Chen

Large language models (LLMs) have shown remarkable in-context learning (ICL) capabilities, yet their potential for sequential decision-making remains underexplored. In this paper, we study the ICL capabilities of LLMs in sequential…

Machine Learning · Computer Science 2026-05-12 Minmin Zhang , Sina Aghaei , Soroush Saghafian

Large Language Models (LLMs) have achieved impressive capabilities in various context-based text generation tasks, such as summarization and reasoning; however, their applications in intention-based generation tasks remain underexplored.…

Computation and Language · Computer Science 2026-03-02 Zhexiong Liu , Diane Litman

Parameter-efficient fine-tuning (PEFT) methods, which fine-tune only a subset of model parameters, offer a promising solution by reducing the computational costs of tuning large language models (LLMs) while maintaining their performance.…

Software Engineering · Computer Science 2025-11-25 André Storhaug , Jingyue Li

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf

We introduce a large language model (LLM) capable of processing speech inputs and show that tuning it further with reinforcement learning on human preference (RLHF) enables it to adapt better to disordered speech than traditional…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Chirag Nagpal , Subhashini Venugopalan , Jimmy Tobin , Marilyn Ladewig , Katherine Heller , Katrin Tomanek

Personalized large language models (LLMs) are designed to tailor responses to individual user preferences. While Reinforcement Learning from Human Feedback (RLHF) is a commonly used framework for aligning LLMs with human preferences,…

Computation and Language · Computer Science 2024-12-10 Xinyu Li , Ruiyang Zhou , Zachary C. Lipton , Liu Leqi

Large language models (LLMs) have significantly advanced the field of natural language processing (NLP) through their extensive parameters and comprehensive data utilization. However, existing LLMs lack a dedicated memory unit, limiting…

Computation and Language · Computer Science 2024-10-25 Ali Modarressi , Ayyoob Imani , Mohsen Fayyaz , Hinrich Schütze