English
Related papers

Related papers: Low-Burden LLM-Based Preference Learning: Personal…

200 papers

Personalized preference alignment for large language models (LLMs), the process of tailoring LLMs to individual users' preferences, is an emerging research direction spanning the area of NLP and personalization. In this survey, we present…

Expressive robotic behavior is essential for the widespread acceptance of robots in social environments. Recent advancements in learned legged locomotion controllers have enabled more dynamic and versatile robot behaviors. However,…

Robotics · Computer Science 2025-04-02 Jaden Clark , Joey Hejna , Dorsa Sadigh

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Large language models (LLMs) have demonstrated high performance on tasks expressed in natural language, particularly in zero- or few-shot settings. These are typically framed as supervised (e.g., classification) or unsupervised (e.g.,…

Computation and Language · Computer Science 2026-02-27 Yarik Menchaca Resendiz , Roman Klinger

Large language models (LLMs) have shown remarkable success, but aligning them with human preferences remains a core challenge. As individuals have their own, multi-dimensional preferences, recent studies have explored multi-dimensional…

Machine Learning · Computer Science 2025-06-03 Minhyeon Oh , Seungjoon Lee , Jungseul Ok

Reinforcement learning based fine-tuning of large language models (LLMs) on human preferences has been shown to enhance both their capabilities and safety behavior. However, in cases related to safety, without precise instructions to human…

Artificial Intelligence · Computer Science 2024-11-05 Tong Mu , Alec Helyar , Johannes Heidecke , Joshua Achiam , Andrea Vallone , Ian Kivlichan , Molly Lin , Alex Beutel , John Schulman , Lilian Weng

Home robots performing personalized tasks must adeptly balance user preferences with environmental affordances. We focus on organization tasks within constrained spaces, such as arranging items into a refrigerator, where preferences for…

Large language models (LLMs) have recently received significant attention for their exceptional capabilities. Despite extensive efforts in developing general-purpose LLMs that can be utilized in various natural language processing (NLP)…

Information Retrieval · Computer Science 2023-06-08 Fan Yang , Zheng Chen , Ziyan Jiang , Eunah Cho , Xiaojiang Huang , Yanbin Lu

Ensuring Large Language Models (LLMs) align with diverse human preferences while preserving privacy and fairness remains a challenge. Existing methods, such as Reinforcement Learning from Human Feedback (RLHF), rely on centralized data…

Machine Learning · Computer Science 2025-03-14 Mahmoud Srewa , Tianyu Zhao , Salma Elmalaki

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

Generalizable alignment is a core challenge for deploying Large Language Models (LLMs) safely in real-world NLP applications. Current alignment methods, including Reinforcement Learning from Human Feedback (RLHF), often fail to guarantee…

Computation and Language · Computer Science 2025-04-07 Jaymari Chua , Chen Wang , Lina Yao

Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like retrieval. We attribute this to a mismatch between LLMs'…

Information Retrieval · Computer Science 2024-04-02 Yuwei Cao , Nikhil Mehta , Xinyang Yi , Raghunandan Keshavan , Lukasz Heldt , Lichan Hong , Ed H. Chi , Maheswaran Sathiamoorthy

Tool learning has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools. Existing tool learning studies primarily focus on the general-purpose tool-use capability, which addresses…

Computation and Language · Computer Science 2025-02-27 Qiancheng Xu , Yongqi Li , Heming Xia , Fan Liu , Min Yang , Wenjie Li

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Despite advances in Preference Alignment (PA) for Large Language Models (LLMs), mainstream methods like Reinforcement Learning with Human Feedback (RLHF) face notable challenges. These approaches require high-quality datasets of positive…

Machine Learning · Computer Science 2025-04-10 Xiaohua Feng , Yuyuan Li , Huwei Ji , Jiaming Zhang , Li Zhang , Tianyu Du , Chaochao Chen

Socially assistive robots (SARs) have shown great potential for supplementing well-being support. However, prior studies have found that existing dialogue pipelines for SARs remain limited in real-time latency, back-channeling, and…

Robotics · Computer Science 2025-07-22 Mengxue Fu , Zhonghao Shi , Minyu Huang , Siqi Liu , Mina Kian , Yirui Song , Maja J. Matarić

Language models (LMs) are pretrained to imitate internet text, including content that would violate human preferences if generated by an LM: falsehoods, offensive comments, personally identifiable information, low-quality or buggy code, and…

Computation and Language · Computer Science 2023-06-16 Tomasz Korbak , Kejian Shi , Angelica Chen , Rasika Bhalerao , Christopher L. Buckley , Jason Phang , Samuel R. Bowman , Ethan Perez

In social impact optimization, AI decision systems often rely on solvers that optimize well-calibrated mathematical objectives. However, these solvers cannot directly accommodate evolving human preferences, typically expressed in natural…

Artificial Intelligence · Computer Science 2025-09-23 Guojun Xiong , Milind Tambe

We demonstrate experimental results with LLMs that address robotics task planning problems. Recently, LLMs have been applied in robotics task planning, particularly using a code generation approach that converts complex high-level…

Robotics · Computer Science 2024-04-09 Yusuke Mikami , Andrew Melnik , Jun Miura , Ville Hautamäki

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

Robotics · Computer Science 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao