中文
相关论文

相关论文: Arch-Router: Aligning LLM Routing with Human Prefe…

200 篇论文

Large Language Models (LLMs) present a critical trade-off between inference quality and computational cost: larger models offer superior capabilities but incur significant latency, while smaller models are faster but less powerful. Existing…

机器学习 · 计算机科学 2025-05-13 Hang Wu , Jianian Zhu , Yinghui Li , Haojie Wang , Biao Hou , Jidong Zhai

Achieving robust networks is a challenging problem due to its NP-hard nature and complex solution space. Current methods, from handcrafted feature extraction to deep learning, have made progress but remain rigid, requiring manual design and…

人工智能 · 计算机科学 2024-10-24 He Yu , Jing Liu

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the…

计算与语言 · 计算机科学 2024-12-19 Zhuoran Jin , Hongbang Yuan , Tianyi Men , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Alignment of Large Language Models (LLMs) aims to align outputs with human preferences, and personalized alignment further adapts models to individual users. This relies on personalized reward models that capture user-specific preferences…

计算与语言 · 计算机科学 2026-04-21 Hongru Cai , Yongqi Li , Tiezheng Yu , Fengbin Zhu , Wenjie Wang , Fuli Feng , Wenjie Li

Recent state-of-the-art recommender systems predominantly rely on either implicit or explicit feedback from users to suggest new items. While effective in recommending novel options, many recommender systems often use uninterpretable…

信息检索 · 计算机科学 2024-07-22 Jerome Ramos , Hossen A. Rahmani , Xi Wang , Xiao Fu , Aldo Lipani

The utilization of Large Language Models (LLMs) to power human-like agents has shown remarkable potential in simulating individual mobility pattern. However, a significant gap remains in modeling cohorts of agents in dynamic and interactive…

物理与社会 · 物理学 2026-03-16 Chengbo Zhang , Zuopeng Xiao

Aligning large language models (LLMs) with human preferences has become essential for safe and beneficial AI deployment. While Reinforcement Learning from Human Feedback (RLHF) established the dominant paradigm, a proliferation of…

人工智能 · 计算机科学 2026-01-13 Tarun Raheja , Nilay Pochhi

Multi-turn, long-horizon tasks are increasingly common for large language models (LLMs), but solving them typically requires many sequential model invocations, accumulating substantial inference costs. Here, we study cost-aware multi-turn…

计算与语言 · 计算机科学 2026-04-28 Yiqun Zhang , Hao Li , Zihan Wang , Shi Feng , Xiaocui Yang , Daling Wang , Bo Zhang , Lei Bai , Shuyue Hu

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

人工智能 · 计算机科学 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

The remarkable capabilities and easy accessibility of large language models (LLMs) have significantly increased societal risks (e.g., fake news generation), necessitating the development of LLM-generated text (LGT) detection methods for…

机器学习 · 计算机科学 2024-11-08 Hyunseok Lee , Jihoon Tack , Jinwoo Shin

As large language models (LLMs) enter the mainstream, aligning them to foster constructive dialogue rather than exacerbate societal divisions is critical. Using an individualized and multicultural alignment dataset of over 7,500…

人机交互 · 计算机科学 2025-03-24 Yara Kyrychenko , Jon Roozenbeek , Brandon Davidson , Sander van der Linden , Ramit Debnath

Accurately modeling user preferences is crucial for improving the performance of content-based recommender systems. Existing approaches often rely on simplistic user profiling methods, such as averaging or concatenating item embeddings,…

信息检索 · 计算机科学 2025-08-13 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

As large language models (LLMs) are deployed in high-stakes domains like healthcare, understanding how well their decision-making aligns with human preferences and values becomes crucial, especially when we recognize that there is no single…

计算与语言 · 计算机科学 2024-10-01 Isaac Kohane

Aligning agent behaviors with diverse human preferences remains a challenging problem in reinforcement learning (RL), owing to the inherent abstractness and mutability of human preferences. To address these issues, we propose AlignDiff, a…

人工智能 · 计算机科学 2024-02-06 Zibin Dong , Yifu Yuan , Jianye Hao , Fei Ni , Yao Mu , Yan Zheng , Yujing Hu , Tangjie Lv , Changjie Fan , Zhipeng Hu

This paper presents a novel approach to aligning large language models (LLMs) with individual human preferences, sometimes referred to as Reinforcement Learning from \textit{Personalized} Human Feedback (RLPHF). Given stated preferences…

人工智能 · 计算机科学 2024-07-08 Jin Peng Zhou , Katie Z Luo , Jingwen Gu , Jason Yuan , Kilian Q. Weinberger , Wen Sun

As large language models (LLMs) grow in scale and specialization, routing--selecting the best model for a given input--has become essential for efficient and effective deployment. While recent methods rely on complex learned routing…

机器学习 · 计算机科学 2026-05-18 Yang Li

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or…

计算与语言 · 计算机科学 2025-12-18 Xiaotian Zhang , Yuan Wang , Ruizhe Chen , Zeya Wang , Runchen Hou , Zuozhu Liu

Low-rank adaptation (LoRA) enables parameter efficient specialization of large language models (LLMs) through modular adapters, resulting in rapidly growing public adapter pools spanning diverse tasks. Effectively using these adapters…

This perspective paper explores the future potential of "conversational intelligence" by examining how Large Language Models (LLMs) could be combined with GRAPHYP's network system to better understand human conversations and preferences.…

人工智能 · 计算机科学 2025-07-29 Renaud Fabre , Daniel Egret , Patrice Bellot

Recent advancements in large language models (LLMs) have shown significant promise in various domains, especially robotics. However, most prior LLM-based work in robotic applications either directly predicts waypoints or applies LLMs within…

机器人学 · 计算机科学 2025-10-01 Yue Meng , Fei Chen , Yongchao Chen , Chuchu Fan