中文
相关论文

相关论文: Test-Time Policy Adaptation for Enhanced Multi-Tur…

200 篇论文

This paper proposes a GRPO-based approach to enhance the performance of large language model (LLM)-based text-to-speech (TTS) models by deriving rewards from an off-the-shelf automatic speech recognition (ASR) model. Compared to previous…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Chang Liu , Ya-Jun Hu , Ying-Ying Gao , Shi-Lei Zhang , Zhen-Hua Ling

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

计算工程、金融与科学 · 计算机科学 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Adapting large language models (LLMs) for personalized recommendation requires aligning their general-purpose capabilities with user-specific preferences while effectively leveraging both behavioral and semantic signals. Existing approaches…

信息检索 · 计算机科学 2026-05-27 Pingjun Pan , Tingting Zhou , Peiyao Lu , Tingting Fei , Hongxiang Chen , Chuanjiang Luo

Large Language Models (LLMs) have opened transformative possibilities for human-robot collaboration. However, enabling real-time collaboration requires both low latency and robust reasoning, and most LLMs suffer from high latency. To…

人工智能 · 计算机科学 2026-01-27 Shipeng Liu , Boshen Zhang , Zhehui Huang

Recent advancements in Large Language Models (LLMs) have significantly propelled the development of Conversational Recommendation Agents (CRAs). However, these agents often generate short-sighted responses that fail to sustain user guidance…

计算与语言 · 计算机科学 2025-06-18 Xueyang Feng , Jingsen Zhang , Jiakai Tang , Wei Li , Guohao Cai , Xu Chen , Quanyu Dai , Yue Zhu , Zhenhua Dong

Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, existing RMs struggle on knowledge-intensive and long-form tasks,…

计算与语言 · 计算机科学 2025-10-30 Ziyou Hu , Zhengliang Shi , Minghang Zhu , Haitao Li , Teng Sun , Pengjie Ren , Suzan Verberne , Zhaochun Ren

As we consider entrusting Large Language Models (LLMs) with key societal and decision-making roles, measuring their alignment with human cognition becomes critical. This requires methods that can assess how these systems represent…

人工智能 · 计算机科学 2025-10-03 Mattson Ogg , Ritwik Bose , Jamie Scharf , Christopher Ratto , Michael Wolmetz

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

信息检索 · 计算机科学 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

Large Language Models (LLMs) are increasingly deployed in multi-turn dialogue settings where preserving conversational context across turns is essential. A standard serving practice concatenates the full dialogue history at every turn,…

计算与语言 · 计算机科学 2026-05-13 Xueqi Cheng , Qiong Wu , Zhengyi Zhou , Xugui Zhou , Tyler Derr , Yushun Dong

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

计算机科学与博弈论 · 计算机科学 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Web agents have emerged as a promising direction to automate Web task completion based on user instructions, significantly enhancing user experience. Recently, Web agents have evolved from traditional agents to Large Language Models…

计算与语言 · 计算机科学 2025-03-25 Hongru Cai , Yongqi Li , Wenjie Wang , Fengbin Zhu , Xiaoyu Shen , Wenjie Li , Tat-Seng Chua

The recent advancements of Large Language Models (LLMs) have spurred considerable research interest in extending their linguistic capabilities beyond text to other modalities, which leads to emergence of speech-based LLMs (SpeechLMs) with…

计算与语言 · 计算机科学 2026-05-21 Yansong Liu , Jiateng Li , Yuan Liu

Direct Preference Optimization (DPO) has shown effectiveness in aligning multi-modal large language models (MLLM) with human preferences. However, existing methods exhibit an imbalanced responsiveness to the data of varying hardness,…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Jinda Lu , Junkang Wu , Jinghan Li , Xiaojun Jia , Shuo Wang , YiFan Zhang , Junfeng Fang , Xiang Wang , Xiangnan He

Large Language Models (LLMs) generate functionally correct solutions but often fall short in code efficiency, a critical bottleneck for real-world deployment. In this paper, we introduce a novel test-time iterative optimization framework to…

软件工程 · 计算机科学 2025-06-04 Mingzhe Du , Luu Anh Tuan , Yue Liu , Yuhao Qing , Dong Huang , Xinyi He , Qian Liu , Zejun Ma , See-kiong Ng

Low-Rank Adaptation (LoRA) is one of the most widely used techniques for fine-tuning large language models (LLMs). By introducing a small number of trainable low-rank weight matrices, LoRA substantially reduces the number of parameters that…

机器学习 · 计算机科学 2025-07-15 Seokmin Ko

Large language models (LLMs) struggle with complex, long-horizon reasoning due to instability caused by their frozen policy assumption. Current test-time scaling methods treat execution feedback merely as an external signal for filtering or…

人工智能 · 计算机科学 2026-01-29 Zhengbo Jiao , Hongyu Xian , Qinglong Wang , Yunpu Ma , Zhebo Wang , Zifan Zhang , Dezhang Kong , Meng Han

Personalized Large Language Models (PLLMs) aim to align model outputs with individual user preferences, a crucial capability for user-centric applications. However, the prevalent approach of fine-tuning a separate module for each user faces…

计算与语言 · 计算机科学 2025-11-27 Xiaopeng Li , Yuanjin Zheng , Wanyu Wang , wenlin zhang , Pengyue Jia , Yiqi Wang , Maolin Wang , Xuetao Wei , Xiangyu Zhao

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

计算与语言 · 计算机科学 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Mainstream approaches to aligning large language models (LLMs) heavily rely on human preference data, particularly when models require periodic updates. The standard process for iterative alignment of LLMs involves collecting new human…

计算与语言 · 计算机科学 2024-10-01 Chen Zhang , Chengguang Tang , Dading Chong , Ke Shi , Guohua Tang , Feng Jiang , Haizhou Li

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

信息检索 · 计算机科学 2024-05-03 Kirandeep Kaur , Chirag Shah