English
Related papers

Related papers: Test-Time Policy Adaptation for Enhanced Multi-Tur…

200 papers

Large language models (LLMs) transcend passive generation and act as goal-directed agents by invoking external tools. Reinforcement learning (RL) offers a principled framework for optimizing these emergent tool-use policies, yet the…

Computation and Language · Computer Science 2026-02-05 Zihan Lin , Xiaohan Wang , Jie Cao , Jiajun Chai , Guojun Yin , Wei Lin , Ran He

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei

Simulating step-wise human behavior with Large Language Models (LLMs) has become an emerging research direction, enabling applications in various practical domains. While prior methods, including prompting, supervised fine-tuning (SFT), and…

Computation and Language · Computer Science 2025-10-21 Ziyi Wang , Yuxuan Lu , Yimeng Zhang , Jing Huang , Dakuo Wang

Rule-based adaptation is a foundational approach to self-adaptation, characterized by its human readability and rapid response. However, building high-performance and robust adaptation rules is often a challenge because it essentially…

Computation and Language · Computer Science 2024-07-03 Yusei Ishimizu , Jialong Li , Jinglue Xu , Jinyu Cai , Hitoshi Iba , Kenji Tei

Conversational Recommender Systems (CRSs) engage users in multi-turn interactions to deliver personalized recommendations. The emergence of large language models (LLMs) further enhances these systems by enabling more natural and dynamic…

Computation and Language · Computer Science 2025-04-18 Xiaoyan Zhao , Yang Deng , Wenjie Wang , Hongzhan lin , Hong Cheng , Rui Zhang , See-Kiong Ng , Tat-Seng Chua

Reinforcement learning in large language models (LLMs) often relies on scalar rewards, a practice that discards valuable textual rationale buried in the rollouts, forcing the model to explore \textit{de novo} with each attempt and hindering…

Machine Learning · Computer Science 2025-10-21 Ang Li , Yifei Wang , Zhihang Yuan , Stefanie Jegelka , Yisen Wang

The Group Relative Policy Optimization (GRPO), a reinforcement learning method used to fine-tune large language models (LLMs), has proved its effectiveness in practical applications such as DeepSeek-R1. It raises a question whether GRPO can…

Machine Learning · Computer Science 2025-11-20 Yanchen Xu , Ziheng Jiao , Hongyuan Zhang , Xuelong Li

The self-improving ability of large language models (LLMs), enabled by prompting them to analyze and revise their own outputs, has garnered significant interest in recent research. However, this ability has been shown to be absent and…

Computation and Language · Computer Science 2024-04-02 Xiao Yu , Baolin Peng , Michel Galley , Jianfeng Gao , Zhou Yu

In recent years, Recommender Systems(RS) have witnessed a transformative shift with the advent of Large Language Models(LLMs) in the field of Natural Language Processing(NLP). These models such as OpenAI's GPT-3.5/4, Llama from Meta, have…

Information Retrieval · Computer Science 2023-11-22 Junyi Chen

The number and dynamic nature of web and mobile applications presents significant challenges for assessing their compliance with data protection laws. In this context, symbolic and statistical Natural Language Processing (NLP) techniques…

Computation and Language · Computer Science 2025-12-22 David Rodriguez , Ian Yang , Jose M. Del Alamo , Norman Sadeh

Reinforcement learning (RL) is a critical component of large language model (LLM) post-training. However, on-policy algorithms used for post-training are not naturally robust to a diversified content of experience replay buffers, which…

Interactive user interfaces have increasingly explored AI's role in enhancing communication efficiency and productivity in collaborative tasks. The emergence of Large Language Models (LLMs) such as ChatGPT has revolutionized conversational…

Human-Computer Interaction · Computer Science 2024-03-06 Ashish Bastola , Hao Wang , Judsen Hembree , Pooja Yadav , Zihao Gong , Emma Dixon , Abolfazl Razi , Nathan McNeese

Humans face countless scenarios that require reasoning and judgment in daily life. However, existing large language model training methods primarily allow models to learn from existing textual content or solve predetermined problems,…

Artificial Intelligence · Computer Science 2026-01-27 Yin Cai , Zhouhong Gu , Juntao Zhang , Ping Chen

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly enhanced the reasoning abilities of large language models (LLMs). Its success, however, largely depends on strong base models with rich world knowledge, yielding only modest…

Artificial Intelligence · Computer Science 2025-08-19 Yongxin Guo , Wenbo Deng , Zhenglin Cheng , Xiaoying Tang

The personalization of black-box large language models (LLMs) is a critical yet challenging task. Existing approaches predominantly rely on context injection, where user history is embedded into the prompt to directly guide the generation…

Computation and Language · Computer Science 2025-11-10 Teqi Hao , Xioayu Tan , Shaojie Shi , Yinghui Xu , Xihe Qiu

Large language models~(LLMs) are trained on heterogeneous multilingual corpora, yet existing policy optimization methods often implicitly restrict each training question to a single response language or rely on a fixed dominant language for…

Computation and Language · Computer Science 2026-05-26 Geyang Guo , Hiromi Wakaki , Yuki Mitsufuji , Alan Ritter , Wei Xu

Large language models (LLMs) have demonstrated exceptional potential in complex reasoning,pioneering a new paradigm for autonomous agent decision making in dynamic settings. However, in Real-Time Strategy (RTS) scenarios, LLMs suffer from a…

Multiagent Systems · Computer Science 2026-03-26 Li Ma , Hao Peng , Yiming Wang , Hongbin Luo , Jie Liu , Kongjing Gu , Guanlin Wu , Hui Lin , Lei Ren

Recently, test-time scaling Large Language Models (LLMs) have demonstrated exceptional reasoning capabilities across scientific and professional tasks by generating long chains-of-thought (CoT). As a crucial component for developing these…

Existing LLM-based policy optimizers see only scalar rewards: that a policy scored 0.45, but not whether the agent got stuck in a loop, fell into a hole on the third step, or performed well on 19 out of 20 rollouts and failed…

Machine Learning · Computer Science 2026-05-12 Rahaf Abu Hara , Vaibbhav Murarri , Claudio Zito

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa