English
Related papers

Related papers: PrefIx: Understand and Adapt to User Preference in…

200 papers

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

Large language models (LLMs) are increasingly used as reasoning modules in many applications. While they are efficient in certain tasks, LLMs often struggle to produce human-aligned solutions. Human-aligned decision making requires…

Artificial Intelligence · Computer Science 2026-05-14 Alina Hyk , Sandhya Saisubramanian

Agentic recommendations cast recommenders as large language model (LLM) agents that can plan, reason, use tools, and interact with users of varying preferences in web applications. However, most existing agentic recommender systems focus on…

Computation and Language · Computer Science 2026-01-27 Yu Xia , Sungchul Kim , Tong Yu , Ryan A. Rossi , Julian McAuley

Personalisation is a standard feature of conversational AI systems used by millions; yet, the efficacy of personalisation methods is often evaluated in academic research using simulated users rather than real people. This raises questions…

Computation and Language · Computer Science 2026-05-14 Hannah Rose Kirk , Liu Leqi , Fanzhi Zeng , Henry Davidson , Bertie Vidgen , Christopher Summerfield , Scott A. Hale

Optimization is as much about modeling the right problem as solving it. Identifying the right objectives, constraints, and trade-offs demands extensive interaction between researchers and stakeholders. Large language models can empower…

Artificial Intelligence · Computer Science 2026-04-06 Joshua Drossman , Alexandre Jacquillat , Sébastien Martin

Recommender and search systems commonly rely on Learning To Rank models trained on logged user interactions to order items by predicted relevance. However, such interaction data is often subject to position bias, as users are more likely to…

Information Retrieval · Computer Science 2025-09-05 Aleksandr V. Petrov , Michael Murtagh , Karthik Nagesh

Evaluating large language model (LLM) based chat assistants is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences. To address this, we explore using strong LLMs as judges to…

Building agents with adaptive behavior in cooperative tasks stands as a paramount goal in the realm of multi-agent systems. Current approaches to developing cooperative agents rely primarily on learning-based methods, whose policy…

Recent progress in large language model (LLM) technology has significantly enhanced the interaction experience between humans and voice assistants (VAs). This project aims to explore a user's continuous interaction with LLM-based VA…

Human-Computer Interaction · Computer Science 2024-09-04 Szeyi Chan , Shihan Fu , Jiachen Li , Bingsheng Yao , Smit Desai , Mirjana Prpa , Dakuo Wang

In the past decades, recommender systems have attracted much attention in both research and industry communities, and a large number of studies have been devoted to developing effective recommendation models. Basically speaking, these…

Information Retrieval · Computer Science 2023-05-12 Junjie Zhang , Ruobing Xie , Yupeng Hou , Wayne Xin Zhao , Leyu Lin , Ji-Rong Wen

We introduce a multi-turn benchmark for evaluating personalised alignment in LLM-based AI assistants, focusing on their ability to handle user-provided safety-critical contexts. Our assessment of ten leading models across five scenarios…

Human-Computer Interaction · Computer Science 2025-01-31 Lize Alberts , Benjamin Ellis , Andrei Lupu , Jakob Foerster

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often…

Computation and Language · Computer Science 2025-05-23 Jing Ye , Lu Xiang , Yaping Zhang , Chengqing Zong

Aligning LLM-based judges with human preferences is a significant challenge, as they are difficult to calibrate and often suffer from rubric sensitivity, bias, and instability. Overcoming this challenge advances key applications, such as…

Recent advances in large language models (LLMs) have stimulated growing interest in agent-based recommender systems, enabling language-driven interaction and reasoning for more expressive preference modeling. However, most existing agentic…

Information Retrieval · Computer Science 2026-05-21 Yaxin Gong , Chongming Gao , Chenxiao Fan , Haoyan Liu , Wenjie Wang , Jianshan Sun , Yangyang Li , Fuli Feng , Xiangnan He

Preference-based reinforcement learning (RL) offers a promising approach for aligning policies with human intent but is often constrained by the high cost of human feedback. In this work, we introduce PrefVLM, a framework that integrates…

Machine Learning · Computer Science 2025-02-04 Udita Ghosh , Dripta S. Raychaudhuri , Jiachen Li , Konstantinos Karydis , Amit Roy-Chowdhury

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

We present Interfaze, a system that treats modern LLM applications as a problem of building and acting over context, not just picking the right monolithic model. Instead of a single transformer, we combine (i) a stack of heterogeneous DNNs…

Artificial Intelligence · Computer Science 2026-02-05 Harsha Vardhan Khurdula , Vineet Agarwal , Yoeven D Khemlani

Interactive large language model (LLM) agents operating via multi-turn dialogue and multi-step tool calling are increasingly used in production. Benchmarks for these agents must both reliably compare models and yield on-policy training…

As AI agents increasingly act on behalf of human stakeholders in economic settings, understanding their behavior in complex market environments becomes critical. This article examines how Large Language Models coordinate on markets that are…

General Economics · Economics 2026-03-11 Alexander Erlei , Lukas Meub

We introduce a new benchmark, LLF-Bench (Learning from Language Feedback Benchmark; pronounced as "elf-bench"), to evaluate the ability of AI agents to interactively learn from natural language feedback and instructions. Learning from…

Artificial Intelligence · Computer Science 2023-12-14 Ching-An Cheng , Andrey Kolobov , Dipendra Misra , Allen Nie , Adith Swaminathan