English
Related papers

Related papers: AWARE-US: Preference-Aware Infeasibility Resolutio…

200 papers

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

Query-to-bidword(i.e., bidding keyword) rewriting is fundamental to sponsored search, transforming noisy user queries into semantically relevant and commercially valuable keywords. Recent advances in large language models (LLMs) improve…

Information Retrieval · Computer Science 2025-11-25 Xiao Zhang , Guanyu Chen , Boyang Zuo , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng

Reward models (RMs) play a critical role in aligning large language models (LLMs) with human preferences. Yet in the domain of tool learning, the lack of RMs specifically designed for function-calling tasks has limited progress toward more…

Artificial Intelligence · Computer Science 2026-01-14 Renhao Li , Jianhong Tu , Yang Su , Yantao Liu , Fei Huang , Hamid Alinejad-Rokny , Derek F. Wong , Junyang Lin , Min Yang

As large language models (LLMs) are deployed globally, creating pluralistic systems that can accommodate the diverse preferences and values of users worldwide becomes essential. We introduce EVALUESTEER, a benchmark to measure LLMs' and…

Computation and Language · Computer Science 2025-10-13 Kshitish Ghate , Andy Liu , Devansh Jain , Taylor Sorensen , Atoosa Kasirzadeh , Aylin Caliskan , Mona T. Diab , Maarten Sap

Conversational recommender systems (CRSs) operate under incremental preference revelation, requiring systems to make recommendation decisions under uncertainty. While recent approaches particularly those built on large language models…

Information Retrieval · Computer Science 2026-04-14 Subham Raj , Aman Vaibhav Jha , Mayank Anand , Sriparna Saha

User satisfaction in dialogue systems is inherently subjective. When the same response strategy is applied across users, minority users may assign different satisfaction ratings than majority users due to variations in individual intents…

Computation and Language · Computer Science 2025-11-10 Yahui Fu , Zi Haur Pang , Tatsuya Kawahara

Reward-driven proactive dialogue agents require precise estimation of user satisfaction as an intrinsic reward signal to determine optimal interaction strategies. Specifically, this framework triggers clarification questions when detecting…

Machine Learning · Computer Science 2025-05-27 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Xiaolong Xu , Wanchun Dou

Searching for and making decisions about information is becoming increasingly difficult as the amount of information and number of choices increases. Recommendation systems help users find items of interest of a particular type, such as…

Information Retrieval · Computer Science 2011-07-04 M. H. Goker , P. Langley , C. A. Thompson

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

Recent multimodal large language models (MLLMs) such as GPT-4o and Qwen3-Omni show strong perception but struggle in multi-speaker, dialogue-centric settings that demand agentic reasoning tracking who speaks, maintaining roles, and…

Recommender systems play a critical role in enhancing user experience by providing personalized suggestions based on user preferences. Traditional approaches often rely on explicit numerical ratings or assume access to fully ranked lists of…

Information Retrieval · Computer Science 2025-08-22 Bahar Boroomand , James R. Wright

LLM-based voice assistants (VAs) increasingly support older adults aging in place, yet how an assistant's agreeableness shapes explanation perception remains underexplored. We conducted a study(N=70) examining how VA agreeableness…

Human-Computer Interaction · Computer Science 2026-03-11 Niharika Mathur , Hasibur Rahman , Smit Desai

Tool-using large language model (LLM) agents often face a fundamental tension between answer quality and execution cost. Fixed workflows are stable but inflexible, while free-form multi-step reasoning methods such as ReAct may improve task…

Artificial Intelligence · Computer Science 2026-03-23 Boyan Liu , Gongming Zhao , Hongli Xu

We introduce Eurus, a suite of large language models (LLMs) optimized for reasoning. Finetuned from Mistral-7B and CodeLlama-70B, Eurus models achieve state-of-the-art results among open-source models on a diverse set of benchmarks covering…

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Recent advances in Vision-Language Models (VLMs) have enabled mobile agents to perceive and interact with real-world mobile environments based on human instructions. However, the current fully autonomous paradigm poses potential safety…

Artificial Intelligence · Computer Science 2026-04-28 Qihang Ai , Pi Bu , Yue Cao , Yingyao Wang , Jihao Gu , Jingxuan Xing , Zekun Zhu , Wei Jiang , Zhicheng Zheng , Jun Song , Yuning Jiang

Recent work has shown that many problems of satisfiability and resiliency in workflows may be viewed as special cases of the authorization policy existence problem (APEP), which returns an authorization policy if one exists and 'No'…

Data Structures and Algorithms · Computer Science 2021-07-15 Jason Crampton , Eduard Eiben , Gregory Gutin , Daniel Karapetyan , Diptapriyo Majumdar

Personalized mobile agents that infer user preferences and calibrate proactive assistance hold great promise as everyday digital assistants, yet existing benchmarks fail to capture what this requires. Prior work evaluates preference…

In this work, we consider how preference models in interactive recommendation systems determine the availability of content and users' opportunities for discovery. We propose an evaluation procedure based on stochastic reachability to…

Information Retrieval · Computer Science 2021-07-05 Mihaela Curmei , Sarah Dean , Benjamin Recht

Motivated by the need for rigorous and scalable evaluation of large language models, we study contextual preference inference for pairwise comparison functionals of context-dependent preference score functions across domains. Focusing on…

Machine Learning · Statistics 2025-09-09 Yichi Zhang , Alexander Belloni , Ethan X. Fang , Junwei Lu , Xiaoan Xu