中文
相关论文

相关论文: HorizonBench: Long-Horizon Personalization with Ev…

200 篇论文

While agent evaluation has shifted toward long-horizon tasks, most benchmarks still emphasize local, step-level reasoning rather than the global constrained optimization (e.g., time and financial budgets) that demands genuine planning…

人工智能 · 计算机科学 2026-01-27 Yinger Zhang , Shutong Jiang , Renhao Li , Jianhong Tu , Yang Su , Lianghao Deng , Xudong Guo , Chenxu Lv , Junyang Lin

Deep research, in which an agent searches the open web, collects evidence, and derives an answer through extended reasoning, is a prominent use case for frontier language models. Frontier deep research products score high on existing…

With the rise in capabilities of large language models (LLMs) and their deployment in real-world tasks, evaluating LLM alignment with human preferences has become an important challenge. Current benchmarks average preferences across all…

人工智能 · 计算机科学 2026-04-22 Cristina Garbacea , Heran Wang , Chenhao Tan

User interactions with language models vary due to static properties of the user (trait) and the specific context of the interaction (state). However, existing persona datasets (like PersonaChat, PANDORA etc.) capture only trait, and ignore…

计算与语言 · 计算机科学 2026-05-08 Tamunotonye Harry , Ivoline Ngong , Chima Nweke , Yuanyuan Feng , Joseph Near

The trustworthiness of Large Language Models (LLMs) refers to the extent to which their outputs are reliable, safe, and ethically aligned, and it has become a crucial consideration alongside their cognitive performance. In practice,…

计算与语言 · 计算机科学 2024-12-24 Aaron J. Li , Satyapriya Krishna , Himabindu Lakkaraju

Personalized digital health support requires long-horizon, cross-dimensional reasoning over heterogeneous lifestyle signals, and recent advances in mobile sensing and large language models (LLMs) make such support increasingly feasible.…

人工智能 · 计算机科学 2026-01-21 Ye Tian , Zihao Wang , Onat Gungor , Xiaoran Fan , Tajana Rosing

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

计算与语言 · 计算机科学 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li

Large language models (LLMs) have evolved into interactive agents that collaborate with users in real-world tasks. Effective collaboration in such settings increasingly depends on understanding the user beyond what is explicitly stated, as…

Simulating real personalities with large language models requires grounding generation in authentic personal data. Existing evaluation approaches rely on demographic surveys, personality questionnaires, or short AI-led interviews as…

计算与语言 · 计算机科学 2026-02-25 Yu Li , Pranav Narayanan Venkit , Yada Pruksachatkun , Chien-Sheng Wu

Preference datasets are essential for training general-domain, instruction-following language models with Reinforcement Learning from Human Feedback (RLHF). Each subsequent data release raises expectations for future data collection,…

Personalizing Large Language Models typically relies on static retrieval or one-time adaptation, assuming user preferences remain invariant over time. However, real-world interactions are dynamic, where user interests continuously evolve,…

人工智能 · 计算机科学 2026-01-16 Seoyeon Kim , Jaehyung Kim

RLHF assumes that annotation responses reflect genuine human preferences. We argue this assumption warrants systematic examination, and that behavioral science offers frameworks that bring clarity to when it holds and when it breaks down.…

人机交互 · 计算机科学 2026-04-07 Bijean Ghafouri , Eun Cheol Choi , Priyanka Dey , Emilio Ferrara

Large language models (LLMs) have advanced conversational AI assistants. However, systematically evaluating how well these assistants apply personalization--adapting to individual user preferences while completing tasks--remains…

计算与语言 · 计算机科学 2025-06-12 Zheng Zhao , Clara Vania , Subhradeep Kayal , Naila Khan , Shay B. Cohen , Emine Yilmaz

Understanding human intent is a complex, high-level task for large language models (LLMs), requiring analytical reasoning, contextual interpretation, dynamic information aggregation, and decision-making under uncertainty. Real-world public…

计算与语言 · 计算机科学 2025-10-21 Xiaozhe Li , TianYi Lyu , Siyi Yang , Yuxi Gong , Yizhao Yang , Jinxuan Huang , Ligao Zhang , Zhuoyi Huang , Qingwen Liu

Personalization of Large Language Models (LLMs) often assumes users hold static preferences that reflect globally in all tasks. In reality, humans hold dynamic preferences that change depending on the context. As users interact with an LLM…

计算与语言 · 计算机科学 2025-08-08 Tae Soo Kim , Yoonjoo Lee , Yoonah Park , Jiho Kim , Young-Ho Kim , Juho Kim

We address the personalized policy learning problem using longitudinal mobile health application usage data. Personalized policy represents a paradigm shift from developing a single policy that may prescribe personalized decisions by…

统计方法学 · 统计学 2020-01-13 Xinyu Hu , Min Qian , Bin Cheng , Ying Kuen Cheung

Reward models trained on aggregate preferences often fail to capture individual users' values, but existing adaptation methods such as fine-tuning or long-context conditioning are too costly for real-time personalization. We propose…

机器学习 · 计算机科学 2026-04-21 Yoonho Lee , Jonathan Williams , Henrik Marklund , Archit Sharma , Eric Mitchell , Anikait Singh , Chelsea Finn

Decision-making problems often feature uncertainty stemming from heterogeneous and context-dependent human preferences. To address this, we propose a sequential learning-and-optimization pipeline to learn preference distributions and…

机器学习 · 计算机科学 2026-03-19 Benjamin Hudson , Laurent Charlin , Emma Frejinger

Personalization is critical in AI assistants, particularly in the context of private AI models that work with individual users. A key scenario in this domain involves enabling AI models to access and interpret a user's private data (e.g.,…

Large language models (LLMs) hold potential for mental healthcare applications, particularly in cognitive behavioral therapy (CBT)-based counseling, where reward models play a critical role in aligning LLMs with preferred therapeutic…

数据库 · 计算机科学 2026-03-13 Yougen Zhou , Qin Chen , Ningning Zhou , Jie Zhou , Liang He