中文
相关论文

相关论文: Language Models Don't Know What You Want: Evaluati…

200 篇论文

Deep research agents have emerged as LLM-based systems designed to perform multi-step information seeking and reasoning over large, open-domain sources to answer complex questions by synthesizing information from multiple information…

信息检索 · 计算机科学 2026-03-20 Mahta Rafiee , Heydar Soudani , Zahra Abbasiantaeb , Mohammad Aliannejadi , Faegheh Hasibi , Hamed Zamani

Evaluating long-form responses to research queries heavily relies on expert annotators, restricting attention to areas like AI where researchers can conveniently enlist colleagues. Yet, research expertise is abundant: survey articles…

计算与语言 · 计算机科学 2025-12-22 Li S. Yifei , Allen Chang , Chaitanya Malaviya , Mark Yatskar

Students benefit from math problems contextualized to their interests. Large language models (LLMs) offer promise for efficient personalization at scale. However, LLM-generated personalized problems may often have problems such as…

计算机与社会 · 计算机科学 2026-04-08 Fareya Ikram , Nischal Ashok Kumar , Junyang Lu , Hunter McNichols , Candace Walkington , Neil Heffernan , Andrew S. Lan

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

计算与语言 · 计算机科学 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

Deep research tools are among the most impactful and most commonly encountered agentic systems today. We observe, however, that each deep research agent introduced so far is hard-coded to carry out a particular research strategy using a…

人工智能 · 计算机科学 2025-09-03 Peter Belcak , Pavlo Molchanov

In this work, we introduce the task of life-long personalization of large language models. While recent mainstream efforts in the LLM community mainly focus on scaling data and compute for improved capabilities of LLMs, we argue that it is…

计算与语言 · 计算机科学 2024-12-18 Tiannan Wang , Meiling Tao , Ruoyu Fang , Huilin Wang , Shuai Wang , Yuchen Eleanor Jiang , Wangchunshu Zhou

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

人机交互 · 计算机科学 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

Retrieval Augmented Generation (RAG) has become one of the most popular methods for bringing knowledge-intensive context to large language models (LLM) because of its ability to bring local context at inference time without the cost or data…

信息检索 · 计算机科学 2025-05-02 Michael J. Ryan , Danmei Xu , Chris Nivera , Daniel Campos

We focus here on Deep Research Agents (DRAs), which are systems that can take a natural language prompt from a user, and then autonomously search for, and utilize, internet-based content to address the prompt. Recent DRAs have demonstrated…

人工智能 · 计算机科学 2026-01-09 Doaa Allabadi , Kyle Bradbury , Jordan M. Malof

Large Language Model (LLM)-based agents show promise for e-commerce conversational shopping, yet existing implementations lack the interaction depth and contextual breadth required for complex product research. Meanwhile, the Deep Research…

人工智能 · 计算机科学 2026-03-02 Jiangyuan Wang , Kejun Xiao , Huaipeng Zhao , Tao Luo , Xiaoyi Zeng

As scientific research proliferates, researchers face the daunting task of navigating and reading vast amounts of literature. Existing solutions, such as document QA, fail to provide personalized and up-to-date information efficiently. We…

计算与语言 · 计算机科学 2024-09-10 Guanyu Lin , Tao Feng , Pengrui Han , Ge Liu , Jiaxuan You

Large Language Models (LLMs) are increasingly serving as personal assistants, where users share complex and diverse preferences over extended interactions. However, assessing how well LLMs can follow these preferences in realistic,…

人工智能 · 计算机科学 2026-03-05 Qianyun Guo , Yibo Li , Yue Liu , Bryan Hooi

As LLMs become capable of complex tasks, there is growing potential for personalized interactions tailored to the subtle and idiosyncratic preferences of the user. We present a public benchmark, PersonalLLM, focusing on adapting LLMs to…

机器学习 · 计算机科学 2025-02-25 Thomas P. Zollo , Andrew Wei Tung Siah , Naimeng Ye , Ang Li , Hongseok Namkoong

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

人工智能 · 计算机科学 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Large Language Models (LLMs) generalize well across language tasks, but suffer from hallucinations and uninterpretability, making it difficult to assess their accuracy without ground-truth. Retrieval-Augmented Generation (RAG) models have…

计算与语言 · 计算机科学 2023-12-18 Jakub Lála , Odhran O'Donoghue , Aleksandar Shtedritski , Sam Cox , Samuel G. Rodriques , Andrew D. White

Large Language Models (LLMs) should answer factual questions truthfully, grounded in objective knowledge, regardless of user context such as self-disclosed personal information, or system personalization. In this paper, we present the first…

计算与语言 · 计算机科学 2025-10-16 Nil-Jana Akpinar , Chia-Jung Lee , Vanessa Murdock , Pietro Perona

We present a long-horizon, hierarchical deep research (DR) agent designed for complex materials and device discovery problems that exceed the scope of existing Machine Learning (ML) surrogates and closed-source commercial agents. Our…

机器学习 · 计算机科学 2025-12-04 Rui Ding , Rodrigo Pires Ferreira , Yuxin Chen , Junhong Chen

Large Language Models (LLMs) have made it possible for recommendation systems to interact with users in open-ended conversational interfaces. In order to personalize LLM responses, it is crucial to elicit user preferences, especially when…

人工智能 · 计算机科学 2025-10-15 Ali Montazeralghaem , Guy Tennenholtz , Craig Boutilier , Ofer Meshi

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

人工智能 · 计算机科学 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Large language models (LLM) excel at a variety of natural language processing tasks, yet they struggle to generate personalized content for individuals, particularly in real-world scenarios like scientific writing. Addressing this…

计算与语言 · 计算机科学 2024-07-12 Xiangru Tang , Xingyao Zhang , Yanjun Shao , Jie Wu , Yilun Zhao , Arman Cohan , Ming Gong , Dongmei Zhang , Mark Gerstein