English
Related papers

Related papers: SeekerGym: A Benchmark for Reliable Information Se…

200 papers

This paper introduces Seeker, a system that allows users to interactively refine search rankings in real time, through feedback in the form of likes and dislikes. When searching online, users may not know how to accurately describe their…

Information Retrieval · Computer Science 2020-06-09 Ari Biswas , Thai T Pham , Michael Vogelsong , Benjamin Snyder , Houssam Nassif

AI agents can extend their capabilities at inference time by loading reusable skills into context, yet equipping an agent with too many skills, particularly irrelevant ones, degrades performance. As community-driven skill repositories grow,…

Artificial Intelligence · Computer Science 2026-03-31 Fangzhou Li , Pagkratios Tagkopoulos , Ilias Tagkopoulos

With the spread of false and misleading information in current news, many algorithmic tools have been introduced with the aim of assessing bias and reliability in written content. However, there has been little work exploring how effective…

Computers and Society · Computer Science 2019-05-20 Benjamin D. Horne , Dorit Nevo , John O'Donovan , Jin-Hee Cho , Sibel Adali

Large Language Models (LLMs)-based agents have made impressive progress in reasoning and tool use, enabling them to solve complex tasks. However, their ability to proactively collaborate with users, especially when goals are vague,…

We wish to measure the information coverage of an ad hoc retrieval algorithm, that is, how much of the range of available relevant information is covered by the search results. Information coverage is a central aspect for retrieval,…

Information Retrieval · Computer Science 2026-03-23 Saron Samuel , Andrew Yates , Dawn Lawrie , Ian Soboroff , Trevor Adriaanse , Benjamin Van Durme , Eugene Yang

Planning has been part of the core pursuit for artificial intelligence since its conception, but earlier AI agents mostly focused on constrained settings because many of the cognitive substrates necessary for human-level planning have been…

Computation and Language · Computer Science 2024-10-24 Jian Xie , Kai Zhang , Jiangjie Chen , Tinghui Zhu , Renze Lou , Yuandong Tian , Yanghua Xiao , Yu Su

In the rapidly advancing research fields such as AI, managing and staying abreast of the latest scientific literature has become a significant challenge for researchers. Although previous efforts have leveraged AI to assist with literature…

Computation and Language · Computer Science 2024-04-10 Xintao Wang , Jiangjie Chen , Nianqi Li , Lida Chen , Xinfeng Yuan , Wei Shi , Xuyang Ge , Rui Xu , Yanghua Xiao

Recent agentic search systems have made substantial progress by emphasising deep, multi-step reasoning. However, this focus often overlooks the challenges of wide-scale information synthesis, where agents must aggregate large volumes of…

Artificial Intelligence · Computer Science 2026-04-06 Ka Yiu Lee , Yuxuan Huang , Zhiyuan He , Huichi Zhou , Weilin Luo , Kun Shao , Meng Fang , Jun Wang

In the rapidly evolving field of artificial intelligence, the ability to harness and integrate knowledge across various domains stands as a paramount challenge and opportunity. This study introduces a novel approach to cross-domain…

With the proliferation of Large Language Models (LLMs), the detection of misinformation has become increasingly important and complex. This research proposes an innovative verifiable misinformation detection LLM agent that goes beyond…

Artificial Intelligence · Computer Science 2025-08-06 Zikun Cui , Tianyi Huang , Chia-En Chiang , Cuiqianhe Du

Information seeking and integration is a complex cognitive task that consumes enormous time and effort. Inspired by the remarkable progress of Large Language Models, recent works attempt to solve this task by combining LLMs and search…

Computation and Language · Computer Science 2025-11-03 Zehui Chen , Kuikun Liu , Qiuchen Wang , Jiangning Liu , Wenwei Zhang , Kai Chen , Feng Zhao

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

We study the use of large language model-based agents for interacting with software via web browsers. Unlike prior work, we focus on measuring the agents' ability to perform tasks that span the typical daily work of knowledge workers…

Large language models (LLMs) are increasingly envisioned as decision-support tools in clinical practice, yet safe clinical reasoning demands integrating heterogeneous knowledge bases -- trials, primary studies, regulatory documents, and…

Computation and Language · Computer Science 2025-05-22 Shan Chen , Pedro Moreira , Yuxin Xiao , Sam Schmidgall , Jeremy Warner , Hugo Aerts , Thomas Hartvigsen , Jack Gallifant , Danielle S. Bitterman

In an information-seeking conversation, a user may ask questions that are under-specified or unanswerable. An ideal agent would interact by initiating different response types according to the available knowledge sources. However, most…

Computation and Language · Computer Science 2023-06-26 Zeqiu Wu , Ryu Parish , Hao Cheng , Sewon Min , Prithviraj Ammanabrolu , Mari Ostendorf , Hannaneh Hajishirzi

The escalating volume of academic research, coupled with a shortage of qualified reviewers, necessitates innovative approaches to peer review. In this work, we propose: 1. ReviewEval, a comprehensive evaluation framework for AI-generated…

Computation and Language · Computer Science 2025-05-27 Madhav Krishan Garg , Tejash Prasad , Tanmay Singhal , Chhavi Kirtani , Murari Mandal , Dhruv Kumar

Recent advances in AI agents for software engineering and scientific discovery have demonstrated remarkable capabilities, yet their application to developing novel ranking models in commercial search engines remains unexplored. In this…

Information Retrieval · Computer Science 2026-03-25 Liwei Wu , Cho-Jui Hsieh

While the advancement of large language models has spurred the development of AI agents to automate tasks, numerous use cases inherently require agents to collaborate with humans due to humans' latent preferences, domain expertise, or the…

Artificial Intelligence · Computer Science 2025-12-09 Yijia Shao , Vinay Samuel , Yucheng Jiang , John Yang , Diyi Yang

Intelligent agents powered by large language models (LLMs) have recently demonstrated impressive capabilities and gained increasing popularity on social media platforms. While LLM agents are reshaping the ecology of social media, there…

Social and Information Networks · Computer Science 2025-12-18 Dizhan Xue , Jing Cui , Shengsheng Qian , Chuanrui Hu , Changsheng Xu

Dataset Search -- the process of finding appropriate datasets for a given task -- remains a critical yet under-explored challenge in data science workflows. Assessing dataset suitability for a task (e.g., training a classification model) is…

Human-Computer Interaction · Computer Science 2025-07-28 Rachel Lin , Bhavya Chopra , Wenjing Lin , Shreya Shankar , Madelon Hulsebos , Aditya G. Parameswaran