English
Related papers

Related papers: DR$^{3}$-Eval: Towards Realistic and Reproducible …

200 papers

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

As multimodal LLM-driven agents advance in autonomy and generalization, traditional static datasets face inherent scalability limitations and are insufficient for fully assessing their capabilities in increasingly complex and diverse tasks.…

Computation and Language · Computer Science 2026-03-06 Yurun Chen , Xavier Hu , Yuhan Liu , Ziqi Wang , Zeyi Liao , Lin Chen , Feng Wei , Yuxi Qian , Bo Zheng , Keting Yin , Shengyu Zhang

Visual analytics now plays a central role in decision-making across diverse disciplines, but it can be unreliable: the knowledge or insights derived from the analysis may not accurately reflect the underlying data. In this dissertation, we…

Human-Computer Interaction · Computer Science 2025-12-23 Hyeon Jeon

Medical reasoning models remain constrained by parametric knowledge and are thus susceptible to forgetting and hallucinations. DeepResearch (DR) models ground outputs in verifiable evidence from tools and perform strongly in general…

Artificial Intelligence · Computer Science 2026-02-05 Zihan Wang , Hao Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yiqun Zhang , Jinghao Lin , Haihua Yang , Xiaozhong Ji

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Artificial Intelligence · Computer Science 2025-12-02 Riley Simmons-Edler , Ryan P. Badman , Felix Baastad Berg , Raymond Chua , John J. Vastola , Joshua Lunger , William Qian , Kanaka Rajan

Deep research has emerged as an important task that aims to address hard queries through extensive open-web exploration. To tackle it, most prior work equips large language model (LLM)-based agents with opaque web search APIs, enabling…

Information Retrieval · Computer Science 2026-02-26 Chuan Meng , Litu Ou , Sean MacAvaney , Jeff Dalton

Large Language Models (LLMs) have advanced autonomous agents from deep search, which retrieves concise factual answers, to deep research, which synthesizes scattered evidence into long-form reports. However, verifiable multimodal deep…

Computation and Language · Computer Science 2026-05-29 Chenghao Zhang , Guanting Dong , Yufan Liu , Tong Zhao , Zhicheng Dou

Deep Research (DR) Agents powered by advanced Large Language Models (LLMs) have fundamentally shifted the paradigm for completing complex research tasks. Yet, a comprehensive and live evaluation of their forecasting performance on…

Synthesizing informative commercial reports from massive and noisy web sources is critical for high-stakes business decisions. Although current deep research agents achieve notable progress, their reports still remain limited in terms of…

Computation and Language · Computer Science 2026-01-09 Mingyue Cheng , Daoyu Wang , Qi Liu , Shuo Yu , Xiaoyu Tao , Yuqian Wang , Chengzhong Chu , Yu Duan , Mingkang Long , Enhong Chen

Effective patient monitoring is vital for timely interventions and improved healthcare outcomes. Traditional monitoring systems often struggle to handle complex, dynamic environments with fluctuating vital signs, leading to delays in…

Machine Learning · Computer Science 2024-10-30 Thanveer Shaik , Xiaohui Tao , Lin Li , Haoran Xie , Hong-Ning Dai , Feng Zhao , Jianming Yong

Retrieval-Augmented Language Models (RALMs) face significant challenges in reducing factual errors, particularly in document relevance evaluation and knowledge integration. We introduce a framework for structured relevance assessment that…

Artificial Intelligence · Computer Science 2025-07-30 Aryan Raj , Astitva Veer Garg , Anitha D

Multi-Agent Deep Reinforcement Learning (MADRL) was proven efficient in solving complex problems in robotics or games, yet most of the trained models are hard to interpret. While learning intrinsically interpretable models remains a…

Artificial Intelligence · Computer Science 2025-02-04 Yoann Poupart , Aurélie Beynier , Nicolas Maudet

A core interest in building Artificial Intelligence (AI) agents is to let them interact with and assist humans. One example is Dynamic Search (DS), which models the process that a human works with a search engine agent to accomplish a…

Information Retrieval · Computer Science 2021-06-10 Zhiwen Tang , Grace Hui Yang

The rapid advancement of large language models (LLMs) has driven the development of agentic systems capable of autonomously performing complex tasks. Despite their impressive capabilities, LLMs remain constrained by their internal knowledge…

Information Retrieval · Computer Science 2025-08-19 Wenlin Zhang , Xiaopeng Li , Yingyi Zhang , Pengyue Jia , Yichao Wang , Huifeng Guo , Yong Liu , Xiangyu Zhao

Scientific Deep Research (DR) agents answer user queries by synthesizing research papers into multi-section reports. User feedback can improve their utility, but existing protocols only score the final report, making it hard to study and…

The increasing use of Retrieval-Augmented Generation (RAG) systems in various applications necessitates stringent protocols to ensure RAG systems accuracy, safety, and alignment with user intentions. In this paper, we introduce VERA…

Information Retrieval · Computer Science 2024-09-09 Tianyu Ding , Adi Banerjee , Laurent Mombaerts , Yunhong Li , Tarik Borogovac , Juan Pablo De la Cruz Weinstein

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Deep Reinforcement Learning (DRL) has emerged as a powerful solution for meeting the growing demands for connectivity, reliability, low latency and operational efficiency in advanced networks. However, most research has focused on…

Networking and Internet Architecture · Computer Science 2025-07-21 Haiyuan Li , Hari Madhukumar , Peizheng Li , Yuelin Liu , Yiran Teng , Yulei Wu , Ning Wang , Shuangyi Yan , Dimitra Simeonidou

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie