中文
相关论文

相关论文: Strong Reasoning Isn't Enough: Evaluating Evidence…

200 篇论文

Large language model-based web agents have demonstrated strong performance on realistic web interaction tasks. However, existing evaluations are predominantly conducted under relatively stable and well-behaved interaction conditions, which…

软件工程 · 计算机科学 2026-04-21 Haoyue Bai , Dong Wang , Long Chen , Bingguang Hao , Pengyang Shao , Yonghui Yang , Yicheng He , Chenyi Zhuang

Deep learning models trained on extensive Electronic Health Records (EHR) data have achieved high accuracy in diagnosis prediction, offering the potential to assist clinicians in decision-making and treatment planning. However, these models…

人工智能 · 计算机科学 2025-09-30 Xiaoxue Han , Pengfei Hu , Jun-En Ding , Chang Lu , Feng Liu , Yue Ning

Motivated by the underspecified, multi-hop nature of search queries and the multimodal, heterogeneous, and often conflicting nature of real-world web results, we introduce MERRIN (Multimodal Evidence Retrieval and Reasoning in Noisy Web…

计算与语言 · 计算机科学 2026-04-16 Han Wang , David Wan , Hyunji Lee , Thinh Pham , Mikaela Cankosyan , Weiyuan Chen , Elias Stengel-Eskin , Tu Vu , Mohit Bansal

Effective clinical decision-making depends on iterative, multimodal reasoning across diverse sources of evidence. The recent emergence of multimodal reasoning models has significantly transformed the landscape of solving complex tasks.…

计算与语言 · 计算机科学 2025-11-04 Zhongzhen Huang , Linjie Mu , Yakun Zhu , Xiangyu Zhao , Shaoting Zhang , Xiaofan Zhang

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

机器学习 · 计算机科学 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Retrieval-Augmented Generation (RAG) effectively improves the accuracy of Large Language Models (LLMs). However, retrieval noises significantly undermine the quality of LLMs' generation, necessitating the development of denoising…

计算与语言 · 计算机科学 2026-04-21 Xinping Zhao , Shouzheng Huang , Yan Zhong , Xinshuo Hu , Meishan Zhang , Baotian Hu , Min Zhang

Large reasoning models (LRMs) have recently achieved significant progress in complex reasoning tasks, aided by reinforcement learning with verifiable rewards. However, LRMs often suffer from overthinking, expending excessive computation on…

人工智能 · 计算机科学 2025-08-19 Chuhuai Yue , Chengqi Dong , Yinan Gao , Hang He , Jiajun Chai , Guojun Yin , Wei Lin

Biomedical question answering often requires decisions from retrieved literature whose relevance, quality, and support for candidate answers are uneven. Most retrieval-augmented large language model (LLM) methods feed this literature to the…

计算与语言 · 计算机科学 2026-05-19 Chang Zong , Hao Ning , Siliang Tang , Jie Huang , Jian Wan

When building artificial intelligence systems that can reason and answer questions about visual data, we need diagnostic tests to analyze our progress and discover shortcomings. Existing benchmarks for visual question answering can help,…

计算机视觉与模式识别 · 计算机科学 2016-12-22 Justin Johnson , Bharath Hariharan , Laurens van der Maaten , Li Fei-Fei , C. Lawrence Zitnick , Ross Girshick

Reasoning-oriented Large Language Models (LLMs) have achieved remarkable progress with Chain-of-Thought (CoT) prompting, yet they remain fundamentally limited by a \emph{blind self-thinking} paradigm: performing extensive internal reasoning…

计算与语言 · 计算机科学 2026-05-29 Xin Chen , Feng Jiang , Yiqian Zhang , Hardy Chen , Shuo Yan , Wenya Xie , Min Yang , Shujian Huang

Clinical reasoning agents based on large language models (LLMs) aim to automate tasks such as intensive care unit (ICU) monitoring and patient state tracking from electronic health records (EHRs). Existing systems typically rely on manually…

Deep research systems are widely used for multi-step web research, analysis, and cross-source synthesis, yet their evaluation remains challenging. Existing benchmarks often require annotation-intensive task construction, rely on static…

计算与语言 · 计算机科学 2026-01-15 Yibo Wang , Lei Wang , Yue Deng , Keming Wu , Yao Xiao , Huanjin Yao , Liwei Kang , Hai Ye , Yongcheng Jing , Lidong Bing

Longitudinal health agents must reason across multi-source trajectories that combine continuous device streams, sparse clinical exams, and episodic life events - yet evaluating them is hard: real-world data cannot be released at scale, and…

人工智能 · 计算机科学 2026-04-06 Chao Li , Cailiang Liu , Ang Gao , Kexin Deng , Shu Zhang , Langping Xu , Xiaotong Shi , Xionghao Ding , Jian Pei , Xun Jiang

Automated radiology report generation holds immense potential to alleviate the heavy workload of radiologists. Despite the formidable vision-language capabilities of recent Multimodal Large Language Models (MLLMs), their clinical deployment…

人工智能 · 计算机科学 2026-03-17 Tuoshi Qi , Shenshen Bu , Yingfei Xiang , Zhiming Dai

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating their parametric knowledge with external retrieved content. However, knowledge conflicts caused by internal inconsistencies or noisy retrieved content…

计算与语言 · 计算机科学 2025-07-03 Juan Chen , Baolong Bi , Wei Zhang , Jingyan Sui , Xiaofei Zhu , Yuanzhuo Wang , Lingrui Mei , Shenghua Liu

Large Language Models (LLMs) are increasingly deployed for knowledge synthesis, yet their capacity for compositional generalization in scientific knowledge remains under-characterized. Existing benchmarks primarily focus on single-turn…

Reasoning models produce long traces of intermediate decisions and tool calls, making test-time verification important for ensuring correctness. Existing approaches either verify only the final answer, which misses early errors, or rely on…

We study clinical trial table reasoning, where answers are not directly stored in visible cells but must be reasoned from semantic understanding through normalization, classification, extraction, or lightweight domain reasoning. Motivated…

Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Honghua Chen , Zitong Xu , Huiyu Duan , Xinyun Zhang , Xiongkuo Min , Guangtao Zhai

Weakly supervised learning aims to reduce the cost of labeling data by using expert-designed labeling rules. However, existing methods require experts to design effective rules in a single shot, which is difficult in the absence of proper…

计算与语言 · 计算机科学 2024-09-10 Giannis Karamanolakis , Daniel Hsu , Luis Gravano