中文
相关论文

相关论文: MI-CXR: A Benchmark for Longitudinal Reasoning ove…

200 篇论文

Compared to single-turn dialogue, multi-turn dialogue involving multiple images better aligns with the needs of real-world human-AI interactions. Additionally, as training data, it provides richer contextual reasoning information, thereby…

人工智能 · 计算机科学 2025-03-25 Dawei Yan , Yang Li , Qing-Guo Chen , Weihua Luo , Peng Wang , Haokui Zhang , Chunhua Shen

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

Medical AI systems face two fundamental limitations. First, conventional vision-language models (VLMs) perform single-pass inference, yielding black-box predictions that cannot be audited or explained in clinical terms. Second, iterative…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Nicanor Mayumu , Zeenath Khan , Melodena Stephens , Patrick Mukala , Farhad Oroumchian

We introduce InterChart, a diagnostic benchmark that evaluates how well vision-language models (VLMs) reason across multiple related charts, a task central to real-world applications such as scientific reporting, financial analysis, and…

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

机器学习 · 计算机科学 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Despite the reduction in turn-around times in radiology reports with the use of speech recognition software, persistent communication errors can significantly impact the interpretation of the radiology report. Pre-filling a radiology report…

计算与语言 · 计算机科学 2023-10-11 Qingqing Zhu , Tejas Sudharshan Mathai , Pritam Mukherjee , Yifan Peng , Ronald M. Summers , Zhiyong Lu

In intensive care units (ICUs), patients with complex clinical conditions require vigilant monitoring and prompt interventions. Chest X-rays (CXRs) are a vital diagnostic tool, providing insights into clinical trajectories, but their…

Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relationships in visual inputs remains unclear. Robust causal reasoning is fundamental to solving…

计算与语言 · 计算机科学 2026-02-05 Zhaotian Weng , Haoxuan Li , Xin Eric Wang , Kuan-Hao Huang , Jieyu Zhao

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

计算与语言 · 计算机科学 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Multi-image Interleaved Reasoning aims to improve Multi-modal Large Language Models (MLLMs) ability to jointly comprehend and reason across multiple images and their associated textual contexts, introducing unique challenges beyond…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Hang Du , Jiayang Zhang , Guoshun Nan , Wendi Deng , Zhenyan Chen , Chenyang Zhang , Wang Xiao , Shan Huang , Yuqi Pan , Tao Qi , Sicong Leng

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

Despite recent advancements in Multi-modal Large Language Models (MLLMs) on diverse understanding tasks, these models struggle to solve problems which require extensive multi-step reasoning. This is primarily due to the progressive dilution…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Byungwoo Jeon , Yoonwoo Jeong , Hyunseok Lee , Minsu Cho , Jinwoo Shin

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

The advancement of large language models (LLMs) has significantly broadened the scope of applications in natural language processing, with multi-modal LLMs extending these capabilities to integrate and interpret visual data. However,…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Bingchen Zhao , Yongshuo Zong , Letian Zhang , Timothy Hospedales

Recent progress in the reasoning capabilities of multimodal large language models (MLLMs) has empowered them to address more complex tasks such as scientific analysis and mathematical reasoning. Despite their promise, MLLMs' reasoning…

计算与语言 · 计算机科学 2026-03-03 Jiachun Li , Shaoping Huang , Zhuoran Jin , Chenlong Zhang , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Vision-language models (VLMs) have achieved impressive results on single-view vision tasks, but lack the multi-view spatial reasoning capabilities essential for embodied AI systems to understand 3D environments and manipulate objects across…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Suchae Jeong , Jaehwi Song , Haeone Lee , Hanna Kim , Jian Kim , Dongjun Lee , Dong Kyu Shin , Changyeon Kim , Dongyoon Hahm , Woogyeol Jin , Juheon Choi , Kimin Lee

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Pulmonary diseases can cause severe respiratory problems, leading to sudden death if not treated timely. Many researchers have utilized deep learning systems to diagnose pulmonary disorders using chest X-rays (CXRs). However, such systems…

图像与视频处理 · 电气工程与系统科学 2022-01-17 Mehreen Sirshar , Taimur Hassan , Muhammad Usman Akram , Shoab Ahmed Khan

Spatial reasoning and visual grounding are core capabilities for vision-language models (VLMs), yet most medical VLMs produce predictions without transparent reasoning or spatial evidence. Existing benchmarks also evaluate VLMs on isolated…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Lama Moukheiber , Caleb M. Yeung , Haotian Xue , Alec Helbling , Zelin Zhao , Yongxin Chen

Scientific reasoning is a key aspect of human intelligence, requiring the integration of multimodal inputs, domain expertise, and multi-step inference across various subjects. Existing benchmarks for multimodal large language models (MLLMs)…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Longteng Guo , Xuanxu Lin , Dongze Hao , Tongtian Yue , Pengkang Huo , Jiatong Ma , Yuchen Liu , Jing Liu