English
Related papers

Related papers: MedEBench: Diagnosing Reliability in Text-Guided M…

200 papers

Despite remarkable advancements in pixel-level medical image perception, existing methods are either limited to specific tasks or heavily rely on accurate bounding boxes or text labels as input prompts. However, the medical knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qinyue Tong , Ziqian Lu , Jun Liu , Yangming Zheng , Zheming Lu

Recent advancements in image editing have enabled highly controllable and semantically-aware alteration of visual content, posing unprecedented challenges to manipulation localization. However, existing AI-generated forgery localization…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shiyu Wu , Shuyan Li , Jing Li , Jing Liu , Yequan Wang

Recent progress in text-to-image (T2I) generation underscores the importance of reliable benchmarks in evaluating how accurately generated images reflect the semantics of their textual prompt. However, (1) existing benchmarks lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yibin Wang , Zhimin Li , Yuhang Zang , Jiazi Bu , Yujie Zhou , Yi Xin , Junjun He , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Current vision-language models (VLMs) in medicine are primarily designed for categorical question answering (e.g., "Is this normal or abnormal?") or qualitative descriptive tasks. However, clinical decision-making often relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yongcheng Yao , Yongshuo Zong , Raman Dutt , Yongxin Yang , Sotirios A Tsaftaris , Timothy Hospedales

Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Malek Ben Alaya , Daniel M. Lang , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

Medical image segmentation is a critical component in clinical practice, facilitating accurate diagnosis, treatment planning, and disease monitoring. However, existing methods, often tailored to specific modalities or disease types, lack…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Jun Ma , Yuting He , Feifei Li , Lin Han , Chenyu You , Bo Wang

Text-guided image editing models have shown remarkable results. However, there remain two problems. First, they employ fixed manipulation modules for various editing requirements (e.g., color changing, texture changing, content adding and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Ming Tao , Bing-Kun Bao , Hao Tang , Fei Wu , Longhui Wei , Qi Tian

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Multimodal large language models (LLMs) are increasingly used to generate dermatology diagnostic narratives directly from images. However, reliable evaluation remains the primary bottleneck for responsible clinical deployment. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuhao Shen , Jiahe Qian , Shuping Zhang , Zhangtianyi Chen , Tao Lu , Juexiao Zhou

The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms, making fair cross-paradigm comparisons difficult, while video editing lacks reliable…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lifan Jiang , Tianrun Wu , Yuhang Pei , Chenyang Wang , Boxi Wu , Deng Cai

The rapid development of diffusion models has significantly advanced AI-generated content (AIGC), particularly in Text-to-Image (T2I) and Text-to-Video (T2V) generation. Text-based video editing, leveraging these generative capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yupeng Chen , Penglin Chen , Xiaoyu Zhang , Yixian Huang , Qian Xie

Image generation has witnessed significant advancements in the past few years. However, evaluating the performance of image generation models remains a formidable challenge. In this paper, we propose ICE-Bench, a unified and comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Yulin Pan , Xiangteng He , Chaojie Mao , Zhen Han , Zeyinzi Jiang , Jingfeng Zhang , Yu Liu

Over the past decade, U-Net has been the dominant architecture in medical image segmentation, leading to the development of thousands of U-shaped variants. Despite its widespread adoption, there is still no comprehensive benchmark to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fenghe Tang , Chengqi Dong , Wenxin Ma , Zikang Xu , Heqin Zhu , Zihang Jiang , Rongsheng Wang , Yuhao Wang , Chenxu Wu , Shaohua Kevin Zhou

Clinical diagnosis is critical in medical practice, typically requiring a continuous and evolving process that includes primary diagnosis, differential diagnosis, and final diagnosis. However, most existing clinical diagnostic tasks are…

Artificial Intelligence · Computer Science 2024-12-17 Ruihui Hou , Shencheng Chen , Yongqi Fan , Guangya Yu , Lifeng Zhu , Jing Sun , Jingping Liu , Tong Ruan

Advances in diffusion, autoregressive, and hybrid models have enabled high-quality image synthesis for tasks such as text-to-image, editing, and reference-guided composition. Yet, existing benchmarks remain limited, either focus on isolated…

Biomedical imaging datasets are often small and biased, meaning that real-world performance of predictive models can be substantially lower than expected from internal testing. This work proposes using generative image editing to simulate…

Multimodal Large Language Models (MLLMs) have shown significant potential in surgical video understanding. With improved zero-shot performance and more effective human-machine interaction, they provide a strong foundation for advancing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ziyang Song , Zelin Zang , Xiaofan Ye , Boqiang Xu , Long Bai , Jinlin Wu , Hongliang Ren , Hongbin Liu , Jiebo Luo , Zhen Lei

The meaningful use of electronic health records (EHR) continues to progress in the digital era with clinical decision support systems augmented by artificial intelligence. A priority in improving provider experience is to overcome…

Computation and Language · Computer Science 2023-01-30 Yanjun Gao , Dmitriy Dligach , Timothy Miller , John Caskey , Brihat Sharma , Matthew M Churpek , Majid Afshar