中文
相关论文

相关论文: MIRAGE: Multimodal foundation model and benchmark …

200 篇论文

Musculoskeletal disorders represent a leading cause of global disability, creating an urgent demand for precise interpretation of medical imaging. Current artificial intelligence (AI) approaches in orthopedics predominantly rely on…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Kang Yu , Dingyu Wang , Zimu Yuan , Nan Zhou , Jiajun Liu , Jiaxin Liu , Shanggui Liu , Yaoyan Zheng , Huishu Yuan , Di Huang , Dong Jiang

Ophthalmic images may contain identical-looking pathologies that can cause failure in automated techniques to distinguish different retinal degenerative diseases. Additionally, reliance on large annotated datasets and lack of knowledge…

图像与视频处理 · 电气工程与系统科学 2022-08-02 Sharif Amit Kamran , Khondker Fariha Hossain , Alireza Tavakkoli , Stewart Lee Zuckerbrod , Salah A. Baker

With the rapid advancement of generative AI, synthetic content across images, videos, and audio has become increasingly realistic, amplifying the risk of misinformation. Existing detection approaches predominantly focus on binary…

机器学习 · 计算机科学 2025-07-23 Xu Yang , Qi Zhang , Shuming Jiang , Yaowen Xu , Zhaofan Zou , Hao Sun , Xuelong Li

Optical coherence tomography (OCT) and confocal microscopy are pivotal in retinal imaging, offering distinct advantages and limitations. In vivo OCT offers rapid, non-invasive imaging but can suffer from clarity issues and motion artifacts,…

图像与视频处理 · 电气工程与系统科学 2024-12-18 Xin Tian , Nantheera Anantrasirichai , Lindsay Nicholson , Alin Achim

Cardiac magnetic resonance imaging (CMR), considered the gold standard for noninvasive cardiac assessment, is a diverse and complex modality requiring a wide variety of image processing tasks for comprehensive assessment of cardiac…

图像与视频处理 · 电气工程与系统科学 2025-12-03 Athira J Jacob , Indraneel Borgohain , Teodora Chitiboi , Puneet Sharma , Dorin Comaniciu , Daniel Rueckert

Despite significant advances in artificial intelligence (AI) for computer vision, its application in medical imaging has been limited by the burden and limits of expert-generated labels. We used images from optical coherence tomography…

计算机视觉与模式识别 · 计算机科学 2018-02-27 Cecilia S. Lee , Ariel J. Tyring , Yue Wu , Sa Xiao , Ariel S. Rokem , Nicolaas P. Deruyter , Qinqin Zhang , Adnan Tufail , Ruikang K. Wang , Aaron Y. Lee

The rapid advancement of foundation models has revolutionized visual representation learning in a self-supervised manner. However, their application in remote sensing (RS) remains constrained by a fundamental gap: existing models…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Hanbo Bi , Yingchao Feng , Boyuan Tong , Mengyu Wang , Haichen Yu , Yongqiang Mao , Hao Chang , Wenhui Diao , Peijin Wang , Yue Yu , Hanyang Peng , Yehong Zhang , Kun Fu , Xian Sun

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng

Retinal optical coherence tomography (OCT) images provide crucial insights into the health of the posterior ocular segment. Therefore, the advancement of automated image analysis methods is imperative to equip clinicians and researchers…

图像与视频处理 · 电气工程与系统科学 2024-02-16 Jiahao Wang , Hong Peng , Shengchao Chen , Sufen Ren

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

图像与视频处理 · 电气工程与系统科学 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

Recent advances in image generation models have led to models that produce synthetic images that are increasingly difficult for standard AI detectors to identify, even though they often remain distinguishable by humans. To identify this…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Pranav Sharma , Shivank Garg , Durga Toshniwal

To study whether it is possible to differentiate intermediate age-related macular degeneration (AMD) from healthy controls using partial optical coherence tomography (OCT) data, that is, restricting the input B-scans to certain pre-defined…

图像与视频处理 · 电气工程与系统科学 2023-07-17 Danilo A. Jesus , Eric F. Thee , Tim Doekemeijer , Daniel Luttikhuizen , Caroline Klaver , Stefan Klein , Theo van Walsum , Hans Vingerling , Luisa Sanchez

Machine learning has demonstrated remarkable performance over finite datasets, yet whether the scores over the fixed benchmarks can sufficiently indicate the model's performance in the real world is still in discussion. In reality, an ideal…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Peiyan Zhang , Haoyang Liu , Chaozhuo Li , Xing Xie , Sunghun Kim , Haohan Wang

Foundation models update slowly due to resource-intensive training, whereas domain-specific models evolve rapidly between releases. Model merging seeks to combine multiple expert models into a single, more capable model, reducing storage…

人工智能 · 计算机科学 2026-03-04 Yongxian Wei , Runxi Cheng , Weike Jin , Enneng Yang , Li Shen , Lu Hou , Sinan Du , Chun Yuan , Xiaochun Cao , Dacheng Tao

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

计算与语言 · 计算机科学 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He

For accurate glaucoma diagnosis and monitoring, reliable retinal layer segmentation in OCT images is essential. However, existing 2D segmentation methods often suffer from slice-to-slice inconsistencies due to the lack of contextual…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Hyunwoo Kim , Heesuk Kim , Wungrak Choi , Jae-Sang Hyun

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

图像与视频处理 · 电气工程与系统科学 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Automating medical reports for retinal images requires a sophisticated blend of visual pattern recognition and deep clinical knowledge. Current Large Vision-Language Models (LVLMs) often struggle in specialized medical fields where data is…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many different fields to collect similar scales of natural images…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Chenyang Lei , Liyi Chen , Jun Cen , Xiao Chen , Zhen Lei , Felix Heide , Qifeng Chen , Zhaoxiang Zhang