English
Related papers

Related papers: MIRAGE: Multimodal foundation model and benchmark …

200 papers

Medical artificial general intelligence (MAGI) enables one foundation model to solve different medical tasks, which is very practical in the medical domain. It can significantly reduce the requirement of large amounts of task-specific data…

Artificial intelligence (AI) classification holds promise as a novel and affordable screening tool for clinical management of ocular diseases. Rural and underserved areas, which suffer from lack of access to experienced ophthalmologists may…

Quantitative Methods · Quantitative Biology 2019-06-19 Minhaj Alam , David Le , Jennifer I. Lim , R. V. P. Chan , Xincheng Yao

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Jia-Hong Huang

Remote Sensing (RS) is a crucial technology for observing, monitoring, and interpreting our planet, with broad applications across geoscience, economics, humanitarian fields, etc. While artificial intelligence (AI), particularly deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Aoran Xiao , Weihao Xuan , Junjue Wang , Jiaxing Huang , Dacheng Tao , Shijian Lu , Naoto Yokoya

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Recent advancements in ophthalmology foundation models such as RetFound have demonstrated remarkable diagnostic capabilities but require massive datasets for effective pre-training, creating significant barriers for development and…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Qingshan Hou , Meng Wang , Peng Cao , Zou Ke , Xiaoli Liu , Huazhu Fu , Osmar R. Zaiane

Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many different fields to collect similar scales of natural images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Chenyang Lei , Liyi Chen , Jun Cen , Xiao Chen , Zhen Lei , Felix Heide , Ziwei Liu , Qifeng Chen , Zhaoxiang Zhang

The measurement of retinal blood flow (RBF) in capillaries can provide a powerful biomarker for the early diagnosis and treatment of ocular diseases. However, no single modality can determine capillary flowrates with high precision.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Chiao-Yi Wang , Faranguisse Kakhi Sadrieh , Yi-Ting Shen , Shih-En Chen , Sarah Kim , Victoria Chen , Achyut Raghavendra , Dongyi Wang , Osamah Saeedi , Yang Tao

Non-mydriatic retinal color fundus photography (CFP) is widely available due to the advantage of not requiring pupillary dilation, however, is prone to poor quality due to operators, systemic imperfections, or patient-related causes.…

Image and Video Processing · Electrical Eng. & Systems 2023-04-11 Wenhui Zhu , Peijie Qiu , Oana M. Dumitrascu , Jacob M. Sobczak , Mohammad Farazi , Zhangsihao Yang , Keshav Nandakumar , Yalin Wang

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Purpose: To evaluate Pegasus-OCT, a clinical decision support software for the identification of features of retinal disease from macula OCT scans, across heterogenous populations involving varying patient demographics, device…

Image and Video Processing · Electrical Eng. & Systems 2019-07-12 Kanwal K. Bhatia , Mark S. Graham , Louise Terry , Ashley Wood , Paris Tranos , Sameer Trikha , Nicolas Jaccard

The spreading of AI-generated images (AIGI), driven by advances in generative AI, poses a significant threat to information security and public trust. Existing AIGI detectors, while effective against images in clean laboratory settings,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Cheng Xia , Manxi Lin , Jiexiang Tan , Xiaoxiong Du , Yang Qiu , Junjun Zheng , Xiangheng Kong , Yuning Jiang , Bo Zheng

Optical coherence tomography (OCT) is commonly used to analyze retinal layers for assessment of ocular diseases. In this paper, we propose a method for retinal layer segmentation and quantification of uncertainty based on Bayesian deep…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Suman Sedai , Bhavna Antony , Dwarikanath Mahapatra , Rahil Garnavi

The rising prevalence of eye diseases poses a growing public health burden. Large language models (LLMs) offer a promising path to reduce documentation workload and support clinical decision-making. However, few have been tailored for…

The widespread use of Magnetic Resonance Imaging (MRI) in combination with deep learning shows promise for many high-impact automated diagnostic and prognostic tools. However, training new models requires large amounts of labeled data, a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Haoyu Dong , Yuwen Chen , Hanxue Gu , Nicholas Konz , Yaqian Chen , Qihang Li , Maciej A. Mazurowski

Focusing on the complicated pathological features, such as blurred boundaries, severe scale differences between symptoms, background noise interference, etc., in the task of retinal edema lesions joint segmentation from OCT images and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Meng Wang , Kai Yu , Chun-Mei Feng , Ke Zou , Yanyu Xu , Qingquan Meng , Rick Siow Mong Goh , Yong Liu , Huazhu Fu

Degradation-agnostic image restoration aims to handle diverse corruptions with one unified model, but faces fundamental challenges in balancing efficiency and performance across different degradation types. Existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Bin Ren , Yawei Li , Xu Zheng , Yuqian Fu , Danda Pani Paudel , Hong Liu , Ming-Hsuan Yang , Luc Van Gool , Nicu Sebe

Allying high-resolution with a large field-of-view (FOV) is of great importance in the fields of biology and medicine, but particularly challenging when imaging non-flat living samples such as the human retina. Indeed, high-resolution is…

The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tai-Ming Huang , Wei-Tung Lin , Kai-Lung Hua , Wen-Huang Cheng , Junichi Yamagishi , Jun-Cheng Chen

Optical coherence tomography (OCT) is a micrometer-scale, volumetric imaging modality that has become a clinical standard in ophthalmology. OCT instruments image by raster-scanning a focused light spot across the retina, acquiring…

Image and Video Processing · Electrical Eng. & Systems 2022-09-16 Stefan Ploner , Siyu Chen , Jungeun Won , Lennart Husvogt , Katharina Breininger , Julia Schottenhamml , James Fujimoto , Andreas Maier