English
Related papers

Related papers: Multi-OCT-SelfNet: Integrating Self-Supervised Lea…

200 papers

Deep learning has proven very promising for interpreting MRI in brain tumor diagnosis. However, deep learning models suffer from a scarcity of brain MRI datasets for effective training. Self-supervised learning (SSL) models provide…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Meryem Altin Karagoz , O. Ufuk Nalbantoglu , Geoffrey C. Fox

Glaucomatous optic neuropathy (GON) is a prevalent ocular disease that can lead to irreversible vision loss if not detected early and treated. The traditional diagnostic approach for GON involves a set of ophthalmic examinations, which are…

Myopia screening using cutting-edge ultra-widefield (UWF) fundus imaging and joint modeling of multiple discrete and continuous clinical scores presents a promising new paradigm for multi-task problems in Ophthalmology. The bi-channel…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yang Li , Jianing Deng , Chong Zhong , Danjuan Yang , Meiyan Li , A. H. Welsh , Aiyi Liu , Xingtao Zhou , Catherine C. Liu , Bo Fu

In optical coherence tomography (OCT) volumes of retina, the sequential acquisition of the individual slices makes this modality prone to motion artifacts, misalignments between adjacent slices being the most noticeable. Any distortion in…

Machine Learning · Computer Science 2020-07-06 Yasmeen M. George , Suman Sedai , Bhavna J. Antony , Hiroshi Ishikawa , Gadi Wollstein , Joel S. Schuman , Rahil Garnavi

Supervised deep learning algorithms have enabled significant performance gains in medical image classification tasks. But these methods rely on large labeled datasets that require resource-intensive expert annotation. Semi-supervised…

Retinal foundation models have significantly advanced retinal image analysis by leveraging self-supervised learning to reduce dependence on labeled data while achieving strong generalization. Many recent approaches enhance retinal image…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Yeonkyung Lee , Woojung Han , Youngjun Jun , Hyeonmin Kim , Jungkyung Cho , Seong Jae Hwang

Multimodal learning, which aims to understand and analyze information from multiple modalities, has achieved substantial progress in the supervised regime in recent years. However, the heavy dependence on data paired with expensive human…

Machine Learning · Computer Science 2024-08-19 Yongshuo Zong , Oisin Mac Aodha , Timothy Hospedales

Deep learning models, such as the fully convolutional network (FCN), have been widely used in 3D biomedical segmentation and achieved state-of-the-art performance. Multiple modalities are often used for disease diagnosis and quantification.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yu Chen , Jiawei Chen , Dong Wei , Yuexiang Li , Yefeng Zheng

This study aims to optimize the few-shot image classification task and improve the model's feature extraction and classification performance by combining self-supervised learning with the deep network model ResNet-101. During the training…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuyang Xiao

While the general idea of self-supervised learning is identical across modalities, the actual algorithms and objectives differ widely because they were developed with a single modality in mind. To get us closer to general self-supervised…

Machine Learning · Computer Science 2022-10-27 Alexei Baevski , Wei-Ning Hsu , Qiantong Xu , Arun Babu , Jiatao Gu , Michael Auli

Inpainting shadowed regions cast by superficial blood vessels in retinal optical coherence tomography (OCT) images is critical for accurate and robust machine analysis and clinical diagnosis. Traditional sequence-based approaches such as…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Yaoqi Tang , Yufan Li , Hongshan Liu , Jiaxuan Li , Peiyao Jin , Yu Gan , Yuye Ling , Yikai Su

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

With promising results of machine learning based models in computer vision, applications on medical imaging data have been increasing exponentially. However, generalizations to complex real-world clinical data is a persistent problem. Deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Nooshin Mojab , Vahid Noroozi , Darvin Yi , Manoj Prabhakar Nallabothula , Abdullah Aleem , Phillip S. Yu , Joelle A. Hallak

Artificial intelligence (AI) classification holds promise as a novel and affordable screening tool for clinical management of ocular diseases. Rural and underserved areas, which suffer from lack of access to experienced ophthalmologists may…

Quantitative Methods · Quantitative Biology 2019-06-19 Minhaj Alam , David Le , Jennifer I. Lim , R. V. P. Chan , Xincheng Yao

Advances in optical coherence tomography (OCT) have enabled noninvasive imaging of substructures of the human retina with high spatial resolution. OCT examinations are now a standard procedure in clinics and an integral part of ophthalmic…

Human-Computer Interaction · Computer Science 2022-12-22 Martin Röhlig , Oliver Stachs , Heidrun Schumann

Aiming to advance AI agents, large foundation models significantly improve reasoning and instruction execution, yet the current focus on vision and language neglects the potential of perceiving diverse modalities in open-world environments.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Weixian Lei , Yixiao Ge , Kun Yi , Jianfeng Zhang , Difei Gao , Dylan Sun , Yuying Ge , Ying Shan , Mike Zheng Shou

The performance of face detectors has been largely improved with the development of convolutional neural network. However, it remains challenging for face detectors to detect tiny, occluded or blurry faces. Besides, most face detectors…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Wanxin Tian , Zixuan Wang , Haifeng Shen , Weihong Deng , Yiping Meng , Binghui Chen , Xiubao Zhang , Yuan Zhao , Xiehe Huang

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Jia-Hong Huang