English
Related papers

Related papers: Multi-Modal Learning Using Physicians Diagnostics …

200 papers

Optical Coherence Tomography (OCT) provides valuable insights in ophthalmology, cardiology, and neurology due to high-resolution, cross-sectional images of the retina. One critical task for ophthalmologists using OCT is delineation of…

Image and Video Processing · Electrical Eng. & Systems 2025-05-21 Samuel T. M. Ball

This paper attacks an emerging challenge of multi-modal retinal disease recognition. Given a multi-modal case consisting of a color fundus photo (CFP) and an array of OCT B-scan images acquired during an eye examination, we aim to build a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Xirong Li , Yang Zhou , Jie Wang , Hailan Lin , Jianchun Zhao , Dayong Ding , Weihong Yu , Youxin Chen

Longitudinal imaging is capable of capturing the static ana\-to\-mi\-cal structures and the dynamic changes of the morphology resulting from aging or disease progression. Self-supervised learning allows to learn new representation from…

Image and Video Processing · Electrical Eng. & Systems 2019-10-25 Antoine Rivail , Ursula Schmidt-Erfurth , Wolf-Dieter Vogl , Sebastian M. Waldstein , Sophie Riedl , Christoph Grechenig , Zhichao Wu , Hrvoje Bogunović

Since the introduction of optical coherence tomography (OCT), it has been possible to study the complex 3D morphological changes of the optic nerve head (ONH) tissues that occur along with the progression of glaucoma. Although several deep…

This dissertation relates to the transition of the state of the art of swept source optical coherence tomography (SS-OCT) systems to a new realm in which the image acquisition speed is improved by an order of magnitude. With the aid of a…

Image and Video Processing · Electrical Eng. & Systems 2020-02-21 Amir Tofighi Zavareh

Purpose: This study explores the feasibility of using generative machine learning (ML) to translate Optical Coherence Tomography (OCT) images into Optical Coherence Tomography Angiography (OCTA) images, potentially bypassing the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rashadul Hasan Badhon , Atalie Carina Thompson , Jennifer I. Lim , Theodore Leng , Minhaj Nur Alam

Optical coherence tomography (OCT) is a prevalent, interferometric, high-resolution imaging method with broad biomedical applications. Nonetheless, OCT images suffer from an artifact, called speckle which degrades the image quality. Digital…

Optical Coherence Tomography (OCT) imaging plays an important role in glaucoma diagnosis in clinical practice. Early detection and timely treatment can prevent glaucoma patients from permanent vision loss. However, only a dearth of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Xi Wang , Hao Chen , Luyang Luo , An-ran Ran , Poemen P. Chan , Clement C. Tham , Carol Y. Cheung , Pheng-Ann Heng

Optical coherence tomography (OCT) is widely used for diagnosing and monitoring retinal diseases, such as age-related macular degeneration (AMD). The segmentation of biomarkers such as layers and lesions is essential for patient diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Botond Fazekas , Guilherme Aresta , Philipp Seeböck , Julia Mai , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Retinal optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA) are promising tools for the (early) diagnosis of Alzheimer's disease (AD). These non-invasive imaging techniques are cost-effective and more…

Image and Video Processing · Electrical Eng. & Systems 2022-09-09 Yasemin Turkan , F. Boray Tek

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Currently, diagnosis of skin diseases is based primarily on visual pattern recognition skills and expertise of the physician observing the lesion. Even though dermatologists are trained to recognize patterns of morphology, it is still a…

Mean Deviation (MD) is a critical metric for assessing visual field loss in ophthalmology. While previous work has focused solely on predicting MD from Optical Coherence Tomography (OCT), it is intuitive to assume that combining OCT with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Haojie Yin , Chengcheng Feng , Tianyi Liu , Tianqi Zhang , Kaizhu Huang

Optical Coherence Tomography (OCT) is an emerging medical imaging modality for luminal organ diagnosis. The non-constant rotation speed of optical components in the OCT catheter tip causes rotational distortion in OCT volumetric scanning.…

Optical tomographic cross-sectional images of biological samples were made possible by interferometric imaging techniques such as Optical Coherence Tomography (OCT). Owing to its unprecedented view of the sample, OCT has become a gold…

Medical Physics · Physics 2020-07-13 Pedro Mecê , Elena Gofas-Salas , Michel Paques , Kate Grieve , Serge Meimon

Eye diseases have posed significant challenges for decades, but advancements in technology have opened new avenues for their detection and treatment. Machine learning and deep learning algorithms have become instrumental in this domain,…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Gauri Naik , Nandini Narvekar , Dimple Agarwal , Nishita Nandanwar , Himangi Pande

In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography, are often involved to make a diagnosis of retinal disease. Multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Aline Sindel , Bettina Hohberger , Andreas Maier , Vincent Christlein

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

Stroke is a major public health problem, affecting millions worldwide. Deep learning has recently demonstrated promise for enhancing the diagnosis and risk prediction of stroke. However, existing methods rely on costly medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2025-12-17 Saeed Shurrab , Aadim Nepal , Terrence J. Lee-St. John , Nicola G. Ghazi , Bartlomiej Piechowski-Jozwiak , Farah E. Shamout