中文
相关论文

相关论文: ELF: An End-to-end Local and Global Multimodal Fus…

200 篇论文

Diabetic Retinopathy (DR), a prevalent and severe complication of diabetes, affects millions of individuals globally, underscoring the need for accurate and timely diagnosis. Recent advancements in imaging technologies, such as…

Recently, multimodal deep learning, which integrates histopathology slides and molecular biomarkers, has achieved a promising performance in glioma grading. Despite great progress, due to the intra-modality complexity and inter-modality…

计算机视觉与模式识别 · 计算机科学 2024-08-19 Li Pan , Yupei Zhang , Qiushi Yang , Tan Li , Xiaohan Xing , Maximus C. F. Yeung , Zhen Chen

Automated optic disc (OD) and optic cup (OC) segmentation in fundus images is relevant to efficiently measure the vertical cup-to-disc ratio (vCDR), a biomarker commonly used in ophthalmology to determine the degree of glaucomatous optic…

Glaucoma is a leading cause of irreversible blindness worldwide, emphasizing the critical need for early detection and intervention. In this paper, we present DeepEyeNet, a novel and comprehensive framework for automated glaucoma detection…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Angshuman Roy , Anuvab Sen , Soumyajit Gupta , Soham Haldar , Subhrajit Deb , Taraka Nithin Vankala , Arkapravo Das

While Electrical Impedance Tomography (EIT) has found many biomedicine applications, a better resolution is needed to provide quantitative analysis for tissue engineering and regenerative medicine. This paper proposes an impedance-optical…

图像与视频处理 · 电气工程与系统科学 2021-12-09 Zhe Liu , Pierre Bagnaninchi , Yunjie Yang

Scarcity of large publicly available retinal fundus image datasets for automated glaucoma detection has been the bottleneck for successful application of artificial intelligence towards practical Computer-Aided Diagnosis (CAD). A few small…

图像与视频处理 · 电气工程与系统科学 2020-06-17 Muhammad Naseer Bajwa , Gur Amrit Pal Singh , Wolfgang Neumeier , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

Current deep learning models are mostly task specific and lack a user-friendly interface to operate. We present Meta-EyeFM, a multi-function foundation model that integrates a large language model (LLM) with vision foundation models (VFMs)…

Objective: Diabetic macular edema (DME) is the leading cause of severe visual impairment in patients with diabetes. Quantification of retinal fluid, particularly intraretinal fluid (IRF) and subretinal fluid (SRF), plays a critical role in…

图像与视频处理 · 电气工程与系统科学 2026-04-27 Zijun Lei , Zikang Xu , Liang Zhang , Ge Song , Hanyu Guo , Dan Cao , Yujia Zhou , Qianjin Feng

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

机器学习 · 计算机科学 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Optic disc (OD) and optic cup (OC) are regions of prominent clinical interest in a retinal fundus image. They are the primary indicators of a glaucomatous condition. With the advent and success of deep learning for healthcare research,…

图像与视频处理 · 电气工程与系统科学 2020-12-15 Aniketh Manjunath , Subramanya Jois , Chandra Sekhar Seelamantula

This paper attacks an emerging challenge of multi-modal retinal disease recognition. Given a multi-modal case consisting of a color fundus photo (CFP) and an array of OCT B-scan images acquired during an eye examination, we aim to build a…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Xirong Li , Yang Zhou , Jie Wang , Hailan Lin , Jianchun Zhao , Dayong Ding , Weihong Yu , Youxin Chen

Clinical decision-making in oncology involves multimodal data such as radiology scans, molecular profiling, histopathology slides, and clinical factors. Despite the importance of these modalities individually, no deep learning framework to…

计算机视觉与模式识别 · 计算机科学 2021-07-02 Nathaniel Braman , Jacob W. H. Gordon , Emery T. Goossens , Caleb Willis , Martin C. Stumpe , Jagadish Venkataraman

Early diagnosis of renal cancer can greatly improve the survival rate of patients. Contrast-enhanced ultrasound (CEUS) is a cost-effective and non-invasive imaging technique and has become more and more frequently used for renal tumor…

图像与视频处理 · 电气工程与系统科学 2023-07-18 Junyu Li , Han Huang , Dong Ni , Wufeng Xue , Dongmei Zhu , Jun Cheng

Objective: To validate and compare the performance of eight available deep learning architectures in grading the severity of glaucoma based on color fundus images. Materials and Methods: We retrospectively collected a dataset of 5978 fundus…

计算机视觉与模式识别 · 计算机科学 2018-11-01 Yi Zhen , Lei Wang , Han Liu , Jian Zhang , Jiantao Pu

According to multiple authoritative authorities, including the World Health Organization, vision-related impairments and disorders are becoming a significant issue. According to a recent report, one of the leading causes of irreversible…

计算机视觉与模式识别 · 计算机科学 2022-10-31 Dishant Padalia , Abhishek Mazumdar , Bharati Singh

Diabetes is a globally prevalent disease that can cause visible microvascular complications such as diabetic retinopathy and macular edema in the human eye retina, the images of which are today used for manual disease screening. This…

图像与视频处理 · 电气工程与系统科学 2019-04-19 Jaakko Sahlsten , Joel Jaskari , Jyri Kivinen , Lauri Turunen , Esa Jaanio , Kustaa Hietala , Kimmo Kaski

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng

We present OCTCube-M, a 3D OCT-based multi-modal foundation model for jointly analyzing OCT and en face images. OCTCube-M first developed OCTCube, a 3D foundation model pre-trained on 26,685 3D OCT volumes encompassing 1.62 million 2D OCT…

图像与视频处理 · 电气工程与系统科学 2024-12-20 Zixuan Liu , Hanwen Xu , Addie Woicik , Linda G. Shapiro , Marian Blazes , Yue Wu , Verena Steffen , Catherine Cukras , Cecilia S. Lee , Miao Zhang , Aaron Y. Lee , Sheng Wang

A variety of vision ailments are associated with geographic atrophy (GA) in the foveal region of the eye. In current clinical practice, the ophthalmologist manually detects potential presence of such GA based on fundus autofluorescence…

Medical data collected for diagnostic decisions are typically multimodal, providing comprehensive information on a subject. While computer-aided diagnosis systems can benefit from multimodal inputs, effectively fusing such data remains a…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Qiuhui Chen , Yi Hong