English
Related papers

Related papers: Re-M3Dr: Rebalanced MultiModal Mean Deviation Regr…

200 papers

Diabetic Retinopathy (DR), an ocular complication of diabetes, is a leading cause of blindness worldwide. Traditionally, DR is monitored using Color Fundus Photography (CFP), a widespread 2-D imaging modality. However, DR classifications…

In medical image analysis, regression plays a critical role in computer-aided diagnosis. It enables quantitative measurements such as age prediction from structural imaging, cardiac function quantification, and molecular measurement from…

Machine Learning · Computer Science 2025-03-25 Yilei Wu , Zijian Dong , Chongyao Chen , Wangchunshu Zhou , Juan Helen Zhou

Perturbation with diverse unlabeled data has proven beneficial for semi-supervised medical image segmentation (SSMIS). While many works have successfully used various perturbation techniques, a deeper understanding of learning perturbations…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Zhenyan Yao , Miao Zhang , Lanhu Wu , Yongri Piao , Feng Tian , Weibing Sun , Huchuan Lu

Multimodal MRIs play a crucial role in clinical diagnosis and treatment. Feature disentanglement (FD)-based methods, aiming at learning superior feature representations for multimodal data analysis, have achieved significant success in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

Class imbalance in supervised classification often degrades model performance by biasing predictions toward the majority class, particularly in critical applications such as medical diagnosis and fraud detection. Traditional oversampling…

Machine Learning · Statistics 2025-09-16 Suman Cha , Hyunjoong Kim

Raman spectroscopy (RS) has been widely used for disease diagnosis, e.g., cardiovascular disease (CVD), owing to its efficiency and component-specific testing capabilities. A series of popular deep learning methods have recently been…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Bo Yu , Hechang Chen , Chengyou Jia , Hongren Zhou , Lele Cong , Xiankai Li , Jianhui Zhuang , Xianling Cong

Optical molecular tomographic imaging is to reconstruct the concentration distribution of photon-molecular probes in a small animal from measured photon fluence rates. The localization and quantification of molecular probes is related to…

Biological Physics · Physics 2017-07-18 Wenxiang Cong , Xavier Intes , Ge Wang

Popular rotated detection methods usually use five parameters (coordinates of the central point, width, height, and rotation angle) to describe the rotated bounding box and l1-loss as the loss function. In this paper, we argue that the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Wen Qian , Xue Yang , Silong Peng , Yue Guo , Junchi Yan

Multi-modal fusion of sensors is a commonly used approach to enhance the performance of odometry estimation, which is also a fundamental module for mobile robots. However, the question of \textit{how to perform fusion among different…

Robotics · Computer Science 2025-03-20 Leyuan Sun , Guanqun Ding , Yue Qiu , Yusuke Yoshiyasu , Fumio Kanehiro

As a long-term complication of diabetes, diabetic retinopathy (DR) progresses slowly, potentially taking years to threaten vision. An accurate and robust evaluation of its severity is vital to ensure prompt management and care. Ordinal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qinkai Yu , Wei Zhou , Hantao Liu , Yanyu Xu , Meng Wang , Yitian Zhao , Huazhu Fu , Xujiong Ye , Yalin Zheng , Yanda Meng

Purpose: To evaluate automated multicriteria optimization (MCO)-- designed for intensity modulated radiation therapy (IMRT), but invoked with limited segmentation -- to efficiently produce high quality 3D conformal treatment (3D-CRT) plans.…

Medical Physics · Physics 2014-02-03 Fazal Khan , David Craft

Retinopathy represents a group of retinal diseases that, if not treated timely, can cause severe visual impairments or even blindness. Many researchers have developed autonomous systems to recognize retinopathy via fundus and optical…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Taimur Hassan , Bilal Hassan , Muhammad Usman Akram , Shahrukh Hashmi , Abdel Hakim Taguri , Naoufel Werghi

Purpose: The integration of multimodal imaging into operating rooms paves the way for comprehensive surgical scene understanding. In ophthalmic surgery, by now, two complementary imaging modalities are available: operating microscope (OPMI)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Nikolo Rohrmoser , Ghazal Ghazaei , Michael Sommersperger , Nassir Navab

Multi-modality fusion and multi-task learning are becoming trendy in 3D autonomous driving scenario, considering robust prediction and computation budget. However, naively extending the existing framework to the domain of multi-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhijian Huang , Sihao Lin , Guiyu Liu , Mukun Luo , Chaoqiang Ye , Hang Xu , Xiaojun Chang , Xiaodan Liang

Alzheimer's disease (AD) is a common neurodegenerative disease among the elderly. Early prediction and timely intervention of its prodromal stage, mild cognitive impairment (MCI), can decrease the risk of advancing to AD. Combining…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Xiangyang Hu , Xiangyu Shen , Yifei Sun , Xuhao Shan , Wenwen Min , Liyilei Su , Xiaomao Fan , Ahmed Elazab , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan

Remarkable progress has been made in self-supervised monocular depth estimation (SS-MDE) by exploring cross-view consistency, e.g., photometric consistency and 3D point cloud consistency. However, they are very vulnerable to illumination…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haimei Zhao , Jing Zhang , Zhuo Chen , Bo Yuan , Dacheng Tao

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Searching for the $k$-nearest neighbors (KNN) in multimodal data retrieval is computationally expensive, particularly due to the inherent difficulty in comparing similarity measures across different modalities. Recent advances in multimodal…

Machine Learning · Computer Science 2025-08-25 Chengyu Gong , Gefei Shen , Luanzheng Guo , Nathan Tallent , Dongfang Zhao

Monocular Depth Estimation (MDE) is a fundamental computer vision task with important applications in 3D vision. The current mainstream MDE methods employ an encoder-decoder architecture with multi-level/scale feature processing. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Huibin Bai , Shuai Li , Hanxiao Zhai , Yanbo Gao , Chong Lv , Yibo Wang , Haipeng Ping , Wei Hua , Xingyu Gao

Multimodality eye disease screening is crucial in ophthalmology as it integrates information from diverse sources to complement their respective performances. However, the existing methods are weak in assessing the reliability of each…

Image and Video Processing · Electrical Eng. & Systems 2023-08-30 Ke Zou , Tian Lin , Xuedong Yuan , Haoyu Chen , Xiaojing Shen , Meng Wang , Huazhu Fu