English
Related papers

Related papers: Learning Collaborative Knowledge with Multimodal R…

200 papers

Magnetic resonance imaging (MRI) tasks often involve multiple contrasts. Recently, numerous deep learning-based multi-contrast MRI super-resolution (SR) and reconstruction methods have been proposed to explore the complementary information…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Pengcheng Lei , Faming Fang , Guixu Zhang , Ming Xu

Cloth-Changing Person Re-Identification (CC-ReID) is a common and realistic problem since fashion constantly changes over time and people's aesthetic preferences are not set in stone. While most existing cloth-changing ReID methods focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yubin Wang , Huimin Yu , Yuming Yan , Shuyi Song , Biyang Liu , Yichong Lu

In this study, toward addressing the over-confident outputs of existing artificial intelligence-based colorectal cancer (CRC) polyp classification techniques, we propose a confidence-calibrated residual neural network. Utilizing a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Siddhartha Kapuria , Tarunraj G. Mohanraj , Nethra Venkatayogi , Ozdemir Can Kara , Yuki Hirata , Patrick Minot , Ariel Kapusta , Naruhiko Ikoma , Farshid Alambeigi

The gap in representations between image and video makes Image-to-Video Re-identification (I2V Re-ID) challenging, and recent works formulate this problem as a knowledge distillation (KD) process. In this paper, we propose a mutual…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Pichao Wang , Fan Wang , Hao Li

In complex orchard environments, the phenotypic heterogeneity of different apple leaf diseases, characterized by significant variation among lesions, poses a challenge to traditional multi-scale feature fusion methods. These methods only…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lemin Liu , Fangchao Hu , Honghua Jiang , Yaru Chen , Limin Liu , Yongliang Qiao

Besides the complex nature of colonoscopy frames with intrinsic frame formation artefacts such as light reflections and the diversity of polyp types/shapes, the publicly available polyp segmentation training datasets are limited, small and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yan Wen , Lei Zhang , Xiangli Meng , Xujiong Ye

Automated colonoscopy reporting holds great potential for enhancing quality control and improving cost-effectiveness of colonoscopy procedures. A major challenge lies in the automated identification, tracking, and re-association (ReID) of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Luca Parolari , Andrea Cherubini , Lamberto Ballan , Carlo Biffi

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could…

Continual learning (CL) refers to the ability of an algorithm to continuously and incrementally acquire new knowledge from its environment while retaining previously learned information. A model trained on one data modality often fails when…

Machine Learning · Computer Science 2025-08-22 Nilay Kushawaha , Egidio Falotico

The precise subtype classification of myeloproliferative neoplasms (MPNs) based on multimodal information, which assists clinicians in diagnosis and long-term treatment plans, is of great clinical significance. However, it remains a great…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Yuan Zhang , Yaolei Qi , Xiaoming Qi , Yongyue Wei , Guanyu Yang

We present Distill CLIP (DCLIP), a fine-tuned variant of the CLIP model that enhances multimodal image-text retrieval while preserving the original model's strong zero-shot classification capabilities. CLIP models are typically constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniel Csizmadia , Andrei Codreanu , Victor Sim , Vighnesh Prabhu , Michael Lu , Kevin Zhu , Sean O'Brien , Vasu Sharma

Early and accurate segmentation of colorectal polyps is critical for reducing colorectal cancer mortality, which has been extensively explored by academia and industry. However, current deep learning-based polyp segmentation models either…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ziyi Wang , Yuanmei Zhang , Dorna Esrafilzadeh , Ali R. Jalili , Suncheng Xiang

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

With the explosion of digital data in recent years, continuously learning new tasks from a stream of data without forgetting previously acquired knowledge has become increasingly important. In this paper, we propose a new continual learning…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Shixiang Tang , Dapeng Chen , Hakan Bilen , Rui Zhao

Early detection of colorectal polyps is of utmost importance for their treatment and for colorectal cancer prevention. Computer vision techniques have the potential to aid professionals in the diagnosis stage, where colonoscopies are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Enric Moreu , Eric Arazo , Kevin McGuinness , Noel E. O'Connor

Medical image segmentation is the technique that helps doctor view and has a precise diagnosis, particularly in Colorectal Cancer. Specifically, with the increase in cases, the diagnosis and identification need to be faster and more…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Trong-Hieu Nguyen Mau , Quoc-Huy Trinh , Nhat-Tan Bui , Minh-Triet Tran , Hai-Dang Nguyen

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

We propose a unified representation learning framework to address the Cross Model Compatibility (CMC) problem in the context of visual search applications. Cross compatibility between different embedding models enables the visual search…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Chien-Yi Wang , Ya-Liang Chang , Shang-Ta Yang , Dong Chen , Shang-Hong Lai

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma

To cope with the growing prevalence of colorectal cancer (CRC), screening programs for polyp detection and removal have proven their usefulness. Colonoscopy is considered the best-performing procedure for CRC screening. To ease the…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Mathias Ramm Haugland , Hemin Ali Qadir , Ilangko Balasingham