English
Related papers

Related papers: Collaborative Learning for Unsupervised Multimodal…

200 papers

Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involving natural images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Zekai Chen , Devansh Agarwal , Kshitij Aggarwal , Wiem Safta , Samit Hirawat , Venkat Sethuraman , Mariann Micsinai Balan , Kevin Brown

Medical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring…

Image and Video Processing · Electrical Eng. & Systems 2022-08-29 Yichi Zhang , Rushi Jiao , Qingcheng Liao , Dongyang Li , Jicong Zhang

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

We present a diffeomorphic image registration algorithm to learn spatial transformations between pairs of images to be registered using fully convolutional networks (FCNs) under a self-supervised learning setting. The network is trained to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hongming Li , Yong Fan

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Linxuan Han , Sa Xiao , Zimeng Li , Haidong Li , Xiuchao Zhao , Yeqing Han , Fumin Guo , Xin Zhou

Conventional deformable registration methods aim at solving an optimization model carefully designed on image pairs and their computational costs are exceptionally high. In contrast, recent deep learning based approaches can provide fast…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Risheng Liu , Zi Li , Xin Fan , Chenying Zhao , Hao Huang , Zhongxuan Luo

We address the unsupervised learning of several interconnected problems in low-level vision: single view depth prediction, camera motion estimation, optical flow, and segmentation of a video into the static scene and moving regions. Our key…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Anurag Ranjan , Varun Jampani , Lukas Balles , Kihwan Kim , Deqing Sun , Jonas Wulff , Michael J. Black

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Self-supervised cross-modal super-resolution (SR) can overcome the difficulty of acquiring paired training data, but is challenging because only low-resolution (LR) source and high-resolution (HR) guide images from different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Xiaoyu Dong , Naoto Yokoya , Longguang Wang , Tatsumi Uezato

The success of deep learning methods in medical image segmentation tasks usually requires a large amount of labeled data. However, obtaining reliable annotations is expensive and time-consuming. Semi-supervised learning has attracted much…

Image and Video Processing · Electrical Eng. & Systems 2021-07-13 Yichi Zhang , Jicong Zhang

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

Contrastive learning has recently shown immense potential in unsupervised visual representation learning. Existing studies in this track mainly focus on intra-image invariance learning. The learning typically uses rich intra-image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Jiahao Xie , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

With the development of deep learning, medical image classification has been significantly improved. However, deep learning requires massive data with labels. While labeling the samples by human experts is expensive and time-consuming,…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Jiarun Liu , Ruirui Li , Chuan Sun

Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Bob D. de Vos , Floris F. Berendsen , Max A. Viergever , Hessam Sokooti , Marius Staring , Ivana Isgum

Unsupervised visible-infrared person re-identification (USL-VI-ReID) seeks to match pedestrian images of the same individual across different modalities without human annotations for model learning. Previous methods unify pseudo-labels of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 De Cheng , Lingfeng He , Nannan Wang , Dingwen Zhang , Xinbo Gao

Semi-supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel-wise annotated data for semantic segmentation tasks. Existing semi-supervised approaches enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xu Zheng , Chong Fu , Haoyu Xie , Jialei Chen , Xingwei Wang , Chiu-Wing Sham

Semi-supervised learning has gained considerable popularity in medical image segmentation tasks due to its capability to reduce reliance on expert-examined annotations. Several mean-teacher (MT) based semi-supervised methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Xiao-Jun Wu

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

In recent years, unsupervised learning for deformable image registration has been a major research focus. This approach involves training a registration network using pairs of moving and fixed images, along with a loss function that…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Xiaojian Chen , Yihao Liu , Shuwen Wei , Aaron Carass , Yong Du , Junyu Chen