English
Related papers

Related papers: Self-Supervised Modality-Agnostic Pre-Training of …

200 papers

State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Junnan Li , Silvio Savarese , Steven C. H. Hoi

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

In this paper, we propose S3T, a self-supervised pre-training method with Swin Transformer for music classification, aiming to learn meaningful music representations from massive easily accessible unlabeled music data. S3T introduces a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Hang Zhao , Chen Zhang , Belei Zhu , Zejun Ma , Kejun Zhang

Fusion-based hyperspectral image super-resolution aims to fuse low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) to reconstruct high spatial and high spectral resolution images. Current methods…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Songcheng Du , Yang Zou , Zixu Wang , Xingyuan Li , Ying Li , Changjing Shang , Qiang Shen

Domain shift has always been one of the primary issues in video object segmentation (VOS), for which models suffer from degeneration when tested on unfamiliar datasets. Recently, many online methods have emerged to narrow the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jinshuo Zhang , Zhicheng Wang , Songyan Zhang , Gang Wei

Enhancing forward-looking sonar images is critical for accurate underwater target detection. Current deep learning methods mainly rely on supervised training with simulated data, but the difficulty in obtaining high-quality real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Zhisheng Zhang , Peng Zhang , Fengxiang Wang , Liangli Ma , Fuchun Sun

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Combining the respective advantages of cross-modality images can compensate for the lack of information in the single modality, which has attracted increasing attention of researchers into multi-modal image matching tasks. Meanwhile, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shasha Mei

The accuracy and robustness of image classification with supervised deep learning are dependent on the availability of large-scale, annotated training data. However, there is a paucity of annotated data available due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Recent advancements in adapting vision-language pre-training models like CLIP for person re-identification (ReID) tasks often rely on complex adapter design or modality-specific tuning while neglecting cross-modal interaction, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yunfei Xie , Yuxuan Cheng , Juncheng Wu , Haoyu Zhang , Yuyin Zhou , Shoudong Han

Unsupervised domain adaptation (UDA) enables models trained on a labeled source domain to handle new unlabeled domains. Recently, pre-trained vision-language models (VLMs) have demonstrated promising zero-shot performance by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Xinyao Li , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

Diffusion models have shown remarkable capacity in image synthesis based on their U-shaped architecture and convolutional neural networks (CNN) as basic blocks. The locality of the convolution operation in CNN may limit the model's ability…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Shaohua Wu , Tong Yu , Shenling Wang , Xudong Zhao

Recent advances in unsupervised domain adaptation (UDA) show that transferable prototypical learning presents a powerful means for class conditional alignment, which encourages the closeness of cross-domain class centroids. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Xiaofeng Liu , Xiongchang Liu , Bo Hu , Wenxuan Ji , Fangxu Xing , Jun Lu , Jane You , C. -C. Jay Kuo , Georges El Fakhri , Jonghye Woo

Inter-modal interaction plays an indispensable role in multimodal sentiment analysis. Due to different modalities sequences are usually non-alignment, how to integrate relevant information of each modality to learn fusion representations…

Computation and Language · Computer Science 2022-12-23 Kaicheng Yang , Ruxuan Zhang , Hua Xu , Kai Gao

Models capable of leveraging unlabelled data are crucial in overcoming large distribution gaps between the acquired datasets across different imaging devices and configurations. In this regard, self-training techniques based on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Negin Ghamsarian , Javier Gamazo Tejero , Pablo Márquez Neila , Sebastian Wolf , Martin Zinkernagel , Klaus Schoeffmann , Raphael Sznitman

We propose the first unsupervised and learning-based method to identify interpretable directions in h-space of pre-trained diffusion models. Our method is derived from an existing technique that operates on the GAN latent space.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zijian Zhang , Luping Liu , Zhijie Lin , Yichen Zhu , Zhou Zhao

Predicting drug response in patients from preclinical data remains a major challenge in precision oncology due to the substantial biological gap between in vitro cell lines and patient tumors. Rather than aiming to improve absolute in vitro…

Machine Learning · Computer Science 2026-03-18 Camille Jimenez Cortes , Philippe Lalanda , German Vega