中文
相关论文

相关论文: Constructive Assimilation: Boosting Contrastive Le…

200 篇论文

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

机器学习 · 计算机科学 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

多媒体 · 计算机科学 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Correctly capturing the symmetry transformations of data can lead to efficient models with strong generalization capabilities, though methods incorporating symmetries often require prior knowledge. While recent advancements have been made…

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Self-training and contrastive learning have emerged as leading techniques for incorporating unlabeled data, both under distribution shift (unsupervised domain adaptation) and when it is absent (semi-supervised learning). However, despite…

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

机器学习 · 计算机科学 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

In this age of information, images are a critical medium for storing and transmitting information. With the rapid growth of image data amount, visual compression and visual data perception are two important research topics attracting a lot…

图像与视频处理 · 电气工程与系统科学 2024-07-02 Yuefeng Zhang , Chuanmin Jia , Jiannhui Chang , Siwei Ma

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

机器学习 · 计算机科学 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

This paper proposes a scalable and straightforward pre-training paradigm for efficient visual conceptual representation called occluded image contrastive learning (OCL). Our OCL approach is simple: we randomly mask patches to generate…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Xiaoyu Yang , Lijian Xu , Hongsheng Li , Shaoting Zhang

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Swami Sankaranarayanan , Yogesh Balaji , Arpit Jain , Ser Nam Lim , Rama Chellappa

Contrastive learning (CL) aims to learn useful representation without relying on expert annotations in the context of medical image segmentation. Existing approaches mainly contrast a single positive vector (i.e., an augmentation of the…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Chenyu You , Ruihan Zhao , Lawrence Staib , James S. Duncan

In this work, we present an interesting attempt on mixture generation: absorbing different image concepts (e.g., content and style) from different domains and thus generating a new domain with learned concepts. In particular, we propose a…

机器学习 · 计算机科学 2018-07-05 Guang-Yuan Hao , Hong-Xing Yu , Wei-Shi Zheng

Image-text contrastive models like CLIP have wide applications in zero-shot classification, image-text retrieval, and transfer learning. However, they often struggle on compositional visio-linguistic tasks (e.g., attribute-binding or…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Samyadeep Basu , Shell Xu Hu , Maziar Sanjabi , Daniela Massiceti , Soheil Feizi

Vision-Language Models (VLMs), such as CLIP, exhibit strong image-text comprehension abilities, facilitating advances in several downstream tasks such as zero-shot image classification, image-text retrieval, and text-to-image generation.…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Le Zhang , Rabiul Awal , Aishwarya Agrawal

Current text conditioned image generation methods output realistic looking images, but they fail to capture specific styles. Simply finetuning them on the target style datasets still struggles to grasp the style features. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Serkan Ozturk , Samet Hicsonmez , Pinar Duygulu

Generative retrieval constitutes an innovative approach in information retrieval, leveraging generative language models (LM) to generate a ranked list of document identifiers (docid) for a given query. It simplifies the retrieval pipeline…

信息检索 · 计算机科学 2025-02-13 Penghao Lu , Xin Dong , Yuansheng Zhou , Lei Cheng , Chuan Yuan , Linjian Mo