English
Related papers

Related papers: VICReg: Variance-Invariance-Covariance Regularizat…

200 papers

Visual representations of data (visualizations) are tools of great importance and widespread use in data analytics as they provide users visual insight to patterns in the observed data in a simple and effective way. However, since…

Databases · Computer Science 2018-11-05 Lorenzo De Stefani , Leonhard F. Spiegelberg , Tim Kraska , Eli Upfal

In this paper, we propose to investigate the problem of out-of-domain visio-linguistic pretraining, where the pretraining data distribution differs from that of downstream data on which the pretrained model will be fine-tuned. Existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Shengyu Zhang , Tan Jiang , Tan Wang , Kun Kuang , Zhou Zhao , Jianke Zhu , Jin Yu , Hongxia Yang , Fei Wu

Self-supervised representation learning is central to modern machine learning because it extracts structured latent features from unlabeled data and enables robust transfer across tasks and domains. However, it can suffer from…

Disordered Systems and Neural Networks · Physics 2026-04-14 Louie Hong Yao , Yuhao Li , Shengchao Liu

The latest video coding standard, called versatile video coding (VVC), includes several novel and refined coding tools at different levels of the coding chain. These tools bring significant coding gains with respect to the previous…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Charles Bonnineau , Wassim Hamidouche , Jean-Francois Travers , Naty Sidaty , Olivier Deforges

Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling. Mode collapse, i.e., the model producing identical representations for all inputs, is…

Machine Learning · Computer Science 2022-09-19 Serdar Ozsoy , Shadi Hamdan , Sercan Ö. Arik , Deniz Yuret , Alper T. Erdogan

Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (CAM). However, CAMs can hardly serve as the object mask due…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yude Wang , Jie Zhang , Meina Kan , Shiguang Shan , Xilin Chen

Recent work has managed to learn cross-lingual word embeddings without parallel data by mapping monolingual embeddings to a shared space through adversarial training. However, their evaluation has focused on favorable conditions, using…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Cross-view geo-localization aims to spot images of the same location shot from two platforms, e.g., the drone platform and the satellite platform. Existing methods usually focus on optimizing the distance between one embedding with others…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Tingyu Wang , Zhedong Zheng , Zunjie Zhu , Yuhan Gao , Yi Yang , Chenggang Yan

The rapid advancement of vision-language models (VLMs) has established a new paradigm in video anomaly detection (VAD): leveraging VLMs to simultaneously detect anomalies and provide comprehendible explanations for the decisions. Existing…

Artificial Intelligence · Computer Science 2025-04-02 Muchao Ye , Weiyang Liu , Pan He

Recent advances in implicit neural representation (INR)-based video coding have demonstrated its potential to compete with both conventional and other learning-based approaches. With INR methods, a neural network is trained to overfit a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ho Man Kwan , Ge Gao , Fan Zhang , Andrew Gower , David Bull

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

In this paper, we examine self-supervised learning methods, particularly VICReg, to provide an information-theoretical understanding of their construction. As a first step, we demonstrate how information-theoretic quantities can be obtained…

Machine Learning · Computer Science 2022-07-22 Ravid Shwartz-Ziv , Randall Balestriero , Yann LeCun

Mutual information-based reinforcement learning (RL) has been proposed as a promising framework for retrieving complex skills autonomously without a task-oriented reward function through mutual information (MI) maximization or variational…

Machine Learning · Computer Science 2023-10-31 Seongun Kim , Kyowoon Lee , Jaesik Choi

3D object representation learning is a fundamental challenge in computer vision to infer about the 3D world. Recent advances in deep learning have shown their efficiency in 3D object recognition, among which view-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Xiang Gao , Wei Hu , Guo-Jun Qi

Contrastive learning applied to self-supervised representation learning has seen a resurgence in deep models. In this paper, we find that existing contrastive learning based solutions for self-supervised video recognition focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Lin Zhang , Qi She , Zhengyang Shen , Changhu Wang

The Vision Transformer architecture has shown to be competitive in the computer vision (CV) space where it has dethroned convolution-based networks in several benchmarks. Nevertheless, convolutional neural networks (CNN) remain the…

Machine Learning · Computer Science 2023-07-20 Manuel Goulão , Arlindo L. Oliveira

Convolution neural networks have achieved remarkable performance in many tasks of computing vision. However, CNN tends to bias to low frequency components. They prioritize capturing low frequency patterns which lead them fail when suffering…

Machine Learning · Computer Science 2020-07-08 Weiyu Guo , Yidong Ouyang

Self-supervised learning methods for computer vision have demonstrated the effectiveness of pre-training feature representations, resulting in well-generalizing Deep Neural Networks, even if the annotated data are limited. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Dmitrii Shubin , Danny Eytan , Sebastian D. Goodfellow

A prominent approach to visual Reinforcement Learning (RL) is to learn an internal state representation using self-supervised methods, which has the potential benefit of improved sample-efficiency and generalization through additional…

Machine Learning · Computer Science 2023-03-16 Yanjie Ze , Nicklas Hansen , Yinbo Chen , Mohit Jain , Xiaolong Wang
‹ Prev 1 4 5 6 7 8 10 Next ›