中文
相关论文

相关论文: Perfectly Balanced: Improving Transfer and Robustn…

200 篇论文

Machine learning models are prone to capturing the spurious correlations between non-causal attributes and classes, with counterfactual data augmentation being a promising direction for breaking these spurious associations. However,…

机器学习 · 计算机科学 2025-07-11 Xiaoling Zhou , Ou Wu , Michael K. Ng

Learning Invariant Representations has been successfully applied for reconciling a source and a target domain for Unsupervised Domain Adaptation. By investigating the robustness of such methods under the prism of the cluster assumption, we…

机器学习 · 计算机科学 2020-07-01 Yassine Ouali , Victor Bouvier , Myriam Tami , Céline Hudelot

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Complex data mining has wide application value in many fields, especially in the feature extraction and classification tasks of unlabeled data. This paper proposes an algorithm based on self-supervised learning and verifies its…

机器学习 · 计算机科学 2025-04-08 Yingbin Liang , Lu Dai , Shuo Shi , Minghao Dai , Junliang Du , Haige Wang

Several prior studies have suggested that word frequency biases can cause the Bert model to learn indistinguishable sentence embeddings. Contrastive learning schemes such as SimCSE and ConSERT have already been adopted successfully in…

计算与语言 · 计算机科学 2023-09-15 Pu Miao , Zeyao Du , Junlin Zhang

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Visual counterfactual explanations are ideal hypothetical images that change the decision-making of the classifier with high confidence toward the desired class while remaining visually plausible and close to the initial image. In this…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Tung Luu , Nam Le , Duc Le , Bac Le

Data augmentation is a crucial component in unsupervised contrastive learning (CL). It determines how positive samples are defined and, ultimately, the quality of the learned representation. In this work, we open the door to new…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Benoit Dufumier , Carlo Alberto Barbano , Robin Louiset , Edouard Duchesnay , Pietro Gori

Unsupervised learning of keypoints and landmarks has seen significant progress with the help of modern neural network architectures, but performance is yet to match the supervised counterpart, making their practicability questionable. We…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Eric Hedlin , Gopal Sharma , Shweta Mahajan , Xingzhe He , Hossam Isack , Abhishek Kar Helge Rhodin , Andrea Tagliasacchi , Kwang Moo Yi

Contrastive learning between different views of the data achieves outstanding success in the field of self-supervised representation learning and the learned representations are useful in broad downstream tasks. Since all supervision…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Haoqing Wang , Xun Guo , Zhi-Hong Deng , Yan Lu

As an effective data augmentation method, Mixup synthesizes an extra amount of samples through linear interpolations. Despite its theoretical dependency on data properties, Mixup reportedly performs well as a regularizer and calibrator…

机器学习 · 计算机科学 2023-11-01 Aiyang Han , Chuanxing Geng , Songcan Chen

Supervised learning can improve the design of state-of-the-art solvers for combinatorial problems, but labelling large numbers of combinatorial instances is often impractical due to exponential worst-case complexity. Inspired by the recent…

机器学习 · 计算机科学 2022-06-22 Haonan Duan , Pashootan Vaezipoor , Max B. Paulus , Yangjun Ruan , Chris J. Maddison

Most of previous deepfake detection researches bent their efforts to describe and discriminate artifacts in human perceptible ways, which leave a bias in the learned networks of ignoring some critical invariance features intra-class and…

计算机视觉与模式识别 · 计算机科学 2022-05-17 Ruiqi Zha , Zhichao Lian , Qianmu Li , Siqi Gu

As the field of representation learning grows, there has been a proliferation of different loss functions to solve different classes of problems. We introduce a single information-theoretic equation that generalizes a large collection of…

机器学习 · 计算机科学 2025-04-24 Shaden Alshammari , John Hershey , Axel Feldmann , William T. Freeman , Mark Hamilton

Spurious correlation caused by subgroup underrepresentation has received increasing attention as a source of bias that can be perpetuated by deep neural networks (DNNs). Distributionally robust optimization has shown success in addressing…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Nilesh Kumar , Ruby Shrestha , Zhiyuan Li , Linwei Wang

Learning fair representation is crucial for achieving fairness or debiasing sensitive information. Most existing works rely on adversarial representation learning to inject some invariance into representation. However, adversarial learning…

机器学习 · 计算机科学 2022-06-20 Changdae Oh , Heeji Won , Junhyuk So , Taero Kim , Yewon Kim , Hosik Choi , Kyungwoo Song

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

音频与语音处理 · 电气工程与系统科学 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

机器学习 · 计算机科学 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler