English
Related papers

Related papers: Adversarial Lagrangian Integrated Contrastive Embe…

200 papers

In this work, we propose a novel adversarial defence mechanism for image classification - CARSO - blending the paradigms of adversarial training and adversarial purification in a synergistic robustness-enhancing way. The method builds upon…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Emanuele Ballarin , Alessio Ansuini , Luca Bortolussi

Learning by contrasting positive and negative samples is a general strategy adopted by many methods. Noise contrastive estimation (NCE) for word embeddings and translating embeddings for knowledge graphs are examples in NLP employing this…

Computation and Language · Computer Science 2018-08-06 Avishek Joey Bose , Huan Ling , Yanshuai Cao

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

Machine Learning · Computer Science 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Injecting adversarial examples during training, known as adversarial training, can improve robustness against one-step attacks, but not for unknown iterative attacks. To address this challenge, we first show iteratively generated…

Machine Learning · Statistics 2018-03-20 Taesik Na , Jong Hwan Ko , Saibal Mukhopadhyay

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Data augmentation is a major component of many machine learning methods with state-of-the-art performance. Common augmentation strategies work by drawing random samples from a space of transformations. Unfortunately, such sampling…

Machine Learning · Computer Science 2020-11-06 Calvin Luo , Hossein Mobahi , Samy Bengio

Adversarial contrastive learning (ACL) does not require expensive data annotations but outputs a robust representation that withstands adversarial attacks and also generalizes to a wide range of downstream tasks. However, ACL needs…

Machine Learning · Computer Science 2023-10-27 Xilie Xu , Jingfeng Zhang , Feng Liu , Masashi Sugiyama , Mohan Kankanhalli

Medical images acquired from standardized protocols show consistent macroscopic or microscopic anatomical structures, and these structures consist of composable/decomposable organs and tissues, but existing self-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Ziyu Zhou , Haozhe Luo , Mohammad Reza Hosseinzadeh Taher , Jiaxuan Pang , Xiaowei Ding , Michael Gotway , Jianming Liang

We introduce an approach that enhances images using a color filter in order to create adversarial effects, which fool neural networks into misclassification. Our approach, Adversarial Color Enhancement (ACE), generates unrestricted…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Zhengyu Zhao , Zhuoran Liu , Martha Larson

Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly…

Machine Learning · Computer Science 2023-12-19 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Spectral clustering is a popular tool in network data analysis, with applications in a variety of scientific application areas. However, many studies have shown that classical spectral clustering does not perform well on certain network…

Methodology · Statistics 2026-03-31 Sinyoung Park , Matthew Nunes , Sandipan Roy

Achieving backward compatibility when rolling out new models can highly reduce costs or even bypass feature re-encoding of existing gallery images for in-production visual retrieval systems. Previous related works usually leverage losses…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Qiang Meng , Chixiang Zhang , Xiaoqiang Xu , Feng Zhou

Magnetic Resonance Imaging (MRI) is one of the fields that the compressed sensing theory is well utilized to reduce the scan time significantly leading to faster imaging or higher resolution images. It has been shown that a small fraction…

Information Theory · Computer Science 2014-06-03 Cagdas Bilen , Yao Wang , Ivan Selesnick

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the…

Machine Learning · Computer Science 2024-02-07 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding. The proposed approach imposes alignment between the attention pattern of…

Computation and Language · Computer Science 2023-05-24 Tassilo Klein , Moin Nabi

Machine learning models are often trained on data from one distribution and deployed on others. So it becomes important to design models that are robust to distribution shifts. Most of the existing work focuses on optimizing for either…

Machine Learning · Computer Science 2021-03-31 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Robust statistical estimators offer resilience against outliers but are often computationally challenging, particularly in high-dimensional sparse settings. Modern optimization techniques are utilized for robust sparse association…

Computation · Statistics 2025-02-03 Pia Pfeiffer , Andreas Alfons , Peter Filzmoser

Adversarial attack algorithms are dominated by penalty methods, which are slow in practice, or more efficient distance-customized methods, which are heavily tailored to the properties of the distance considered. We propose a white-box…

Machine Learning · Computer Science 2021-08-20 Jérôme Rony , Eric Granger , Marco Pedersoli , Ismail Ben Ayed