English
Related papers

Related papers: Adversarial Training with Complementary Labels: On…

200 papers

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Deep Active Learning (DAL) aims to reduce labeling costs in neural-network training by prioritizing the most informative unlabeled samples for annotation. Beyond selecting which samples to label, several DAL approaches further enhance data…

Machine Learning · Computer Science 2025-12-17 Jonathan Spiegelman , Guy Amir , Guy Katz

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Despite extensive diagnostics and debugging by developers, AI systems sometimes exhibit harmful unintended behaviors. Finding and fixing these is challenging because the attack surface is so large -- it is not tractable to exhaustively…

Cryptography and Security · Computer Science 2025-07-30 Stephen Casper , Lennart Schulze , Oam Patel , Dylan Hadfield-Menell

In cross-lingual text classification, one seeks to exploit labeled data from one language to train a text classification model that can then be applied to a completely different language. Recent multilingual representation models have made…

Computation and Language · Computer Science 2020-07-31 Xin Dong , Yaxin Zhu , Yupeng Zhang , Zuohui Fu , Dongkuan Xu , Sen Yang , Gerard de Melo

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and model interpretability. Adversarial training (AT) for attention…

Computation and Language · Computer Science 2022-12-27 Shunsuke Kitada , Hitoshi Iyatomi

In this paper we proposed a novel Adversarial Training (AT) approach for end-to-end speech recognition using a Criticizing Language Model (CLM). In this way the CLM and the automatic speech recognition (ASR) model can challenge and learn…

Computation and Language · Computer Science 2018-11-05 Alexander H. Liu , Hung-yi Lee , Lin-shan Lee

We study the problem of knowledge tracing (KT) where the goal is to trace the students' knowledge mastery over time so as to make predictions on their future performance. Owing to the good representation capacity of deep neural networks…

Computers and Society · Computer Science 2021-08-11 Xiaopeng Guo , Zhijie Huang , Jie Gao , Mingyu Shang , Maojing Shu , Jun Sun

Adversarial robustness is a research area that has recently received a lot of attention in the quest for trustworthy artificial intelligence. However, recent works on adversarial robustness have focused on supervised learning where it is…

Machine Learning · Computer Science 2023-08-09 Dongyoon Yang , Insung Kong , Yongdai Kim

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer

Despite recent efforts in Large Language Model (LLM) safety and alignment, current adversarial attacks on frontier LLMs can still consistently force harmful generations. Although adversarial training has been widely studied and shown to…

Machine Learning · Computer Science 2025-10-29 Csaba Dékány , Stefan Balauca , Robin Staab , Dimitar I. Dimitrov , Martin Vechev

Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size…

Machine Learning · Computer Science 2024-05-24 Shayan Mohajer Hamidi , Linfeng Ye

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

In this paper, we investigate the challenges of complementary-label learning (CLL), a specialized form of weakly-supervised learning (WSL) where models are trained with labels indicating classes to which instances do not belong, rather than…

Machine Learning · Computer Science 2026-02-03 Tan-Ha Mai , Hsuan-Tien Lin

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang

The high cost of data labeling often results in node label shortage in real applications. To improve node classification accuracy, graph-based semi-supervised learning leverages the ample unlabeled nodes to train together with the scarce…

Machine Learning · Computer Science 2023-03-14 Jiaren Xiao , Quanyu Dai , Xiaochen Xie , James Lam , Ka-Wai Kwok

We consider the task of training classifiers without labels. We propose a weakly supervised method---adversarial label learning---that trains classifiers to perform well against an adversary that chooses labels for training data. The weak…

Machine Learning · Computer Science 2019-01-31 Chidubem Arachie , Bert Huang

Large language models (LLMs) remain vulnerable to adversarial prompting despite advances in alignment and safety, often exhibiting harmful behaviors under novel attack strategies. While adversarial training can improve robustness, existing…

Machine Learning · Computer Science 2026-05-08 Yiwei Zhang , Jeremiah Birrell , Reza Ebrahimi , Rouzbeh Behnia , Jason Pacheco , Elisa Bertino

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Object detectors encounter challenges in handling domain shifts. Cutting-edge domain adaptive object detection methods use the teacher-student framework and domain adversarial learning to generate domain-invariant pseudo-labels for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Kaiwen Wang , Yinzhe Shen , Martin Lauer