English
Related papers

Related papers: Beyond cross-entropy: learning highly separable fe…

200 papers

The effectiveness of supervised learning techniques has made them ubiquitous in research and practice. In high-dimensional settings, supervised learning commonly relies on dimensionality reduction to improve performance and identify the…

Machine Learning · Computer Science 2016-08-11 Chang Liu , Bo Li , Yevgeniy Vorobeychik , Alina Oprea

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Generative Adversarial Networks (GAN) training process, in most cases, apply Uniform or Gaussian sampling methods in the latent space, which probably spends most of the computation on examples that can be properly handled and easy to…

Machine Learning · Computer Science 2022-12-19 Shiyu Yi , Donglin Zhan , Wenqing Zhang , Denglin Jiang , Kang An , Hao Wang

Generative learning, recognized for its effective modeling of data distributions, offers inherent advantages in handling out-of-distribution instances, especially for enhancing robustness to adversarial attacks. Among these, diffusion…

Machine Learning · Computer Science 2025-02-25 Huanran Chen , Yinpeng Dong , Shitong Shao , Zhongkai Hao , Xiao Yang , Hang Su , Jun Zhu

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

Machine Learning · Computer Science 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Classifiers trained solely on labeled source data may yield misleading results when applied to unlabeled target data drawn from a different distribution. Transfer learning can rectify this by transferring knowledge from source to target…

Statistics Theory · Mathematics 2025-02-19 Junjun Lang , Yukun Liu

Adversarial attacks present a critical challenge to deep neural networks' robustness, particularly in transfer scenarios across different model architectures. However, the transferability of adversarial attacks faces a fundamental dilemma…

Machine Learning · Computer Science 2025-11-04 Zenghao Niu , Weicheng Xie , Siyang Song , Zitong Yu , Feng Liu , Linlin Shen

Graph deep learning models, such as graph convolutional networks (GCN) achieve remarkable performance for tasks on graph data. Similar to other types of deep models, graph deep learning models often suffer from adversarial attacks. However,…

Machine Learning · Computer Science 2019-05-23 Huijun Wu , Chen Wang , Yuriy Tyshetskiy , Andrew Docherty , Kai Lu , Liming Zhu

The performance of deep segmentation models often degrades due to distribution shifts in image intensities between the training and test data sets. This is particularly pronounced in multi-centre studies involving data acquired using…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Zhendong Liu , Van Manh , Xin Yang , Xiaoqiong Huang , Karim Lekadir , Víctor Campello , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a…

Machine Learning · Computer Science 2019-02-28 Weihao Gao , Ashok Vardhan Makkuva , Sewoong Oh , Pramod Viswanath

While it has long been empirically observed that adversarial robustness may be at odds with standard accuracy and may have further disparate impacts on different classes, it remains an open question to what extent such observations hold and…

Machine Learning · Computer Science 2023-05-30 Yuzheng Hu , Fan Wu , Hongyang Zhang , Han Zhao

Labeling a training set is often expensive and susceptible to errors, making the design of robust loss functions for label noise an important problem. The symmetry condition provides theoretical guarantees for robustness to such noise. In…

Machine Learning · Computer Science 2026-05-21 Alexandre Lemire Paquin , Brahim Chaib-Draa , Philippe Giguère

Class-conditional generative models hold promise to overcome the shortcomings of their discriminative counterparts. They are a natural choice to solve discriminative tasks in a robust manner as they jointly optimize for predictive…

Machine Learning · Computer Science 2020-02-18 Ethan Fetaya , Jörn-Henrik Jacobsen , Will Grathwohl , Richard Zemel

Over the past years, Generative Adversarial Networks (GANs) have shown a remarkable generation performance especially in image synthesis. Unfortunately, they are also known for having an unstable training process and might loose parts of…

Machine Learning · Computer Science 2019-11-18 Teodora Pandeva , Matthias Schubert

Achieving robustness against adversarial input perturbation is an important and intriguing problem in machine learning. In the area of semantic image segmentation, a number of adversarial training approaches have been proposed as a defense…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Levente Halmosi , Mark Jelasity

Generative adversarial networks (GANs) are a framework that learns a generative distribution through adversarial training. Recently, their class-conditional extensions (e.g., conditional GAN (cGAN) and auxiliary classifier GAN (AC-GAN))…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Crafting adversarial examples has become an important technique to evaluate the robustness of deep neural networks (DNNs). However, most existing works focus on attacking the image classification problem since its input space is continuous…

Machine Learning · Computer Science 2020-04-22 Minhao Cheng , Jinfeng Yi , Pin-Yu Chen , Huan Zhang , Cho-Jui Hsieh

Intrusion Detection Systems (IDS) play a crucial role in network security defense. However, a significant challenge for IDS in training detection models is the shortage of adequately labeled malicious samples. To address these issues, this…

Cryptography and Security · Computer Science 2025-08-26 Haijian Ma , Daizong Liu , Xiaowen Cai , Pan Zhou , Yulai Xie

Several recent results provide theoretical insights into the phenomena of adversarial examples. Existing results, however, are often limited due to a gap between the simplicity of the models studied and the complexity of those deployed in…

Machine Learning · Computer Science 2021-01-05 Jeremias Sulam , Ramchandran Muthukumar , Raman Arora