中文
相关论文

相关论文: The Geometry of Adversarial Training in Binary Cla…

200 篇论文

Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The…

图像与视频处理 · 电气工程与系统科学 2022-06-22 Margaret Duff , Neill D. F. Campbell , Matthias J. Ehrhardt

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

统计理论 · 数学 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulnerable to adversarial examples, much like Convolutional Neural Networks (CNNs). A common…

机器学习 · 计算机科学 2026-04-22 Jiaming Zhang , Meng Ding , Shaopeng Fu , Jingfeng Zhang , Di Wang

Classifiers such as deep neural networks have been shown to be vulnerable against adversarial perturbations on problems with high-dimensional input space. While adversarial training improves the robustness of image classifiers against such…

计算机视觉与模式识别 · 计算机科学 2019-08-14 Chaithanya Kumar Mummadi , Thomas Brox , Jan Hendrik Metzen

Adversarial training is the most effective defense against adversarial attacks. The effectiveness of the adversarial attacks has been on the design of its loss function and regularization term. The most widely used loss function in…

机器学习 · 计算机科学 2025-10-08 Zhenyu Liu , Varun Ojha

Recent work has shown that the training of a one-hidden-layer, scalar-output fully-connected ReLU neural network can be reformulated as a finite-dimensional convex program. Unfortunately, the scale of such a convex program grows…

机器学习 · 计算机科学 2021-05-27 Yatong Bai , Tanmay Gautam , Yu Gai , Somayeh Sojoudi

Neural network training is usually accomplished by solving a non-convex optimization problem using stochastic gradient descent. Although one optimizes over the networks parameters, the main loss function generally only depends on the…

机器学习 · 计算机科学 2023-02-10 Julius Berner , Dennis Elbrächter , Philipp Grohs

We develop a weak adversarial approach to solving obstacle problems using neural networks. By employing (generalised) regularised gap functions and their properties we rewrite the obstacle problem (which is an elliptic variational…

最优化与控制 · 数学 2024-11-28 Amal Alphonse , Michael Hintermüller , Alexander Kister , Chin Hang Lun , Clemens Sirotenko

Adversarial examples are inputs to machine learning models designed to cause the model to make a mistake. They are useful for understanding the shortcomings of machine learning models, interpreting their results, and for regularisation. In…

机器学习 · 计算机科学 2018-08-28 Pasquale Minervini , Sebastian Riedel

We use convex relaxation techniques to provide a sequence of solutions to the matrix completion problem. Using the nuclear norm as a regularizer, we provide simple and very efficient algorithms for minimizing the reconstruction error…

机器学习 · 统计学 2009-06-12 Rahul Mazumder , Trevor Hastie , Rob Tibshirani

Adversarial robustness has become a topic of growing interest in machine learning since it was observed that neural networks tend to be brittle. We propose an information-geometric formulation of adversarial defense and introduce FIRE, a…

机器学习 · 计算机科学 2022-06-15 Marine Picot , Francisco Messina , Malik Boudiaf , Fabrice Labeau , Ismail Ben Ayed , Pablo Piantanida

Low-rank matrix recovery is a fundamental problem in signal processing and machine learning. A recent very popular approach to recovering a low-rank matrix X is to factorize it as a product of two smaller matrices, i.e., X = UV^T, and then…

最优化与控制 · 数学 2023-07-19 Shuang Li , Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

机器学习 · 计算机科学 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

In order to tackle the difficulty associated with the ill-posed nature of the image registration problem, regularization is often used to constrain the solution space. For most learning-based registration approaches, the regularization…

计算机视觉与模式识别 · 计算机科学 2022-03-03 Zhe Xu , Jie Luo , Donghuan Lu , Jiangpeng Yan , Sarah Frisken , Jayender Jagadeesan , William Wells , Xiu Li , Yefeng Zheng , Raymond Tong

Recent studies on the adversarial vulnerability of neural networks have shown that models trained to be more robust to adversarial attacks exhibit more interpretable saliency maps than their non-robust counterparts. We aim to quantify this…

机器学习 · 统计学 2019-05-13 Christian Etmann , Sebastian Lunz , Peter Maass , Carola-Bibiane Schönlieb

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

机器学习 · 计算机科学 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

The robustness of neural networks is challenged by adversarial examples that contain almost imperceptible perturbations to inputs, which mislead a classifier to incorrect outputs in high confidence. Limited by the extreme difficulty in…

机器学习 · 计算机科学 2020-10-20 Honglin Li , Yifei Fan , Frieder Ganz , Anthony Yezzi , Payam Barnaghi

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

最优化与控制 · 数学 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

最优化与控制 · 数学 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

Adversarial training is extensively utilized to improve the adversarial robustness of deep neural networks. Yet, mitigating the degradation of standard generalization performance in adversarial-trained models remains an open problem. This…

机器学习 · 计算机科学 2024-03-27 Xiangyu Yin , Wenjie Ruan