English
Related papers

Related papers: Adversarial Barrier in Uniform Class Separation

200 papers

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

Machine Learning · Computer Science 2023-06-14 Omar Montasser

This article re-examines Lawvere's abstract, category-theoretic proof of the fixed-point theorem whose contrapositive is a `universal' diagonal argument. The main result is that the necessary axioms for both the fixed-point theorem and the…

Category Theory · Mathematics 2024-08-07 David Michael Roberts

In the course of classifying the homogeneous permutations, Cameron introduced the viewpoint of permutations as structures in a language of two linear orders, and this structural viewpoint is taken up here. The majority of this thesis is…

Logic · Mathematics 2018-05-14 Samuel Braunfeld

Recent works on adversarial perturbations show that there is an inherent trade-off between standard test accuracy and adversarial accuracy. Specifically, they show that no classifier can simultaneously be robust to adversarial perturbations…

Machine Learning · Statistics 2019-03-26 Arun Sai Suggala , Adarsh Prasad , Vaishnavh Nagarajan , Pradeep Ravikumar

We study the problem of learning predictors that are robust to adversarial examples with respect to an unknown perturbation set, relying instead on interaction with an adversarial attacker or access to attack oracles, examining different…

Machine Learning · Computer Science 2021-02-04 Omar Montasser , Steve Hanneke , Nathan Srebro

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

A wide range of defenses have been proposed to harden neural networks against adversarial attacks. However, a pattern has emerged in which the majority of adversarial defenses are quickly broken by new attacks. Given the lack of success at…

Machine Learning · Computer Science 2020-02-05 Ali Shafahi , W. Ronny Huang , Christoph Studer , Soheil Feizi , Tom Goldstein

Collective learning methods exploit relations among data points to enhance classification performance. However, such relations, represented as edges in the underlying graphical model, expose an extra attack surface to the adversaries. We…

Machine Learning · Computer Science 2020-07-28 Kai Zhou , Yevgeniy Vorobeychik

The susceptibility of modern machine learning classifiers to adversarial examples has motivated theoretical results suggesting that these might be unavoidable. However, these results can be too general to be applicable to natural data…

Machine Learning · Computer Science 2024-05-28 Ambar Pal , Jeremias Sulam , René Vidal

Diagonalization in the spirit of Cantor's diagonal arguments is a widely used tool in theoretical computer sciences to obtain structural results about computational problems and complexity classes by indirect proofs. The Uniform…

Computational Complexity · Computer Science 2019-02-22 Friederike Anna Dziemba

The Univalence Principle is the statement that equivalent mathematical structures are indistinguishable. We prove a general version of this principle that applies to all set-based, categorical, and higher-categorical structures defined in a…

Category Theory · Mathematics 2022-08-31 Benedikt Ahrens , Paige Randall North , Michael Shulman , Dimitris Tsementzis

Assuming natural variational realization conjectures, we give uniform bounds for the obstruction to the integral Tate conjecture in 1-dimensional families of algebraic varieties over an infinite finitely generated field.

Algebraic Geometry · Mathematics 2024-10-29 Anna Cadoret , Alena Pirutka

We prove the algorithmic canonicity of two classes of $\mu$-inequalities in a constructive meta-theory of normal lattice expansions. This result simultaneously generalizes Conradie and Craig's canonicity for $\mu$-inequalities based on a…

Logic · Mathematics 2016-03-22 Willem Conradie , Andrew Craig , Alessandra Palmigiano , Zhiguang Zhao

Transformers have become the foundational architecture for a broad spectrum of sequence modeling applications, underpinning state-of-the-art systems in natural language processing, vision, and beyond. However, their theoretical limitations…

Computation and Language · Computer Science 2026-02-13 Michelle Yuan , Weiyi Sun , Amir H. Rezaeian , Jyotika Singh , Sandip Ghoshal , Yao-Ting Wang , Miguel Ballesteros , Yassine Benajiba

In ASPIC-style structured argumentation an argument can rebut another argument by attacking its conclusion. Two ways of formalizing rebuttal have been proposed: In restricted rebuttal, the attacked conclusion must have been arrived at with…

Artificial Intelligence · Computer Science 2020-07-10 Marcos Cramer , Meghna Bhadra

Adversarial training has been recently employed for realizing structured semantic segmentation, in which the aim is to preserve higher-level scene structural consistencies in dense predictions. However, as we show, value-based…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Laurens Samson , Nanne van Noord , Olaf Booij , Michael Hofmann , Efstratios Gavves , Mohsen Ghafoorian

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

Machine Learning · Statistics 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

To preserve previously learned representations, continual learning systems must strike a balance between plasticity, the ability to acquire new knowledge, and stability. This stability-plasticity dilemma affects how representations can be…

Machine Learning · Computer Science 2026-05-01 Kathrin Korte , Joachim Winter Pedersen , Eleni Nisioti , Sebastian Risi

We define an abstract framework called {\it discrete finite differences embedding} which can be used to obtain discrete analogue of formal functional relations in the spirit of category theory. For ordinary differential equations we exhibit…

Numerical Analysis · Mathematics 2014-11-27 Jacky Cresson , Frédéric Pierret

Most automated verifiers for separation logic target the symbolic-heap fragment, disallowing both the magic-wand operator and the application of classical Boolean operators to spatial formulas. This is not surprising, as support for the…

Logic in Computer Science · Computer Science 2021-03-15 Jens Pagel , Florian Zuleger