English
Related papers

Related papers: Smoothed Embeddings for Certified Few-Shot Learnin…

200 papers

Randomized smoothing is sound when using infinite precision. However, we show that randomized smoothing is no longer sound for limited floating-point precision. We present a simple example where randomized smoothing certifies a radius of…

Machine Learning · Computer Science 2023-04-26 Václav Voráček , Matthias Hein

Adversarial data examples have drawn significant attention from the machine learning and security communities. A line of work on tackling adversarial examples is certified robustness via randomized smoothing that can provide a theoretical…

Machine Learning · Computer Science 2021-08-24 Haowen Lin , Jian Lou , Li Xiong , Cyrus Shahabi

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

Machine Learning · Computer Science 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

Certified defense using randomized smoothing is a popular technique to provide robustness guarantees for deep neural networks against l2 adversarial attacks. Existing works use this technique to provably secure a pretrained non-robust model…

Machine Learning · Computer Science 2022-10-18 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Currently the most popular method of providing robustness certificates is randomized smoothing where an input is smoothed via some probability distribution. We propose a novel approach to randomized smoothing over multiplicative parameters.…

Machine Learning · Computer Science 2022-08-17 Nikita Muravev , Aleksandr Petiushko

Randomized smoothing is currently considered the state-of-the-art method to obtain certifiably robust classifiers. Despite its remarkable performance, the method is associated with various serious problems such as "certified accuracy…

Machine Learning · Computer Science 2024-03-11 Peter Súkeník , Aleksei Kuvshinov , Stephan Günnemann

Deep learning interpretation is essential to explain the reasoning behind model predictions. Understanding the robustness of interpretation methods is important especially in sensitive domains such as medical applications since…

Machine Learning · Computer Science 2019-10-21 Alexander Levine , Sahil Singla , Soheil Feizi

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L_1 and L_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base…

Machine Learning · Computer Science 2019-11-22 Alexander Levine , Soheil Feizi

Few-shot and one-shot learning have been the subject of active and intensive research in recent years, with mounting evidence pointing to successful implementation and exploitation of few-shot learning algorithms in practice. Classical…

Machine Learning · Computer Science 2023-12-07 Ivan Y. Tyukin , Alexander N. Gorban , Muhammad H. Alkhudaydi , Qinghua Zhou

In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $\epsilon$) of the…

Machine Learning · Computer Science 2025-05-02 Gautam Chandrasekaran , Adam Klivans , Vasilis Kontonis , Raghu Meka , Konstantinos Stavropoulos

Certified robustness in machine learning has primarily focused on adversarial perturbations of the input with a fixed attack budget for each point in the data distribution. In this work, we present provable robustness guarantees on the…

Machine Learning · Computer Science 2023-07-18 Aounon Kumar , Alexander Levine , Tom Goldstein , Soheil Feizi

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

Machine Learning · Computer Science 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

Machine Learning · Computer Science 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

We introduce the isoperimetric loss as a regularization criterion for learning the map from a visual representation to a semantic embedding, to be used to transfer knowledge to unknown classes in a zero-shot learning setting. We use a…

Machine Learning · Computer Science 2019-12-05 Shay Deutsch , Andrea Bertozzi , Stefano Soatto

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Randomized smoothing has established state-of-the-art provable robustness against $\ell_2$ norm adversarial attacks with high probability. However, the introduced Gaussian data augmentation causes a severe decrease in natural accuracy. We…

Machine Learning · Computer Science 2020-12-01 Ching-Chia Kao , Jhe-Bang Ko , Chun-Shien Lu

Patch adversarial attacks on images, in which the attacker can distort pixels within a region of bounded size, are an important threat model since they provide a quantitative model for physical adversarial attacks. In this paper, we…

Machine Learning · Computer Science 2021-01-11 Alexander Levine , Soheil Feizi
‹ Prev 1 3 4 5 6 7 10 Next ›