中文
相关论文

相关论文: Smoothed Embeddings for Certified Few-Shot Learnin…

200 篇论文

Randomized smoothing is sound when using infinite precision. However, we show that randomized smoothing is no longer sound for limited floating-point precision. We present a simple example where randomized smoothing certifies a radius of…

机器学习 · 计算机科学 2023-04-26 Václav Voráček , Matthias Hein

Adversarial data examples have drawn significant attention from the machine learning and security communities. A line of work on tackling adversarial examples is certified robustness via randomized smoothing that can provide a theoretical…

机器学习 · 计算机科学 2021-08-24 Haowen Lin , Jian Lou , Li Xiong , Cyrus Shahabi

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

计算机视觉与模式识别 · 计算机科学 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

机器学习 · 计算机科学 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

Certified defense using randomized smoothing is a popular technique to provide robustness guarantees for deep neural networks against l2 adversarial attacks. Existing works use this technique to provably secure a pretrained non-robust model…

机器学习 · 计算机科学 2022-10-18 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Currently the most popular method of providing robustness certificates is randomized smoothing where an input is smoothed via some probability distribution. We propose a novel approach to randomized smoothing over multiplicative parameters.…

机器学习 · 计算机科学 2022-08-17 Nikita Muravev , Aleksandr Petiushko

Randomized smoothing is currently considered the state-of-the-art method to obtain certifiably robust classifiers. Despite its remarkable performance, the method is associated with various serious problems such as "certified accuracy…

机器学习 · 计算机科学 2024-03-11 Peter Súkeník , Aleksei Kuvshinov , Stephan Günnemann

Deep learning interpretation is essential to explain the reasoning behind model predictions. Understanding the robustness of interpretation methods is important especially in sensitive domains such as medical applications since…

机器学习 · 计算机科学 2019-10-21 Alexander Levine , Sahil Singla , Soheil Feizi

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L_1 and L_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base…

机器学习 · 计算机科学 2019-11-22 Alexander Levine , Soheil Feizi

Few-shot and one-shot learning have been the subject of active and intensive research in recent years, with mounting evidence pointing to successful implementation and exploitation of few-shot learning algorithms in practice. Classical…

机器学习 · 计算机科学 2023-12-07 Ivan Y. Tyukin , Alexander N. Gorban , Muhammad H. Alkhudaydi , Qinghua Zhou

In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $\epsilon$) of the…

机器学习 · 计算机科学 2025-05-02 Gautam Chandrasekaran , Adam Klivans , Vasilis Kontonis , Raghu Meka , Konstantinos Stavropoulos

Certified robustness in machine learning has primarily focused on adversarial perturbations of the input with a fixed attack budget for each point in the data distribution. In this work, we present provable robustness guarantees on the…

机器学习 · 计算机科学 2023-07-18 Aounon Kumar , Alexander Levine , Tom Goldstein , Soheil Feizi

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

机器学习 · 计算机科学 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

机器学习 · 计算机科学 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

We introduce the isoperimetric loss as a regularization criterion for learning the map from a visual representation to a semantic embedding, to be used to transfer knowledge to unknown classes in a zero-shot learning setting. We use a…

机器学习 · 计算机科学 2019-12-05 Shay Deutsch , Andrea Bertozzi , Stefano Soatto

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

机器学习 · 计算机科学 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Randomized smoothing has established state-of-the-art provable robustness against $\ell_2$ norm adversarial attacks with high probability. However, the introduced Gaussian data augmentation causes a severe decrease in natural accuracy. We…

机器学习 · 计算机科学 2020-12-01 Ching-Chia Kao , Jhe-Bang Ko , Chun-Shien Lu

Patch adversarial attacks on images, in which the attacker can distort pixels within a region of bounded size, are an important threat model since they provide a quantitative model for physical adversarial attacks. In this paper, we…

机器学习 · 计算机科学 2021-01-11 Alexander Levine , Soheil Feizi