English
Related papers

Related papers: Smoothed Embeddings for Certified Few-Shot Learnin…

200 papers

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

Recent advances in machine learning (ML) algorithms, especially deep neural networks (DNNs), have demonstrated remarkable success (sometimes exceeding human-level performance) on several tasks, including face and speech recognition.…

Machine Learning · Computer Science 2020-03-04 Yue Gao , Harrison Rosenberg , Kassem Fawaz , Somesh Jha , Justin Hsu

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

Few-shot classification is challenging because the data distribution of the training set can be widely different to the test set as their classes are disjoint. This distribution shift often results in poor generalization. Manifold smoothing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Pau Rodríguez , Issam Laradji , Alexandre Drouin , Alexandre Lacoste

Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g. misclassify several…

Machine Learning · Computer Science 2024-02-27 Jan Schuchardt , Tom Wollschläger , Aleksandar Bojchevski , Stephan Günnemann

Recent work in imitation learning has shown that having an expert controller that is both suitably smooth and stable enables stronger guarantees on the performance of the learned controller. However, constructing such smoothed expert…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Daniel Pfrommer , Swati Padmanabhan , Kwangjun Ahn , Jack Umenberger , Tobia Marcucci , Zakaria Mhammedi , Ali Jadbabaie

Randomized smoothing (RS) is a well known certified defense against adversarial attacks, which creates a smoothed classifier by predicting the most likely class under random noise perturbations of inputs during inference. While initial work…

Machine Learning · Computer Science 2023-04-21 Soumalya Nandi , Sravanti Addepalli , Harsh Rangwani , R. Venkatesh Babu

Randomized smoothing is a popular certified defense against adversarial attacks. In its essence, we need to solve a problem of statistical estimation which is usually very time-consuming since we need to perform numerous (usually $10^5$)…

Machine Learning · Statistics 2025-01-22 Vaclav Voracek

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbed input with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanbin Hong , Yuan Hong

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily computed. In this…

Machine Learning · Computer Science 2020-12-16 Alexander Levine , Aounon Kumar , Thomas Goldstein , Soheil Feizi

Randomness supports many critical functions in the field of machine learning (ML) including optimisation, data selection, privacy, and security. ML systems outsource the task of generating or harvesting randomness to the compiler, the cloud…

Machine Learning · Computer Science 2024-02-13 Pranav Dahiya , Ilia Shumailov , Ross Anderson

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

We propose a method for learning embeddings for few-shot learning that is suitable for use with any number of ways and any number of shots (shot-free). Rather than fixing the class prototypes to be the Euclidean average of sample…

Machine Learning · Computer Science 2020-04-23 Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Feature attributions are a popular tool for explaining the behavior of Deep Neural Networks (DNNs), but have recently been shown to be vulnerable to attacks that produce divergent explanations for nearby inputs. This lack of robustness is…

Machine Learning · Computer Science 2020-10-23 Zifan Wang , Haofan Wang , Shakul Ramkumar , Matt Fredrikson , Piotr Mardziel , Anupam Datta

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or $\ell_\infty$;…

Machine Learning · Computer Science 2020-07-27 Greg Yang , Tony Duan , J. Edward Hu , Hadi Salman , Ilya Razenshteyn , Jerry Li

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

Machine Learning · Computer Science 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

We extend randomized smoothing to cover parameterized transformations (e.g., rotations, translations) and certify robustness in the parameter space (e.g., rotation angle). This is particularly challenging as interpolation and rounding…

Machine Learning · Computer Science 2021-08-26 Marc Fischer , Maximilian Baader , Martin Vechev

Federated learning has recently gained significant attention and popularity due to its effectiveness in training machine learning models on distributed data privately. However, as in the single-node supervised learning setup, models trained…

Machine Learning · Computer Science 2022-10-27 Motasem Alfarra , Juan C. Pérez , Egor Shulgin , Peter Richtárik , Bernard Ghanem