English
Related papers

Related papers: AdaptDel: Adaptable Deletion Rate Randomized Smoot…

200 papers

Randomized Smoothing (RS) is considered the state-of-the-art approach to obtain certifiably robust models for challenging tasks. However, current RS approaches drastically decrease standard accuracy on unperturbed data, severely limiting…

Machine Learning · Computer Science 2022-04-04 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Autonomous systems increasingly rely on machine learning techniques to transform high-dimensional raw inputs into predictions that are then used for decision-making and control. However, it is often easy to maliciously manipulate such…

Machine Learning · Computer Science 2023-02-07 Jinghan Yang , Hunmin Kim , Wenbin Wan , Naira Hovakimyan , Yevgeniy Vorobeychik

Although randomized smoothing has demonstrated high certified robustness and superior scalability to other certified defenses, the high computational overhead of the robustness certification bottlenecks the practical applicability, as it…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Ruoxin Chen , Jie Li , Junchi Yan , Ping Li , Bin Sheng

Randomized smoothing has become a leading approach for certifying adversarial robustness in machine learning models. However, a persistent gap remains between theoretical certified robustness and empirical robustness accuracy. This paper…

Machine Learning · Computer Science 2025-04-10 Blaise Delattre , Paul Caillon , Quentin Barthélemy , Erwan Fagnou , Alexandre Allauzen

We present a new certification method for image and point cloud segmentation based on randomized smoothing. The method leverages a novel scalable algorithm for prediction and certification that correctly accounts for multiple testing,…

Machine Learning · Computer Science 2022-07-28 Marc Fischer , Maximilian Baader , Martin Vechev

Machine learning models have demonstrated remarkable success across diverse domains but remain vulnerable to adversarial attacks. Empirical defense mechanisms often fail, as new attacks constantly emerge, rendering existing defenses…

Machine Learning · Computer Science 2024-10-25 Anupriya Kumari , Devansh Bhardwaj , Sukrit Jindal

The standard approach to assess reliability of automatic speech transcriptions is through the use of confidence scores. If accurate, these scores provide a flexible mechanism to flag transcription errors for upstream and downstream…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-01 Anton Ragni , Qiujia Li , Mark Gales , Yu Wang

Deep Neural Networks are vulnerable to small perturbations that can drastically alter their predictions for perceptually unchanged inputs. The literature on adversarially robust Deep Learning attempts to either enhance the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Thomas Massena , Corentin Friedrich , Franck Mamalet , Mathieu Serrurier

Fine-tuning over large pretrained language models (PLMs) has established many state-of-the-art results. Despite its superior performance, such fine-tuning can be unstable, resulting in significant variance in performance and potential risks…

Computation and Language · Computer Science 2022-10-20 Chenghao Yang , Xuezhe Ma

The pruning objective has recently extended beyond accuracy and sparsity to robustness in language models. Despite this, existing methods struggle to enhance robustness against adversarial attacks when continually increasing model sparsity…

Computation and Language · Computer Science 2024-01-12 Jianwei Li , Qi Lei , Wei Cheng , Dongkuan Xu

Deep neural networks have been widely adopted in many vision and robotics applications with visual inputs. It is essential to verify its robustness against semantic transformation perturbations, such as brightness and contrast. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hanjiang Hu , Bowei Li , Ziwei Wang , Tianhao Wei , Casidhe Hutchison , Eric Sample , Changliu Liu

Depth-adaptive neural networks can dynamically adjust depths according to the hardness of input words, and thus improve efficiency. The main challenge is how to measure such hardness and decide the required depths (i.e., layers) to conduct.…

Computation and Language · Computer Science 2020-12-17 Yijin Liu , Fandong Meng , Jie Zhou , Yufeng Chen , Jinan Xu

Randomized smoothing, a method to certify a classifier's decision on an input is invariant under adversarial noise, offers attractive advantages over other certification methods. It operates in a black-box and so certification is not…

Machine Learning · Computer Science 2020-06-09 Jamie Hayes

Robust federated learning aims to maintain reliable performance despite the presence of adversarial or misbehaving workers. While state-of-the-art (SOTA) robust distributed gradient descent (Robust-DGD) methods were proven theoretically…

Machine Learning · Computer Science 2025-05-12 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Ahmed Jellouli , Geovani Rizk , John Stephan

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Deep learning-based malware detection systems are vulnerable to adversarial EXEmples - carefully-crafted malicious programs that evade detection with minimal perturbation. As such, the community is dedicating effort to develop mechanisms to…

Cryptography and Security · Computer Science 2024-05-02 Daniel Gibert , Luca Demetrio , Giulio Zizzo , Quan Le , Jordi Planes , Battista Biggio

The literature on provable robustness in machine learning has primarily focused on static prediction problems, such as image classification, in which input samples are assumed to be independent and model performance is measured as an…

Machine Learning · Computer Science 2023-03-30 Aounon Kumar , Vinu Sankar Sadasivan , Soheil Feizi

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

Managing heterogeneous datasets that vary in complexity, size, and similarity in continual learning presents a significant challenge. Task-agnostic continual learning is necessary to address this challenge, as datasets with varying…

Machine Learning · Computer Science 2024-01-09 Yuqing Zhao , Divya Saxena , Jiannong Cao

Visual instruction datasets from various distributors are released at different times and often contain a significant number of semantically redundant text-image pairs, depending on their task compositions (i.e., skills) or reference…

Machine Learning · Computer Science 2025-03-25 Adyasha Maharana , Jaehong Yoon , Tianlong Chen , Mohit Bansal