English
Related papers

Related papers: Enhancing Certified Robustness via Smoothed Weight…

200 papers

Deep learning interpretation is essential to explain the reasoning behind model predictions. Understanding the robustness of interpretation methods is important especially in sensitive domains such as medical applications since…

Machine Learning · Computer Science 2019-10-21 Alexander Levine , Sahil Singla , Soheil Feizi

Existing techniques for certifying the robustness of models for discrete data either work only for a small class of models or are general at the expense of efficiency or tightness. Moreover, they do not account for sparsity in the input…

Machine Learning · Computer Science 2023-02-28 Aleksandar Bojchevski , Johannes Gasteiger , Stephan Günnemann

Autonomous systems increasingly rely on machine learning techniques to transform high-dimensional raw inputs into predictions that are then used for decision-making and control. However, it is often easy to maliciously manipulate such…

Machine Learning · Computer Science 2023-02-07 Jinghan Yang , Hunmin Kim , Wenbin Wan , Naira Hovakimyan , Yevgeniy Vorobeychik

Neural networks (NNs) are known to be vulnerable against adversarial perturbations, and thus there is a line of work aiming to provide robustness certification for NNs, such as randomized smoothing, which samples smoothing noises from a…

Machine Learning · Computer Science 2023-02-01 Linyi Li , Jiawei Zhang , Tao Xie , Bo Li

This paper presents a score-based weighted likelihood estimator (SWLE) for robust estimations of generalized linear model (GLM) for insurance loss data. The SWLE exhibits a limited sensitivity to the outliers, theoretically justifying its…

Methodology · Statistics 2022-04-25 Tsz Chai Fung

Federated Learning has emerged as a dominant computational paradigm for distributed machine learning. Its unique data privacy properties allow us to collaboratively train models while offering participating clients certain…

Machine Learning · Computer Science 2022-05-04 Dimitris Stripelis , Marcin Abram , Jose Luis Ambite

In structured output prediction tasks, labeling ground-truth training output is often expensive. However, for many tasks, even when the true output is unknown, we can evaluate predictions using a scalar reward function, which may be easily…

Machine Learning · Computer Science 2021-10-19 Amirmohammad Rooshenas , Dongxu Zhang , Gopal Sharma , Andrew McCallum

Modern machine learning forces practitioners to choose between powerful but expensive deep networks and fast but limited classical algorithms. Here we introduce Soft Learning, a framework that maintains a library of heterogeneous…

Machine Learning · Computer Science 2026-05-20 Mohammed Aledhari , Ali Aledhari , Fatimah Aledhari , Mohamed Rahouti

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that…

Machine Learning · Computer Science 2022-01-03 Jinghui Chen , Yu Cheng , Zhe Gan , Quanquan Gu , Jingjing Liu

Robustness to natural corruptions remains a critical challenge for reliable deep learning, particularly in safety-sensitive domains. We study a family of model-based training approaches that leverage a learned nuisance variation model to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Josué Martínez-Martínez , Olivia Brown , Giselle Zeno , Pooya Khorrami , Rajmonda Caceres

Many leading classification algorithms output a classifier that is a weighted average of kernel evaluations. Optimizing these weights is a nontrivial problem that still attracts much research effort. Furthermore, explaining these methods to…

Machine Learning · Statistics 2025-10-14 Brendan van Rooyen , Aditya Krishna Menon , Robert C. Williamson

We propose a robust elastic net (REN) model for high-dimensional sparse regression and give its performance guarantees (both the statistical error bound and the optimization bound). A simple idea of trimming the inner product is applied to…

Machine Learning · Computer Science 2016-05-03 Weiyang Liu , Rongmei Lin , Meng Yang

Mixture modeling, which considers the potential heterogeneity in data, is widely adopted for classification and clustering problems. Mixture models can be estimated using the Expectation-Maximization algorithm, which works with the complete…

Methodology · Statistics 2022-03-18 Shonosuke Sugasawa , Genya Kobayashi

Deep Learning has been shown to be particularly vulnerable to adversarial samples. To combat adversarial strategies, numerous defensive techniques have been proposed. Among these, a promising approach is to use randomness in order to make…

Cryptography and Security · Computer Science 2020-03-18 Kumar Sharad , Giorgia Azzurra Marson , Hien Thi Thu Truong , Ghassan Karame

Multi-level sentence simplification generates simplified sentences with varying language proficiency levels. We propose Label Confidence Weighted Learning (LCWL), a novel approach that incorporates a label confidence weighting scheme in the…

Computation and Language · Computer Science 2024-10-10 Xinying Qiu , Jingshen Zhang

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

We propose a new training algorithm, ScanMix, that explores semantic clustering and semi-supervised learning (SSL) to allow superior robustness to severe label noise and competitive robustness to non-severe label noise problems, in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ragav Sachdeva , Filipe R Cordeiro , Vasileios Belagiannis , Ian Reid , Gustavo Carneiro

The weighted ensemble (WE) method stands out as a widely used segment-based sampling technique renowned for its rigorous treatment of kinetics. The WE framework typically involves initially mapping the configuration space onto a…

Computational Physics · Physics 2024-11-19 Dedi Wang , Pratyush Tiwary

Training certifiably robust neural networks is an important but challenging task. While many algorithms for (deterministic) certified training have been proposed, they are often evaluated on different training schedules, certification…

Machine Learning · Computer Science 2025-05-29 Yuhao Mao , Stefan Balauca , Martin Vechev

Randomized Smoothing (RS) offers formal $\ell_2$ guarantees for arbitrary base classifiers but faces two key practical bottlenecks: (i) it often relies on noise-augmented training to achieve nontrivial certificates, which increases training…

Machine Learning · Computer Science 2026-04-29 Miao Lin , MD Saifur Rahman Mazumder , Feng Yu , Daniel Takabi , Rui Ning