English
Related papers

Related papers: Robust and Accurate -- Compositional Architectures…

200 papers

We consider the problem of certified robustness for sequence classification against edit distance perturbations. Naturally occurring inputs of varying lengths (e.g., sentences in natural language processing tasks) present a challenge to…

Computation and Language · Computer Science 2025-11-13 Zhuoqun Huang , Neil G. Marchant , Olga Ohrimenko , Benjamin I. P. Rubinstein

Calibration measures and reliability diagrams are two fundamental tools for measuring and interpreting the calibration of probabilistic predictors. Calibration measures quantify the degree of miscalibration, and reliability diagrams…

Machine Learning · Computer Science 2023-09-22 Jarosław Błasiok , Preetum Nakkiran

Randomized smoothing-based certification is an effective approach for obtaining robustness certificates of deep neural networks (DNNs) against adversarial attacks. This method constructs a smoothed DNN model and certifies its robustness…

Machine Learning · Computer Science 2024-04-12 Shubham Ugare , Tarun Suresh , Debangshu Banerjee , Gagandeep Singh , Sasa Misailovic

Robustness against noisy imaging is crucial for practical image anomaly detection systems. This study introduces a Robust Anomaly Detection (RAD) dataset with free views, uneven illuminations, and blurry collections to systematically…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuqi Cheng , Yunkang Cao , Rui Chen , Weiming Shen

Routability optimization in modern EDA tools has benefited greatly from using machine learning (ML) models. Constructing and optimizing the performance of ML models continues to be a challenge. Neural Architecture Search (NAS) serves as a…

Machine Learning · Computer Science 2024-11-22 Arjun Sridhar , Chen-Chia Chang , Junyao Zhang , Yiran Chen

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

Randomness supports many critical functions in the field of machine learning (ML) including optimisation, data selection, privacy, and security. ML systems outsource the task of generating or harvesting randomness to the compiler, the cloud…

Machine Learning · Computer Science 2024-02-13 Pranav Dahiya , Ilia Shumailov , Ross Anderson

Sample average approximation (SAA) is a widely popular approach to data-driven decision-making under uncertainty. Under mild assumptions, SAA is both tractable and enjoys strong asymptotic performance guarantees. Similar guarantees,…

Optimization and Control · Mathematics 2016-11-03 Dimitris Bertsimas , Vishal Gupta , Nathan Kallus

Recent studies have revealed the vulnerability of deep neural networks: A small adversarial perturbation that is imperceptible to human can easily make a well-trained deep neural network misclassify. This makes it unsafe to apply neural…

Machine Learning · Computer Science 2018-08-02 Xuanqing Liu , Minhao Cheng , Huan Zhang , Cho-Jui Hsieh

Despite substantial progress in anomaly synthesis methods, existing diffusion-based and coarse inpainting pipelines commonly suffer from structural deficiencies such as micro-structural discontinuities, limited semantic controllability, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Long Qian , Bingke Zhu , Yingying Chen , Ming Tang , Jinqiao Wang

This paper presents novel methods for estimating certified radii in randomized smoothing, a technique crucial for certifying the robustness of neural networks against adversarial perturbations. Our proposed techniques significantly improve…

Machine Learning · Computer Science 2025-03-13 Zixuan Liang

Smoothness is a key inductive bias in machine learning and is closely related to generalization. Existing smoothness-inducing methods typically rely either on explicit gradient regularization, which often incurs substantial computational…

Machine Learning · Computer Science 2026-05-11 Parsa Moradi , Tayyebeh Jahaninezhad , Hanzaleh Akbarinodehi , Mohammad Ali Maddah-Ali

We study the problem of robust time series analysis under the standard auto-regressive (AR) time series model in the presence of arbitrary outliers. We devise an efficient hard thresholding based algorithm which can obtain a consistent…

Machine Learning · Computer Science 2016-07-04 Kush Bhatia , Prateek Jain , Parameswaran Kamalaruban , Purushottam Kar

Neural networks (NNs) are known to be vulnerable against adversarial perturbations, and thus there is a line of work aiming to provide robustness certification for NNs, such as randomized smoothing, which samples smoothing noises from a…

Machine Learning · Computer Science 2023-02-01 Linyi Li , Jiawei Zhang , Tao Xie , Bo Li

Soft random sampling (SRS) is a simple yet effective approach for efficient training of large-scale deep neural networks when dealing with massive data. SRS selects a subset uniformly at random with replacement from the full data set in…

Machine Learning · Computer Science 2023-11-27 Xiaodong Cui , Ashish Mittal , Songtao Lu , Wei Zhang , George Saon , Brian Kingsbury

Randomized smoothing has become essential for achieving certified adversarial robustness in machine learning models. However, current methods primarily use isotropic noise distributions that are uniform across all data dimensions, such as…

Machine Learning · Computer Science 2025-10-24 Hanbin Hong , Ashish Kundu , Ali Payani , Binghui Wang , Yuan Hong

This paper deals with model order selection in context of correlated noise. More precisely, one considers sources embedded in an additive Complex Elliptically Symmetric (CES) noise, with unknown parameters. The main difficultly for…

Methodology · Statistics 2017-10-19 Eugénie Terreaux , Jean-Philippe Ovarlez , Frédéric Pascal

We propose a new ensemble prediction method, Random Subset Averaging (RSA), tailored for settings with many covariates, particularly in the presence of strong correlations. RSA constructs candidate models via binomial random subset strategy…

Methodology · Statistics 2025-12-30 Wenhao Cui , Jie Hu

Sequential Recommender Systems (SRSs) have emerged as a highly efficient approach to recommendation systems. By leveraging sequential data, SRSs can identify temporal patterns in user behaviour, significantly improving recommendation…

As Automatic Speech Recognition (ASR) models become ever more pervasive, it is important to ensure that they make reliable predictions under corruptions present in the physical and digital world. We propose Speech Robust Bench (SRB), a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-10 Muhammad A. Shah , David Solans Noguero , Mikko A. Heikkila , Bhiksha Raj , Nicolas Kourtellis