English
Related papers

Related papers: ANCER: Anisotropic Certification via Sample-wise V…

200 papers

We present and analyze an algorithm for estimating the size, under a Gaussian or uniform measure, of a localized neighborhood in neural network parameter space with behavior similar to an ``anchor'' point. We refer to this as the "local…

Machine Learning · Computer Science 2025-04-09 Adam Scherlis , Nora Belrose

Machine learning-based static malware detectors remain vulnerable to adversarial evasion techniques, such as metamorphic engine mutations. To address this vulnerability, we propose a certifiably robust malware detection framework based on…

Cryptography and Security · Computer Science 2026-04-23 Nandakrishna Giri , Asmitha K. A. , Serena Nicolazzo , Antonino Nocera , Vinod P

Accents play a pivotal role in shaping human communication, enhancing our ability to convey and comprehend messages with clarity and cultural nuance. While there has been significant progress in Automatic Speech Recognition (ASR),…

Computation and Language · Computer Science 2025-06-24 Bonaventure F. P. Dossou

This paper presents Conformer-1, an end-to-end Automatic Speech Recognition (ASR) model trained on an extensive dataset of 570k hours of speech audio data, 91% of which was acquired from publicly available sources. To achieve this, we…

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

For safety-related applications, it is crucial to produce trustworthy deep neural networks whose prediction is associated with confidence that can represent the likelihood of correctness for subsequent decision-making. Existing dense binary…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Jiawei Liu , Changkun Ye , Shan Wang , Ruikai Cui , Jing Zhang , Kaihao Zhang , Nick Barnes

Existing techniques for certifying the robustness of models for discrete data either work only for a small class of models or are general at the expense of efficiency or tightness. Moreover, they do not account for sparsity in the input…

Machine Learning · Computer Science 2023-02-28 Aleksandar Bojchevski , Johannes Gasteiger , Stephan Günnemann

We systematically explore regularizing neural networks by penalizing low entropy output distributions. We show that penalizing low entropy output distributions, which has been shown to improve exploration in reinforcement learning, acts as…

Neural and Evolutionary Computing · Computer Science 2017-01-24 Gabriel Pereyra , George Tucker , Jan Chorowski , Łukasz Kaiser , Geoffrey Hinton

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

In light of the inherently complex and dynamic nature of real-world environments, incorporating risk measures is crucial for the robustness evaluation of deep learning models. In this work, we propose a Risk-Averse Certification framework…

Machine Learning · Computer Science 2024-12-02 Xiyue Zhang , Zifan Wang , Yulong Gao , Licio Romao , Alessandro Abate , Marta Kwiatkowska

As deep learning models continue to advance and are increasingly utilized in real-world systems, the issue of robustness remains a major challenge. Existing certified training methods produce models that achieve high provable robustness…

Machine Learning · Computer Science 2023-07-26 Zhakshylyk Nurlanov , Frank R. Schmidt , Florian Bernard

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leading to a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hasanul Mahmud , Kevin Desai , Palden Lama , Sushil K. Prasad

Recent end-to-end deep neural networks for disparity regression have achieved the state-of-the-art performance. However, many well-acknowledged specific properties of disparity estimation are omitted in these deep learning algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Yang Chen , Zongqing Lu , Xuechen Zhang , Lei Chen , Qingmin Liao

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

Contextual word representation models have shown massive improvements on a multitude of NLP tasks, yet their word sense disambiguation capabilities remain poorly explained. To address this gap, we assess whether contextual word…

Computation and Language · Computer Science 2021-04-23 Geetanjali Bihani , Julia Taylor Rayz

Mixed precision quantization has become an important technique for optimizing the execution of deep neural networks (DNNs). Certified robustness, which provides provable guarantees about a model's ability to withstand different adversarial…

Machine Learning · Computer Science 2026-04-29 Yuchen Yang , Yifan Zhao , Shubham Ugare , Gagandeep Singh , Sasa Misailovic

This paper introduces NoRefER, a novel referenceless quality metric for automatic speech recognition (ASR) systems. Traditional reference-based metrics for evaluating ASR systems require costly ground-truth transcripts. NoRefER overcomes…

Computation and Language · Computer Science 2023-06-23 Kamer Ali Yuksel , Thiago Ferreira , Golara Javadi , Mohamed El-Badrashiny , Ahmet Gunduz

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak