English
Related papers

Related papers: The interplay of robustness and generalization in …

200 papers

The question why deep learning algorithms generalize so well has attracted increasing research interest. However, most of the well-established approaches, such as hypothesis capacity, stability or sparseness, have not provided complete…

Machine Learning · Computer Science 2017-11-07 Tom Zahavy , Bingyi Kang , Alex Sivak , Jiashi Feng , Huan Xu , Shie Mannor

A central challenge of adversarial learning is to interpret the resulting hardened model. In this contribution, we ask how robust generalization can be visually discerned and whether a concise view of the interactions between a hardened…

Machine Learning · Computer Science 2018-05-10 Alex Huang , Abdullah Al-Dujaili , Erik Hemberg , Una-May O'Reilly

In this study, we explore the inherent trade-off between accuracy and robustness in neural networks, drawing an analogy to the uncertainty principle in quantum mechanics. We propose that neural networks are subject to an uncertainty…

Machine Learning · Computer Science 2025-01-17 Jun-Jie Zhang , Dong-Xiao Zhang , Jian-Nan Chen , Long-Gang Pang , Deyu Meng

Classical learning of the expectation values of observables for quantum states is a natural variant of learning quantum states or channels. While learning-theoretic frameworks establish the sample complexity and the number of measurement…

Quantum Physics · Physics 2024-08-12 Beng Yee Gan , Po-Wei Huang , Elies Gil-Fuster , Patrick Rebentrost

Stability analysis is an essential aspect of studying the generalization ability of deep learning, as it involves deriving generalization bounds for stochastic gradient descent-based training algorithms. Adversarial training is the most…

Machine Learning · Computer Science 2024-01-09 Yihan Wang , Shuang Liu , Xiao-Shan Gao

Despite their outstanding performance, large language models (LLMs) suffer notorious flaws related to their preference for simple, surface-level textual relations over full semantic complexity of the problem. This proposal investigates a…

Computation and Language · Computer Science 2022-06-20 Michal Štefánik

We investigate robustness of deep feed-forward neural networks when input data are subject to random uncertainties. More specifically, we consider regularization of the network by its Lipschitz constant and emphasize its role. We highlight…

Machine Learning · Computer Science 2019-04-15 Nicolas Couellan

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when…

Machine Learning · Statistics 2024-10-22 Matteo Vilucchio , Nikolaos Tsilivis , Bruno Loureiro , Julia Kempe

As machine learning models become increasingly prevalent in critical decision-making models and systems in fields like finance, healthcare, etc., ensuring their robustness against adversarial attacks and changes in the input data is…

Machine Learning · Statistics 2024-08-05 Arun Prakash R , Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

Robustness and generalization ability of machine learning models are of utmost importance in various application domains. There is a wide interest in efficient ways to analyze those properties. One important direction is to analyze…

Machine Learning · Computer Science 2025-04-29 Khoat Than , Dat Phan , Giang Vu

Despite their tremendous success in modelling high-dimensional data manifolds, deep neural networks suffer from the threat of adversarial attacks - Existence of perceptually valid input-like samples obtained through careful perturbation…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Vinay Kyatham , Mayank Mishra , Tarun Kumar Yadav , Deepak Mishra , Prathosh AP

Quantum machine learning (QML) is a rapidly growing field that combines quantum computing principles with traditional machine learning. It seeks to revolutionize machine learning by harnessing the unique capabilities of quantum mechanics…

Quantum Physics · Physics 2024-11-15 Jun Qi , Chao-Han Yang , Samuel Yen-Chi Chen , Pin-Yu Chen

Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but also boost the…

Machine Learning · Computer Science 2021-11-29 Yang Bai , Xin Yan , Yong Jiang , Shu-Tao Xia , Yisen Wang

Quantum machine learning is considered one of the flagship applications of quantum computers, where variational quantum circuits could be the leading paradigm both in the near-term quantum devices and the early fault-tolerant quantum…

Quantum Physics · Physics 2024-12-17 Yuqing Li , Jinglei Cheng , Xulong Tang , Youtao Zhang , Frederic T. Chong , Junyu Liu

Machine learning (ML) methods such as artificial neural networks are rapidly becoming ubiquitous in modern science, technology and industry. Despite their accuracy and sophistication, neural networks can be easily fooled by carefully…

Despite their ever more widespread deployment throughout society, machine learning algorithms remain critically vulnerable to being spoofed by subtle adversarial tampering with their input data. The prospect of near-term quantum computers…

Machine learning algorithms are powerful tools for data driven tasks such as image classification and feature detection, however their vulnerability to adversarial examples - input samples manipulated to fool the algorithm - remains a…

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities when exposed to various noises in real-world applications.…

Machine Learning · Computer Science 2023-04-11 Yisong Xiao , Tianyuan Zhang , Shunchang Liu , Haotong Qin
‹ Prev 1 4 5 6 7 8 10 Next ›