English
Related papers

Related papers: Quantitative Robustness of Localized Support Vecto…

200 papers

Robust Bayesian analysis has been mainly devoted to detecting and measuring robustness w.r.t. the prior distribution. Many contributions in the literature aim to define suitable classes of priors which allow the computation of variations of…

Statistics Theory · Mathematics 2025-09-04 Antonio Di Noia , Fabrizio Ruggeri , Antonietta Mira

We examine the relationship between learnability and robust (or agnostic) learnability for the problem of distribution learning. We show that, contrary to other learning settings (e.g., PAC learning of function classes), realizable…

Machine Learning · Statistics 2024-06-27 Shai Ben-David , Alex Bie , Gautam Kamath , Tosca Lechner

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Machine learning methods have significantly improved in their predictive capabilities, but at the same time they are becoming more complex and less transparent. As a result, explainers are often relied on to provide interpretability to…

Machine Learning · Computer Science 2024-04-17 Zulqarnain Khan , Davin Hill , Aria Masoomi , Joshua Bone , Jennifer Dy

Advances in statistical learning theory present the opportunity to develop statistical models of quantum many-body systems exhibiting remarkable predictive power. The potential of such ``theory-thin'' approaches is illustrated with the…

Nuclear Theory · Physics 2008-11-26 John W. Clark , Haochen Li

Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness…

Methodology · Statistics 2021-07-02 Alexander Tarr , Kosuke Imai

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

Machine Learning · Computer Science 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

We propose a randomized algorithm for training Support vector machines(SVMs) on large datasets. By using ideas from Random projections we show that the combinatorial dimension of SVMs is $O({log} n)$ with high probability. This estimate of…

Machine Learning · Computer Science 2009-09-22 Vinay Jethava , Krishnan Suresh , Chiranjib Bhattacharyya , Ramesh Hariharan

Distribution regression refers to the supervised learning problem where labels are only available for groups of inputs instead of individual inputs. In this paper, we develop a rigorous mathematical framework for distribution regression…

Machine Learning · Computer Science 2021-09-30 Maud Lemercier , Cristopher Salvi , Theodoros Damoulas , Edwin V. Bonilla , Terry Lyons

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts…

Persistent homology has become an important tool for extracting geometric and topological features from data, whose multi-scale features are summarized in a persistence diagram. From a statistical perspective, however, persistence diagrams…

Statistics Theory · Mathematics 2022-06-07 Siddharth Vishwanath , Kenji Fukumizu , Satoshi Kuriki , Bharath Sriperumbudur

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Foundation models are a current focus of attention in both industry and academia. While they have shown their capabilities in a variety of tasks, in-depth research is required to determine their robustness to distribution shift when used as…

Computation and Language · Computer Science 2023-12-12 Xiruo Ding , Zhecheng Sheng , Brian Hur , Feng Chen , Serguei V. S. Pakhomov , Trevor Cohen

Learning models capable of providing reliable predictions in the face of adversarial actions has become a central focus of the machine learning community in recent years. This challenge arises from observing that data encountered at…

Machine Learning · Computer Science 2025-05-05 Marco C. Campi , Algo Carè , Luis G. Crespo , Simone Garatti , Federico A. Ramponi

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

Machine Learning · Computer Science 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

Crucial for building trust in deep learning models for critical real-world applications is efficient and theoretically sound uncertainty quantification, a task that continues to be challenging. Useful uncertainty information is expected to…

Machine Learning · Computer Science 2021-10-28 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Accurately predicting the relevance of items to users is crucial to the success of many social platforms. Conventional approaches train models on logged historical data; but recommendation systems, media services, and online marketplaces…

Machine Learning · Computer Science 2022-10-11 Amir Feder , Guy Horowitz , Yoav Wald , Roi Reichart , Nir Rosenfeld

This paper provides an overview of current approaches for solving inverse problems in imaging using variational methods and machine learning. A special focus lies on point estimators and their robustness against adversarial perturbations.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Alexander Auras , Kanchana Vaishnavi Gandikota , Hannah Droege , Michael Moeller

Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their position in the scene. However, in some domains, like…

Machine Learning · Computer Science 2020-07-13 Arnas Uselis , Mantas Lukoševičius , Lukas Stasytis

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xin Ke , ZiFeng Wang , Chunxi Li