English
Related papers

Related papers: Provable Robustness for Streaming Models with a Sl…

200 papers

To develop rigorous knowledge about ML models -- and the systems in which they are embedded -- we need reliable measurements. But reliable measurement is fundamentally challenging, and touches on issues of reproducibility, scalability,…

Machine Learning · Computer Science 2024-08-13 A. Feder Cooper

Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent…

Machine Learning · Computer Science 2020-10-07 Ryan Campbell , Chris Finlay , Adam M Oberman

Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Yaohua Wang , FangYi Zhang , Ming Lin , Senzhang Wang , Xiuyu Sun , Rong Jin

We study the problem of high-dimensional robust mean estimation in an online setting. Specifically, we consider a scenario where $n$ sensors are measuring some common, ongoing phenomenon. At each time step $t=1,2,\ldots,T$, the $i^{th}$…

Machine Learning · Computer Science 2023-10-26 Daniel M. Kane , Ilias Diakonikolas , Hanshen Xiao , Sihan Liu

Interpretable machine learning and explainable artificial intelligence have become essential in many applications. The trade-off between interpretability and model performance is the traitor to developing intrinsic and model-agnostic…

Machine Learning · Computer Science 2023-09-06 Chiara Balestra , Bin Li , Emmanuel Müller

Machine translation models have discrete vocabularies and commonly use subword segmentation techniques to achieve an 'open vocabulary.' This approach relies on consistent and correct underlying unicode sequences, and makes models…

Computation and Language · Computer Science 2021-12-13 Elizabeth Salesky , David Etter , Matt Post

Neural networks are often susceptible to minor perturbations in input that cause them to misclassify. A recent solution to this problem is the use of globally-robust neural networks, which employ a function to certify that the…

Programming Languages · Computer Science 2025-05-13 James Tobler , Hira Taqdees Syeda , Toby Murray

For systems with uncertain linear models, bounded additive disturbances and state and control constraints, a robust model predictive control algorithm incorporating online model adaptation is proposed. Sets of model parameters are…

Optimization and Control · Mathematics 2020-07-16 Xiaonan Lu , Mark Cannon , Denis Koksal-Rivet

As multimodal learning finds applications in a wide variety of high-stakes societal tasks, investigating their robustness becomes important. Existing work has focused on understanding the robustness of vision-and-language models to…

Machine Learning · Computer Science 2022-11-07 Gaurav Verma , Vishwa Vinay , Ryan A. Rossi , Srijan Kumar

In the last years, AI systems, in particular neural networks, have seen a tremendous increase in performance, and they are now used in a broad range of applications. Unlike classical symbolic AI systems, neural networks are trained using…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Christian Berghoff , Pavol Bielik , Matthias Neu , Petar Tsankov , Arndt von Twickel

Robust learning is an important issue in Scientific Machine Learning (SciML). There are several works in the literature addressing this topic. However, there is an increasing demand for methods that can simultaneously consider all the…

Many methods of estimating causal models do not provide estimates of confidence in the resulting model. In this work, a metric is proposed for validating the output of a causal model fit; the robustness of the model structure with resampled…

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xin Ke , ZiFeng Wang , Chunxi Li

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

The increasing deployment of advanced digital technologies such as Internet of Things (IoT) devices and Cyber-Physical Systems (CPS) in industrial environments is enabling the productive use of machine learning (ML) algorithms in the…

Machine Learning · Computer Science 2021-12-21 Nicolas Jourdan , Sagar Sen , Erik Johannes Husom , Enrique Garcia-Ceja , Tobias Biegel , Joachim Metternich

Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model. Several works suggest this variability is negligible when models have the same performance, which in the case…

Machine Learning · Statistics 2023-10-03 Sinjini Banerjee , Reilly Cannon , Tim Marrinan , Tony Chiang , Anand D. Sarwate

Robustness to distribution shift and fairness have independently emerged as two important desiderata required of modern machine learning models. While these two desiderata seem related, the connection between them is often unclear in…

Machine Learning · Computer Science 2023-09-13 Maggie Makar , Alexander D'Amour

One of the intensely studied concepts of network robustness is $r$-robustness, which is a network topology property quantified by an integer $r$. It is required by mean subsequence reduced (MSR) algorithms and their variants to achieve…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Yuhao Yi , Yuan Wang , Xingkang He , Stacy Patterson , Karl H. Johansson

While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal)…

Machine Learning · Computer Science 2022-06-28 Yujia Bao , Shiyu Chang , Regina Barzilay

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma