English
Related papers

Related papers: The Role of Randomness in Stability

200 papers

Reproducibility is imperative for any scientific discovery. More often than not, modern scientific findings rely on statistical analysis of high-dimensional data. At a minimum, reproducibility manifests itself in stability of statistical…

Statistics Theory · Mathematics 2013-10-02 Bin Yu

Deep learning systems achieve remarkable empirical performance, yet the stability of the training process itself remains poorly understood. Training unfolds as a high-dimensional dynamical system in which small perturbations to…

Machine Learning · Computer Science 2026-01-21 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

Credit attribution is crucial across various fields. In academic research, proper citation acknowledges prior work and establishes original contributions. Similarly, in generative models, such as those trained on existing artworks or music,…

Machine Learning · Computer Science 2024-11-01 Roi Livni , Shay Moran , Kobbi Nissim , Chirag Pabbaraju

Algorithmic robustness refers to the sustained performance of a computational system in the face of change in the nature of the environment in which that system operates or in the task that the system is meant to perform. Below, we motivate…

Artificial Intelligence · Computer Science 2023-11-14 David Jensen , Brian LaMacchia , Ufuk Topcu , Pamela Wisniewski

Fair Machine Learning endeavors to prevent unfairness arising in the context of machine learning applications embedded in society. Despite the variety of definitions of fairness and proposed "fair algorithms", there remain unresolved…

Machine Learning · Computer Science 2022-11-17 Rabanus Derr , Robert C. Williamson

Constraint tightening to non-conservatively guarantee recursive feasibility and stability in Stochastic Model Predictive Control is addressed. Stability and feasibility requirements are considered separately, highlighting the difference…

Systems and Control · Computer Science 2016-05-13 Matthias Lorenzen , Fabrizio Dabbene , Roberto Tempo , Frank Allgöwer

In safety-critical deep learning applications, robustness measures the ability of neural models that handle imperceptible perturbations in input data, which may lead to potential safety hazards. Existing pre-deployment robustness assessment…

Machine Learning · Computer Science 2025-08-27 Wenchuan Mu , Kwan Hui Lim

Acquisition of data is a difficult task in many applications of machine learning, and it is only natural that one hopes and expects the population risk to decrease (better performance) monotonically with increasing data points. It turns…

Machine Learning · Computer Science 2022-01-19 Zakaria Mhammedi

In this paper, we introduce a notion of algorithmic stability called typical stability. When our goal is to release real-valued queries (statistics) computed over a dataset, this notion does not require the queries to be of bounded…

Machine Learning · Computer Science 2016-09-20 Raef Bassily , Yoav Freund

Trusting machine learning algorithms requires having confidence in their outputs. Confidence is typically interpreted in terms of model reliability, where a model is reliable if it produces a high proportion of correct outputs. However,…

Machine Learning · Computer Science 2023-11-01 Jonathan Vandenburgh

Robustness is a correctness notion for concurrent programs running under relaxed consistency models. The task is to check that the relaxed behavior coincides (up to traces) with sequential consistency (SC). Although computationally simple…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-16 Egor Derevenetc , Roland Meyer , Sebastian Schweizer

Algorithmic stability is a key characteristic to ensure the generalization ability of a learning algorithm. Among different notions of stability, \emph{uniform stability} is arguably the most popular one, which yields exponential…

Machine Learning · Computer Science 2021-07-14 Zhun Deng , Hangfeng He , Weijie J. Su

We examine the stability of loss-minimizing training processes that are used for deep neural networks (DNN) and other classifiers. While a classifier is optimized during training through a so-called loss function, the performance of…

Analysis of PDEs · Mathematics 2020-10-05 Leonid Berlyand , Pierre-Emmanuel Jabin , C. Alex Safsten

We propose two solution concepts for matchings under preferences: robustness and near stability. The former strengthens while the latter relaxes the classic definition of stability by Gale and Shapley (1962). Informally speaking, robustness…

Computer Science and Game Theory · Computer Science 2019-06-06 Jiehua Chen , Piotr Skowron , Manuel Sorge

Similarity is a fundamental measure in network analyses and machine learning algorithms, with wide applications ranging from personalized recommendation to socio-economic dynamics. We argue that an effective similarity measurement should…

Physics and Society · Physics 2015-12-07 Jian-Guo Liu , Lei Hou , Xue Pan , Qiang Guo , Tao Zhou

We study binary classification algorithms for which the prediction on any point is not too sensitive to individual examples in the dataset. Specifically, we consider the notions of uniform stability (Bousquet and Elisseeff, 2001) and…

Machine Learning · Computer Science 2020-09-24 Yuval Dagan , Vitaly Feldman

Rankings play a crucial role in decision-making. However, if minor changes to items significantly alter their rankings, the quality of the decisions being made can be compromised. The stability of ranking is a measure used to assess how…

Databases · Computer Science 2026-03-11 Felix S. Campbell , Yuval Moskovitch

Discrete stability extends the classical notion of stability to random elements in discrete spaces by defining a scaling operation in a randomised way: an integer is transformed into the corresponding binomial distribution. Similarly…

Probability · Mathematics 2011-08-10 Youri Davydov , Ilya Molchanov , Sergei Zuyev

We propose and investigate probabilistic guarantees for the adversarial robustness of classification algorithms. While traditional formal verification approaches for robustness are intractable and sampling-based approaches do not provide…

Machine Learning · Computer Science 2025-11-11 Peter Blohm , Patrick Indri , Thomas Gärtner , Sagar Malhotra

In many matching markets--such as athlete recruitment or academic admissions--participants on one side are evaluated by attribute vectors known to the other side, which in turn applies individual \emph{salience vectors} to assign relative…

Computer Science and Game Theory · Computer Science 2026-02-05 Amit Ronen , S. S. Ravi , Sarit Kraus