English
Related papers

Related papers: Stability and Accuracy Trade-offs in Statistical E…

200 papers

Two-sided matching markets describe a large class of problems wherein participants from one side of the market must be matched to those from the other side according to their preferences. In many real-world applications (e.g. content…

Computer Science and Game Theory · Computer Science 2024-10-16 Hadi Hosseini , Sanjukta Roy , Duohan Zhang

Standard stochastic optimization methods are brittle, sensitive to stepsize choices and other algorithmic parameters, and they exhibit instability outside of well-behaved families of objectives. To address these challenges, we investigate…

Optimization and Control · Mathematics 2022-06-08 Hilal Asi , John C. Duchi

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada

In online learning from non-stationary data streams, it is necessary to learn robustly to outliers and to adapt quickly to changes in the underlying data generating mechanism. In this paper, we refer to the former attribute of online…

Machine Learning · Statistics 2021-09-29 Shintaro Fukushima , Atsushi Nitanda , Kenji Yamanishi

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

Federated learning is a distributed learning paradigm where multiple agents, each only with access to local data, jointly learn a global model. There has recently been an explosion of research aiming not only to improve the accuracy rates…

Computer Science and Game Theory · Computer Science 2021-06-18 Kate Donahue , Jon Kleinberg

In the {\sc Course Allocation} problem, there are a set of students and a set of courses at a given university. University courses may have different numbers of credits, typically related to different numbers of learning hours, and there…

Data Structures and Algorithms · Computer Science 2026-01-27 José Rodríguez , David Manlove

Algorithms of control of differential equations solutions are under investigation in the article. Idealized and real modifications of the algorithms are distinguished. An equation, which can be the base equation for investigation of the…

Numerical Analysis · Computer Science 2016-01-05 Yu. V. Troshchiev

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We study graphs and two-player games in which rewards are assigned to states, and the goal of the players is to satisfy or dissatisfy certain property of the generated outcome, given as a mean payoff property. Since the notion of…

Logic in Computer Science · Computer Science 2016-04-22 Tomáš Brázdil , Vojtěch Forejt , Antonín Kučera , Petr Novotný

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

Machine Learning · Statistics 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

Exponential generalization bounds with near-tight rates have recently been established for uniformly stable learning algorithms. The notion of uniform stability, however, is stringent in the sense that it is invariant to the data-generating…

Machine Learning · Statistics 2022-06-09 Xiao-Tong Yuan , Ping Li

In this work, we show that for all statistical estimation problems, a natural MMSE instability (discontinuity) condition implies the failure of stable algorithms, serving as a version of OGP for estimation tasks. Using this criterion, we…

Statistics Theory · Mathematics 2026-03-24 Xifan Yu , Ilias Zadik

While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal)…

Machine Learning · Computer Science 2022-06-28 Yujia Bao , Shiyu Chang , Regina Barzilay

The existence of instabilities, for example in the form of adversarial examples, has given rise to a highly active area of research concerning itself with understanding and enhancing the stability of neural networks. We focus on a popular…

Numerical Analysis · Mathematics 2025-10-28 Matthias J. Ehrhardt , Davide Murari , Ferdia Sherry

Dynamic response of loads has a significant effect on system stability and directly determines the stability margin of the operating point. Inherent uncertainty and natural variability of load models make the stability assessment especially…

Systems and Control · Computer Science 2015-04-15 Hung D. Nguyen , Konstantin Turitsyn

Large-scale, two-sided matching platforms must find market outcomes that align with user preferences while simultaneously learning these preferences from data. Classical notions of stability (Gale and Shapley, 1962; Shapley and Shubik,…

Machine Learning · Computer Science 2023-02-02 Meena Jagadeesan , Alexander Wei , Yixin Wang , Michael I. Jordan , Jacob Steinhardt

In this paper we consider stable matchings subject to assignment constraints. These are matchings that require certain assigned pairs to be included, insist that some other assigned pairs are not, and, importantly, are stable. Our main…

Theoretical Economics · Economics 2024-06-14 Gregory Gutin , Philip R. Neary , Anders Yeo

We identify a trade-off between robustness and accuracy that serves as a guiding principle in the design of defenses against adversarial examples. Although this problem has been widely studied empirically, much remains unknown concerning…

Machine Learning · Computer Science 2019-06-25 Hongyang Zhang , Yaodong Yu , Jiantao Jiao , Eric P. Xing , Laurent El Ghaoui , Michael I. Jordan

Algorithmic robustness refers to the sustained performance of a computational system in the face of change in the nature of the environment in which that system operates or in the task that the system is meant to perform. Below, we motivate…

Artificial Intelligence · Computer Science 2023-11-14 David Jensen , Brian LaMacchia , Ufuk Topcu , Pamela Wisniewski