English
Related papers

Related papers: Minimax Optimal Estimation of Stability Under Dist…

200 papers

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

Optimal algorithms are developed for robust detection of changes in non-stationary processes. These are processes in which the distribution of the data after change varies with time. The decision-maker does not have access to precise…

Methodology · Statistics 2025-05-14 Yingze Hou , Yousef Oleyaeimotlagh , Rahul Mishra , Hoda Bidkhori , Taposh Banerjee

A distribution shift can have fundamental consequences such as signaling a change in the operating environment or significantly reducing the accuracy of downstream models. Thus, understanding distribution shifts is critical for examining…

Machine Learning · Computer Science 2023-06-21 Sean Kulinski , David I. Inouye

In computing, as in many aspects of life, changes incur cost. Many optimization problems are formulated as a one-time instance starting from scratch. However, a common case that arises is when we already have a set of prior assignments, and…

Data Structures and Algorithms · Computer Science 2013-02-11 Edith Cohen , Graham Cormode , Nick Duffield , Carsten Lund

A rich line of recent work has studied distributionally robust learning approaches that seek to learn a hypothesis that performs well, in the worst-case, on many different distributions over a population. We argue that although the most…

Machine Learning · Computer Science 2024-05-10 Jabari Hastings , Christopher Jung , Charlotte Peale , Vasilis Syrgkanis

We propose an algorithm to restrict the switching signals of a constrained switched system in order to guarantee its stability, while at the same time attempting to keep the largest possible set of allowed switching signals. Our work is…

Optimization and Control · Mathematics 2018-09-11 Cláudio Gomes , Raphaël M. Jungers , Benoît Legat , Hans Vangheluwe

Experimental designs that are minimax in the presence of model misspecifications have been constructed so as to minimize the maximum, over classes of alternate response models, of the integrated mean squared error of the predicted values.…

Statistics Theory · Mathematics 2026-04-27 Rui Hu , Douglas P. Wiens

Transfer learning is essential when sufficient data comes from the source domain, with scarce labeled data from the target domain. We develop estimators that achieve minimax linear risk for linear regression problems under distribution…

Machine Learning · Computer Science 2021-06-24 Qi Lei , Wei Hu , Jason D. Lee

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

We consider the problem of optimizing the steady state of a dynamical system in closed loop. Conventionally, the design of feedback optimization control laws assumes that the system is stationary. However, in reality, the dynamics of the…

Optimization and Control · Mathematics 2020-05-11 Sandeep Menta , Adrian Hauswirth , Saverio Bolognani , Gabriela Hug , Florian Dörfler

Theory and algorithms are developed for detecting changes in the distribution of statistically periodic random processes. The statistical periodicity is modeled using independent and periodically identically distributed processes, a new…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Taposh Banerjee , Prudhvi Gurram , Gene Whipps

The class of $\alpha$-stable distributions is widely used in various applications, especially for modelling heavy-tailed data. Although the $\alpha$-stable distributions have been used in practice for many years, new methods for…

Methodology · Statistics 2022-12-29 Kewin Pączek , Damian Jelito , Marcin Pitera , Agnieszka Wyłomańska

We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Stability against changes in data distribution is an important mandate for responsible deployment of models. The domain…

Machine Learning · Computer Science 2021-01-26 Harvineet Singh , Rina Singh , Vishwali Mhasawade , Rumi Chunara

We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

Owing to their inherently interpretable structure, decision trees are commonly used in applications where interpretability is essential. Recent work has focused on improving various aspects of decision trees, including their predictive…

Machine Learning · Statistics 2023-05-30 Dimitris Bertsimas , Vassilis Digalakis

Stability perserving is an important topic in approximation of systems, e.g.\ model reduction. If the original system is stable, we often want the approximation to be stable. But even if an algorithm preserves stability the resulting system…

Optimization and Control · Mathematics 2012-08-02 Marcus Köhler

Research in machine learning is making progress in fixing its own reproducibility crisis. Reinforcement learning (RL), in particular, faces its own set of unique challenges. Comparison of point estimates, and plots that show successful…

Machine Learning · Computer Science 2024-02-07 Ted Fujimoto , Joshua Suetterlein , Samrat Chatterjee , Auroop Ganguly

This paper considers structural optimization under a reliability constraint, where the input distribution is only partially known. Specifically, when we only know that the expected value vector and the variance-covariance matrix of the…

Optimization and Control · Mathematics 2022-12-19 Yoshihiro Kanno

Robustness to natural distribution shifts has seen remarkable progress thanks to recent pre-training strategies combined with better fine-tuning methods. However, such fine-tuning assumes access to large amounts of labelled data, and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aaditya Singh , Kartik Sarangmath , Prithvijit Chattopadhyay , Judy Hoffman

Distributed control, as a potential solution to decreasing communication demands in microgrids, has drawn much attention in recent years. Advantages of distributed control have been extensively discussed, while its impacts on microgrid…

Systems and Control · Computer Science 2018-09-11 Yimajian Yan , Di Shi , Desong Bian , Bibin Huang , Zhehan Yi , Zhiwei Wang