English
Related papers

Related papers: Robust Quickest Change Detection in Non-Stationary…

200 papers

In sustained growth with random dynamics stationary distributions can exist without detailed balance. This suggests thermodynamical behavior in fast growing complex systems. In order to model such phenomena we apply both a discrete and a…

Statistical Mechanics · Physics 2017-03-22 Tamás Biró , Zoltán Néda

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

Machine Learning · Statistics 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

Distributed optimization algorithms have been studied extensively in the literature; however, underlying most algorithms is a linear consensus scheme, i.e. averaging variables from neighbors via doubly stochastic matrices. We consider…

Optimization and Control · Mathematics 2023-03-14 Hsu Kao , Vijay Subramanian

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

Machine Learning · Computer Science 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

Information in the time distribution of points in a state space reconstructed from observed data yields a test for ``nonstationarity''. Framed in terms of a statistical hypothesis test, this numerical algorithm can discern whether some…

chao-dyn · Physics 2008-02-03 Matthew B. Kennel

The problem of sequentially detecting a moving anomaly which affects different parts of a sensor network with time is studied. Each network sensor is characterized by a non-anomalous and anomalous distribution, governing the generation of…

Statistics Theory · Mathematics 2020-07-30 Georgios Rovatsos , George V. Moustakides , Venugopal V. Veeravalli

In this paper a class of optimization problems with uncertain linear constraints is discussed. It is assumed that the constraint coefficients are random vectors whose probability distributions are only partially known. Possibility theory is…

Optimization and Control · Mathematics 2021-11-30 Romain Guillaume , Adam Kasperski , Pawel Zielinski

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

Machine Learning · Computer Science 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

Robustness in AI systems refers to their ability to maintain reliable and accurate performance under various conditions, including out-of-distribution (OOD) samples, adversarial attacks, and environmental changes. This is crucial in…

Artificial Intelligence · Computer Science 2025-10-15 Wissam Salhab , Darine Ameyed , Hamid Mcheick , Fehmi Jaafar

We consider offline reinforcement learning (RL) methods in possibly nonstationary environments. Many existing RL algorithms in the literature rely on the stationarity assumption that requires the system transition and the reward function to…

Machine Learning · Statistics 2025-01-07 Mengbing Li , Chengchun Shi , Zhenke Wu , Piotr Fryzlewicz

Algorithmic robustness refers to the sustained performance of a computational system in the face of change in the nature of the environment in which that system operates or in the task that the system is meant to perform. Below, we motivate…

Artificial Intelligence · Computer Science 2023-11-14 David Jensen , Brian LaMacchia , Ufuk Topcu , Pamela Wisniewski

We study the fundamental limits on learning latent community structure in dynamic networks. Specifically, we study dynamic stochastic block models where nodes change their community membership over time, but where edges are generated…

Machine Learning · Statistics 2016-07-20 Amir Ghasemian , Pan Zhang , Aaron Clauset , Cristopher Moore , Leto Peel

Machine learning models are often trained on data from one distribution and deployed on others. So it becomes important to design models that are robust to distribution shifts. Most of the existing work focuses on optimizing for either…

Machine Learning · Computer Science 2021-03-31 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy,…

Machine Learning · Computer Science 2020-02-26 Ayush Jain , Alon Orlitsky

The non-stationary evolution of observable quantities in complex systems can frequently be described as a juxtaposition of quasi-stationary spells. Given that standard theoretical and data analysis approaches usually rely on the assumption…

Statistical Mechanics · Physics 2011-10-18 S. Camargo , S. Duarte Queirós , C. Anteneodo

This paper presents a robust, distributed algorithm to solve general linear programs. The algorithm design builds on the characterization of the solutions of the linear program as saddle points of a modified Lagrangian function. We show…

Optimization and Control · Mathematics 2014-09-26 Dean Richert , Jorge Cortes

Information processing abilities of active matter are studied in the reservoir computing (RC) paradigm to infer the future state of a chaotic signal. We uncover an exceptional regime of agent dynamics that has been overlooked previously. It…

Adaptation and Self-Organizing Systems · Physics 2026-01-26 Mario U. Gaimann , Miriam Klopotek

AI applications are becoming increasingly visible to the general public. There is a notable gap between the theoretical assumptions researchers make about computer vision models and the reality those models face when deployed in the real…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Eashan Adhikarla , Kai Zhang , Jun Yu , Lichao Sun , John Nicholson , Brian D. Davison

Conditional estimation given specific covariate values (i.e., local conditional estimation or functional estimation) is ubiquitously useful with applications in engineering, social and natural sciences. Existing data-driven non-parametric…

Machine Learning · Statistics 2020-10-13 Viet Anh Nguyen , Fan Zhang , Jose Blanchet , Erick Delage , Yinyu Ye