English
Related papers

Related papers: Robust Sequential Change-Point Detection by Convex…

200 papers

We introduce a framework for online changepoint detection and simultaneous model learning which is applicable to highly parametrized models, such as deep neural networks. It is based on detecting changepoints across time by sequentially…

Machine Learning · Computer Science 2020-10-08 Michalis K. Titsias , Jakub Sygnowski , Yutian Chen

We consider a distributionally robust stochastic optimization problem and formulate it as a stochastic two-level composition optimization problem with the use of the mean--semideviation risk measure. In this setting, we consider a single…

Optimization and Control · Mathematics 2023-06-12 Landi Zhu , Mert Gürbüzbalaban , Andrzej Ruszczyński

We propose an algorithm for change point monitoring in linear causal models that accounts for interventions. Through a special centralization technique, we can concentrate the changes arising from causal propagation across nodes into a…

Machine Learning · Statistics 2025-06-10 Haijie Xu , Chen Zhang

Robustness to natural distribution shifts has seen remarkable progress thanks to recent pre-training strategies combined with better fine-tuning methods. However, such fine-tuning assumes access to large amounts of labelled data, and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aaditya Singh , Kartik Sarangmath , Prithvijit Chattopadhyay , Judy Hoffman

This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions,…

Methodology · Statistics 2022-07-08 Amir Hossein Abolmasoumi , Marcos Netto , Lamine Mili

Automated analysis of complex systems based on multiple readouts remains a challenge. Change point detection algorithms are aimed to locating abrupt changes in the time series behaviour of a process. In this paper, we present a novel change…

Machine Learning · Computer Science 2023-10-05 Artem Ryzhikov , Mikhail Hushchyn , Denis Derkach

The paper algorithmizes the problem of regime change point identification for data measured in a system exhibiting impulsive behaviors. This is a fundamental challenge for annotation of measurement data relevant, e.g., for designing…

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

Rapid detection of spatial events that propagate across a sensor network is of wide interest in many modern applications. In particular, in communications, radar, IoT, environmental monitoring, and biosurveillance, we may observe…

Statistics Theory · Mathematics 2023-01-18 Topi Halme , Eyal Nitzan , Visa Koivunen

This paper considers robust Markov decision processes under parametric transition distributions. We assume that the true transition distribution is uniquely specified by some parametric distribution, and explicitly enforce that the…

Optimization and Control · Mathematics 2022-11-24 Ben Black , Trivikram Dokka , Christopher Kirkbride

We consider stochastic programs where the distribution of the uncertain parameters is only observable through a finite training dataset. Using the Wasserstein metric, we construct a ball in the space of (multivariate and non-discrete)…

Optimization and Control · Mathematics 2017-06-14 Peyman Mohajerin Esfahani , Daniel Kuhn

The non-convexity and intractability of distributionally robust chance constraints make them challenging to cope with. From a data-driven perspective, we propose formulating it as a robust optimization problem to ensure that the…

Optimization and Control · Mathematics 2023-06-23 Zhiping Chen , Wentao Ma , Bingbing Ji

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

A ubiquitous feature of data of our era is their extra-large sizes and dimensions. Analyzing such high-dimensional data poses significant challenges, since the feature dimension is often much larger than the sample size. This thesis…

Statistics Theory · Mathematics 2025-09-11 Kai Yang

We present a convex approach to probabilistic segmentation and modeling of time series data. Our approach builds upon recent advances in multivariate total variation regularization, and seeks to learn a separate set of parameters for the…

Machine Learning · Statistics 2015-11-17 Matt Wytock , J. Zico Kolter

This paper considers continuous-time coordination algorithms for networks of agents that seek to collectively solve a general class of nonsmooth convex optimization problems with an inherent distributed structure. Our algorithm design…

Optimization and Control · Mathematics 2017-05-17 Simon K. Niederländer , Jorge Cortés

Visual place recognition is challenging because there are so many factors that can cause the appearance of a place to change, from day-night cycles to seasonal change to atmospheric conditions. In recent years a large range of approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Sourav Garg , Ben Harwood , Gaurangi Anand , Michael Milford

We consider the problem of quickest change-point detection in data streams. Classical change-point detection procedures, such as CUSUM, Shiryaev-Roberts and Posterior Probability statistics, are optimal only if the change-point model is…

Machine Learning · Statistics 2017-06-13 Denis Volkhonskiy , Ilia Nouretdinov , Alexander Gammerman , Vladimir Vovk , Evgeny Burnaev

This paper studies Markov Decision Processes under parameter uncertainty. We adapt the distributionally robust optimization framework, and assume that the uncertain parameters are random variables following an unknown distribution, and…

Systems and Control · Computer Science 2015-05-14 Pengqian Yu , Huan Xu

This paper considers the detection of change points in parallel data streams, a problem widely encountered when analyzing large-scale real-time streaming data. Each stream may have its own change point, at which its data has a…

Methodology · Statistics 2023-01-18 Zexian Lu , Yunxiao Chen , Xiaoou Li