English
Related papers

Related papers: Template Matching and Change Point Detection by M-…

200 papers

We present new algorithms for $M$-estimators of multivariate scatter and location and for symmetrized $M$-estimators of multivariate scatter. The new algorithms are considerably faster than currently used fixed-point and related algorithms.…

Computation · Statistics 2015-12-10 Lutz Duembgen , Klaus Nordhausen , Heike Schuhmacher

Estimators derived from a divergence criterion such as $\varphi-$divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called MD$\varphi$DE, an estimator built using a dual…

Computation · Statistics 2016-06-14 Diaa Al Mohamad , Michel Broniatowski

We study asymptotic properties of $M$-estimates of regression parameters in linear models in which errors are dependent. Weak and strong Bahadur representations of the $M$-estimates are derived and a central limit theorem is established.…

Statistics Theory · Mathematics 2009-09-29 Wei Biao Wu

In small area estimation different data sources are integrated in order to produce reliable estimates of target parameters (e.g., a mean or a proportion) for a collection of small subsets (areas) of a finite population. Regression models…

Methodology · Statistics 2024-05-31 Enrico Fabrizi , Nicola Salvati , Martin Slawski

Transition Matching (TM) is an emerging paradigm for generative modeling that generalizes diffusion and flow-matching models as well as continuous-state autoregressive models. TM, similar to previous paradigms, gradually transforms noise…

Machine Learning · Computer Science 2025-12-16 Uriel Singer , Yaron Lipman

In this paper, we establish optimal rates of adaptive estimation of a vector in the multi-reference alignment model, a problem with important applications in fields such as signal processing, image processing, and computer vision, among…

Statistics Theory · Mathematics 2018-05-22 Afonso S. Bandeira , Philippe Rigollet , Jonathan Weed

We observe a $n$-sample, the distribution of which is assumed to belong, or at least to be close enough, to a given mixture model. We propose an estimator of this distribution that belongs to our model and possesses some robustness…

Statistics Theory · Mathematics 2025-02-06 Alexandre Lecestre

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

The joint estimation of means and scatter matrices is often a core problem in multivariate analysis. In order to overcome robustness issues, such as outliers from Gaussian assumption, M-estimators are now preferred to the traditional sample…

Signal Processing · Electrical Eng. & Systems 2019-01-24 Bruno Mériaux , Chengfang Ren , Mohammed Nabil El Korso , Arnaud Breloy , Philippe Forster

Using a time series model to mimic an observed time series has a long history. However, with regard to this objective, conventional estimation methods for discrete-time dynamical models are frequently found to be wanting. In fact, they are…

Statistics Theory · Mathematics 2015-03-19 Yingcun Xia , Howell Tong

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

We study the multivariate nonparametric change point detection problem, where the data are a sequence of independent $p$-dimensional random vectors whose distributions are piecewise-constant with Lipschitz densities changing at unknown…

Statistics Theory · Mathematics 2020-06-26 Oscar Hernan Madrid Padilla , Yi Yu , Daren Wang , Alessandro Rinaldo

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

We study the estimation error of constrained M-estimators, and derive explicit upper bounds on the expected estimation error determined by the Gaussian width of the constraint set. Both of the cases where the true parameter is on the…

Statistics Theory · Mathematics 2015-06-29 Yen-Huan Li , Ya-Ping Hsieh , Nissim Zerbib , Volkan Cevher

Changepoint models typically assume the data within each segment are independent and identically distributed conditional on some parameters which change across segments. This construction may be inadequate when data are subject to local…

Methodology · Statistics 2021-11-10 Karl L. Hallgren , Nicholas A. Heard , Niall M. Adams

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…

Information Theory · Computer Science 2010-10-13 Maxim Raginsky

Estimator algorithms in learning automata are useful tools for adaptive, real-time optimization in computer science and engineering applications. This paper investigates theoretical convergence properties for a special case of estimator…

Machine Learning · Computer Science 2012-09-28 Ryan Martin , Omkar Tilak

Regression problems are traditionally analyzed via univariate characteristics like the regression function, scale function and marginal density of regression errors. These characteristics are useful and informative whenever the association…

Statistics Theory · Mathematics 2008-12-18 Sam Efromovich

Asymptotic theory for M-estimation problems usually focuses on the asymptotic convergence of the sample descriptor, defined as the minimizer of the sample loss function. Here, we explore a related question and formulate asymptotic theory…

Statistics Theory · Mathematics 2024-11-15 Benjamin Eltzner

We introduce a robust and fully adaptive method for pointwise estimation in heteroscedastic regression. We allow for noise and design distributions that are unknown and fulfill very weak assumptions only. In particular, we do not impose…

Statistics Theory · Mathematics 2014-07-10 Michaël Chichignoud , Johannes Lederer