English
Related papers

Related papers: Regularized Tyler's Scatter Estimator: Existence, …

200 papers

In many estimation problems, e.g. linear and logistic regression, we wish to minimize an unknown objective given only unbiased samples of the objective function. Furthermore, we aim to achieve this using as few samples as possible. In the…

Machine Learning · Statistics 2015-02-26 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Notwithstanding the popularity of conventional clustering algorithms such as K-means and probabilistic clustering, their clustering results are sensitive to the presence of outliers in the data. Even a few outliers can compromise the…

Machine Learning · Statistics 2015-05-27 Pedro A. Forero , Vassilis Kekatos , Georgios B. Giannakis

Consider the Maximum Weight Independent Set problem for rectangles: given a family of weighted axis-parallel rectangles in the plane, find a maximum-weight subset of non-overlapping rectangles. The problem is notoriously hard both in the…

Data Structures and Algorithms · Computer Science 2016-11-22 Michał Pilipczuk , Erik Jan van Leeuwen , Andreas Wiese

Recent work on the mechanism of polymer crystallization has led to a proposal for the mechanism of thickness selection which differs from those proposed by the surface nucleation theory of Lauritzen and Hoffman and the entropic barrier…

Condensed Matter · Physics 2007-05-23 Jonathan Doye , Daan Frenkel

We study modeling and inference with the Elliptical Gamma Distribution (EGD). We consider maximum likelihood (ML) estimation for EGD scatter matrices, a task for which we develop new fixed-point algorithms. Our algorithms are efficient and…

Computation · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra , Lucas Theis , Matthias Bethge

Sufficient dimension reduction methods often require stringent conditions on the joint distribution of the predictor, or, when such conditions are not satisfied, rely on marginal transformation or reweighting to fulfill them approximately.…

Statistics Theory · Mathematics 2009-04-27 Bing Li , Yuexiao Dong

Nonlinear estimation in robotics and vision is typically plagued with outliers due to wrong data association, or to incorrect detections from signal processing and machine learning methods. This paper introduces two unifying formulations…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Pasquale Antonante , Vasileios Tzoumas , Heng Yang , Luca Carlone

We propose and investigate a new estimation method for the parameters of models consisting of smooth density functions on the positive half axis. The procedure is based on a recently introduced characterization result for the respective…

Statistics Theory · Mathematics 2021-06-16 Steffen Betsch , Bruno Ebner , Bernhard Klar

Designing scalable estimation algorithms is a core challenge in modern statistics. Here we introduce a framework to address this challenge based on parallel approximants, which yields estimators with provable properties that operate on the…

Methodology · Statistics 2023-08-04 Aritra Chakravorty , William S. Cleveland , Patrick J. Wolfe

Empirical risk minimization stands behind most optimization in supervised machine learning. Under this scheme, labeled data is used to approximate an expected cost (risk), and a learning algorithm updates model-defining parameters in search…

Machine Learning · Statistics 2023-05-25 James Schmidt

Rapidly decreasing tempered stable distributions are useful models for financial applications. However, there has been no exact method for simulation available in the literature. We remedy this by introducing an exact simulation method in…

Probability · Mathematics 2021-02-09 Michael Grabchak

A counterexample to uniqueness of global minimizers of semilinear optimal control problems is given. The lack of uniqueness occurs for a special choice of the state-target in the cost functional. Our arguments show also that, for some…

Optimization and Control · Mathematics 2020-12-29 Dario Pighin

Assumptions on a likelihood function, including a local Glivenko-Cantelli condition, imply the existence of M-estimators converging to an M-functional. Scatter matrix-valued estimators, defined on all empirical measures on ${\Bbb{R}}^d$ for…

Statistics Theory · Mathematics 2007-06-13 R. M. Dudley

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

Machine Learning · Computer Science 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

In this article we prove a regularization by noise phenomenon for the energy-critical and mass-critical nonlinear Schr\"odinger equations. We show that for any deterministic data, the probability that the corresponding solution exists…

Analysis of PDEs · Mathematics 2025-05-09 Martin Spitz , Deng Zhang , Zhenqi Zhao

The main theme of this paper is a modification of the likelihood ratio test (LRT) for testing high dimensional covariance matrix. Recently, the correct asymptotic distribution of the LRT for a large-dimensional case (the case $p/n$…

Methodology · Statistics 2019-04-16 Young-Geun Choi , Chi Tim Ng , Johan Lim

The increasing availability of sensing techniques provides a great opportunity for engineers to design state estimation methods, which are optimal for the system under observation and the observed noise patterns. However, these patterns…

Systems and Control · Electrical Eng. & Systems 2023-06-19 Jean-Sébastien Brouillon , Florian Dörfler , Giancarlo Ferrari-Trecate

This paper presents the main features of a system that aims to transform regular expressions into shorter equivalent expressions. The system is also capable of computing other operations useful for simplification, such as checking the…

Symbolic Computation · Computer Science 2023-07-14 Baudouin Le Charlier

In many important statistical applications, the number of variables or parameters $p$ is much larger than the number of observations $n$. Suppose then that we have observations $y=X\beta+z$, where $\beta\in\mathbf{R}^p$ is a parameter…

Statistics Theory · Mathematics 2009-09-29 Emmanuel Candes , Terence Tao