English
Related papers

Related papers: Robust Piecewise-Constant Smoothing: M-Smoother Re…

200 papers

Piecewise constant denoising can be solved either by deterministic optimization approaches, based on the Potts model, or by stochastic Bayesian procedures. The former lead to low computational time but require the selection of a…

Machine Learning · Computer Science 2017-10-11 Jordan Frecon , Nelly Pustelnik , Nicolas Dobigeon , Herwig Wendt , Patrice Abry

In this article we consider recursive approximations of the smoothing distribution associated to partially observed stochastic differential equations (SDEs), which are observed discretely in time. Such models appear in a wide variety of…

Methodology · Statistics 2018-05-15 Jeremie Houssineau , Ajay Jasra , Sumeetpal S. Singh

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

This paper presents a tensor multiplication based smoothing algorithm that follows a two step denoising method. Unlike other traditional averaging approaches, our approach uses an element based normal voting tensor to compute smooth…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 S. K. Yadav , U. Reitebuch , K. Polthier

We study the algorithmic problem of robust mean estimation of an identity covariance Gaussian in the presence of mean-shift contamination. In this contamination model, we are given a set of points in $\mathbb{R}^d$ generated i.i.d. via the…

Data Structures and Algorithms · Computer Science 2025-02-21 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Thanasis Pittas

The problem of Bayesian filtering and smoothing in nonlinear models with additive noise is an active area of research. Classical Taylor series as well as more recent sigma-point based methods are two well-known strategies to deal with these…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-02 Fatemeh Yaghoobi , Adrien Corenflos , Sakira Hassan , Simo Särkkä

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

Information retrieval (IR) systems traditionally aim to maximize metrics built on rankings, such as precision or NDCG. However, the non-differentiability of the ranking operation prevents direct optimization of such metrics in…

Information Retrieval · Computer Science 2021-05-04 Thibaut Thonet , Yagmur Gizem Cinar , Eric Gaussier , Minghan Li , Jean-Michel Renders

In this paper, we propose an interesting semi-sparsity smoothing algorithm based on a novel sparsity-inducing optimization framework. This method is derived from the multiple observations that semi-sparsity prior knowledge is more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Junqing Huang , Haihui Wang , Xuechao Wang , Michael Ruzhansky

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

We give an efficient algorithm for robustly clustering of a mixture of two arbitrary Gaussians, a central open problem in the theory of computationally efficient robust estimation, assuming only that the the means of the component Gaussians…

Data Structures and Algorithms · Computer Science 2020-06-02 He Jia , Santosh Vempala

To estimate the smoothing distribution in a nonlinear state space model, we apply the conditional particle filter with ancestor sampling. This gives an iterative algorithm in a Markov chain Monte Carlo fashion, with asymptotic convergence…

Computation · Statistics 2015-09-17 Andreas Svensson , Thomas B. Schön , Manon Kok

We propose a smooth regularization technique that instills a strong temporal inductive bias in video recognition models, particularly benefiting lightweight architectures. Our method encourages smoothness in the intermediate-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Gil Goldman , Raja Giryes , Mahadev Satyanarayanan

We propose a new class of robust and Fisher-consistent estimators for mixture models. These estimators can be used to construct robust model-based clustering procedures. We study in detail the case of multivariate normal mixtures and…

Methodology · Statistics 2021-06-09 Juan D. Gonzalez , Ricardo Maronna , Victor J. Yohai , Ruben H. Zamar

We present a static analysis for discovering differentiable or more generally smooth parts of a given probabilistic program, and show how the analysis can be used to improve the pathwise gradient estimator, one of the most popular methods…

Programming Languages · Computer Science 2022-11-15 Wonyeol Lee , Xavier Rival , Hongseok Yang

Many industrial and engineering processes monitored as times series have smooth trends that indicate normal behavior and occasionally anomalous patterns that can indicate a problem. This kind of behavior can be modeled by a smooth trend,…

Methodology · Statistics 2024-08-07 Matthew Hofkes , Douglas Nychka , Tzahi Cath , Amanda Hering , Craig McGonagill

Optimising a ranking-based metric, such as Average Precision (AP), is notoriously challenging due to the fact that it is non-differentiable, and hence cannot be optimised directly using gradient-descent methods. To this end, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Andrew Brown , Weidi Xie , Vicky Kalogeiton , Andrew Zisserman

A Riemannian geometric framework for Markov chain Monte Carlo (MCMC) is developed where using the Fisher-Rao metric on the manifold of probability density functions (pdfs), informed proposal densities for Metropolis-Hastings (MH) algorithms…

Methodology · Statistics 2024-11-08 Vivekananda Roy

Automated algorithm selection for continuous black-box optimization depends on representing problem information under limited probing and selecting solvers under heavy-tailed performance distributions. This paper proposes a geometric…

Machine Learning · Computer Science 2026-05-22 Jiabao Brad Wang , Xiang Shi , Yiliang Yuan , Mustafa Misir

We consider a coupled model of free-flow and porous medium flow, governed by stationary Stokes and Darcy flow, respectively. The coupling between the two systems is enforced by introducing a single variable representing the normal flux…

Numerical Analysis · Mathematics 2022-09-28 Wietse M. Boon