English
Related papers

Related papers: Parametric inference in the large data limit using…

200 papers

The interdependence and high dimensionality of multivariate signals present significant challenges for denoising, as conventional univariate methods often struggle to capture the complex interactions between variables. A successful approach…

Machine Learning · Computer Science 2024-07-29 Jaesung Choi , Pilwon Kim

This document presents the statistical methods used to process low-level measurements in the presence of noise. These methods can be classical or Bayesian. The question is placed in the general framework of the problem of nuisance…

Instrumentation and Detectors · Physics 2024-03-20 Guillaume Manificat , Salima Helali , Patrick Bouisset

It is often of interest to assess whether a function-valued statistical parameter, such as a density function or a mean regression function, is equal to any function in a class of candidate null parameters. This can be framed as a…

Methodology · Statistics 2023-06-14 Aaron Hudson

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

In the uniform deconvolution problem one is interested in estimating the distribution function $F_0$ of a nonnegative random variable, based on a sample with additive uniform noise. A peculiar and not well understood phenomenon of the…

Statistics Theory · Mathematics 2025-04-25 Piet Groeneboom , Geurt Jongbloed

In this paper, sensor selection problems for target tracking in large sensor networks with linear equality or inequality constraints are considered. First, we derive an equivalent Kalman filter for sensor selection, i.e., generalized…

Optimization and Control · Mathematics 2023-07-19 Xiaojing Shen , Pramod K. Varshney

We investigate statistical properties of a likelihood approach to nonparametric estimation of a singular distribution using deep generative models. More specifically, a deep generative model is used to model high-dimensional data that are…

Machine Learning · Statistics 2023-03-29 Minwoo Chae , Dongha Kim , Yongdai Kim , Lizhen Lin

Inferring dynamical models from low-resolution temporal data continues to be a significant challenge in biophysics, especially within transcriptomics, where separating molecular programs from noise remains an important open problem. We…

Machine Learning · Computer Science 2023-10-05 Victor Chardès , Suryanarayana Maddu , Michael J. Shelley

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani

Multi-sensor state space models underpin fusion applications in networks of sensors. Estimation of latent parameters in these models has the potential to provide highly desirable capabilities such as network self-calibration. Conventional…

Systems and Control · Computer Science 2018-01-04 Murat Uney , Bernard Mulgrew , Daniel E Clark

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Deep neural networks have shown promise for music audio signal processing applications, often surpassing prior approaches, particularly as end-to-end models in the waveform domain. Yet results to date have tended to be constrained by low…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 William Mitchell , Scott H. Hawley

Machine learning and statistics typically focus on building models that capture the vast majority of the data, possibly ignoring a small subset of data as "noise" or "outliers." By contrast, here we consider the problem of jointly…

Machine Learning · Computer Science 2016-08-19 Brendan Juba

Randomized experiments on a network often involve interference between connected units; i.e., a situation in which an individual's treatment can affect the response of another individual. Current approaches to deal with interference, in…

Methodology · Statistics 2017-05-17 Guillaume Basse , Edoardo Airoldi

This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference…

Methodology · Statistics 2024-04-09 Shijie Cui , Xu Guo , Zhe Zhang

We consider the problem of inferring the interactions between a set of N binary variables from the knowledge of their frequencies and pairwise correlations. The inference framework is based on the Hopfield model, a special case of the Ising…

Statistical Mechanics · Physics 2015-05-27 Simona Cocco , Remi Monasson , Vitor Sessak

Likelihood-free inference is quickly emerging as a powerful tool to perform fast/effective parameter estimation. We demonstrate a technique of optimizing likelihood-free inference to make it even faster by marginalizing symmetries in a…

Machine Learning · Computer Science 2023-12-14 Deep Chatterjee , Philip C. Harris , Maanas Goel , Malina Desai , Michael W. Coughlin , Erik Katsavounidis

The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the…

Statistics Theory · Mathematics 2022-11-28 Junichiro Yoshida , Nakahiro Yoshida

We present a formulation of deep learning that aims at producing a large margin classifier. The notion of margin, minimum distance to a decision boundary, has served as the foundation of several theoretically profound and empirically…

Machine Learning · Statistics 2018-12-05 Gamaleldin F. Elsayed , Dilip Krishnan , Hossein Mobahi , Kevin Regan , Samy Bengio

We consider the problem of pointwise estimation of multi-dimensional signals $s$, from noisy observations $(y_\tau)$ on the regular grid $\bZd$. Our focus is on the adaptive estimation in the case when the signal can be well recovered using…

Statistics Theory · Mathematics 2008-09-05 Anatoli Juditsky , Arkadii S. Nemirovski