English
Related papers

Related papers: Exponential Family Trend Filtering on Lattices

200 papers

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

Uncertainty awareness is crucial to develop reliable machine learning models. In this work, we propose the Natural Posterior Network (NatPN) for fast and high-quality uncertainty estimation for any task where the target distribution belongs…

Machine Learning · Computer Science 2022-03-17 Bertrand Charpentier , Oliver Borchert , Daniel Zügner , Simon Geisler , Stephan Günnemann

Evolutionary Strategies (ES) are a popular family of black-box zeroth-order optimization algorithms which rely on search distributions to efficiently optimize a large variety of objective functions. This paper investigates the potential…

Neural and Evolutionary Computing · Computer Science 2019-02-01 Louis Faury , Clement Calauzenes , Olivier Fercoq , Syrine Krichen

The paper considers causal smoothing of the real sequences, i.e.,discrete time processes in a deterministic setting. A family of causal linear time-invariant filters is suggested. These filters approximate the gain decay for some non-causal…

Optimization and Control · Mathematics 2015-07-07 Nikolai Dokuchaev

Exponential-family random network (ERN) models specify a joint representation of both the dyads of a network and nodal characteristics. This class of models allow the nodal characteristics to be modelled as stochastic processes, expanding…

Methodology · Statistics 2013-03-07 Ian E. Fellows , Mark S. Handcock

Forecasting with multivariate time series, which aims to predict future values given previous and current several univariate time series data, has been studied for decades, with one example being ARIMA. Because it is difficult to measure…

Artificial Intelligence · Computer Science 2020-10-19 Youngjin Park , Deokjun Eom , Byoungki Seo , Jaesik Choi

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

Statistics Theory · Mathematics 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

In high-dimensional statistics, the Lasso is a cornerstone method for simultaneous variable selection and parameter estimation. However, its reliance on the squared loss function renders it highly sensitive to outliers and heavy-tailed…

Machine Learning · Statistics 2025-11-20 The Tien Mai

In this paper, we introduce a new adaptive data analysis method to study trend and instantaneous frequency of nonlinear and non-stationary data. This method is inspired by the Empirical Mode Decomposition method (EMD) and the recently…

Numerical Analysis · Mathematics 2012-02-28 Thomas Y. hou , Zuoqiang Shi

Fitting a graphical model to a collection of random variables given sample observations is a challenging task if the observed variables are influenced by latent variables, which can induce significant confounding statistical dependencies…

Machine Learning · Statistics 2020-10-20 Armeen Taeb , Parikshit Shah , Venkat Chandrasekaran

Bayesian estimation is a vital tool in robotics as it allows systems to update the robot state belief using incomplete information from noisy sensors. To render the state estimation problem tractable, many systems assume that the motion and…

Robotics · Computer Science 2025-01-13 Miguel Saavedra-Ruiz , Steven A. Parkison , Ria Arora , James Richard Forbes , Liam Paull

Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. Each iteration of TMLE involves fitting a parametric submodel that targets the parameter of interest. We…

Methodology · Statistics 2014-06-03 Iván Díaz , Michael Rosenblum

Several numerical tools designed to overcome the challenges of smoothing in a nonlinear and non-Gaussian setting are investigated for a class of particle smoothers. The considered family of smoothers is induced by the class of linear…

Numerical Analysis · Mathematics 2019-10-29 Jana de Wiljes , Sahani Pathiraja , Sebastian Reich

We first consider the sequential detection of transient signals by generalizing the moving average chart to exponential family and study the false detection probability (FDP) and power of detection (POD) in the steady state. Then windowed…

Statistics Theory · Mathematics 2022-06-24 Yanhong Wu

Time series forecasting presents significant challenges in real-world applications across various domains. Building upon the decomposition of the time series, we enhance the architecture of machine learning models for better multivariate…

Machine Learning · Computer Science 2026-02-24 Sanjeev Panta , Xu Yuan , Li Chen , Nian-Feng Tzeng

Time series forecasting is an active research topic in academia as well as industry. Although we see an increasing amount of adoptions of machine learning methods in solving some of those forecasting challenges, statistical methods remain…

Computation · Statistics 2021-01-26 Edwin Ng , Zhishi Wang , Huigang Chen , Steve Yang , Slawek Smyl

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

We propose an algorithm for taming Normalizing Flow models - changing the probability that the model will produce a specific image or image category. We focus on Normalizing Flows because they can calculate the exact generation probability…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Shimon Malnick , Shai Avidan , Ohad Fried

The link with exponential families has allowed $k$-means clustering to be generalized to a wide variety of data generating distributions in exponential families and clustering distortions among Bregman divergences. Getting the framework to…

Machine Learning · Computer Science 2022-11-08 Ehsan Amid , Richard Nock , Manfred Warmuth

When signals are measured through physical sensors, they are perturbed by noise. To reduce noise, low-pass filters are commonly employed in order to attenuate high frequency components in the incoming signal, regardless if they come from…

Signal Processing · Electrical Eng. & Systems 2021-11-08 Alejandro J. Ordóñez-Conejo , Armin Lederer , Sandra Hirche