English
Related papers

Related papers: A framework for fitting sparse data

200 papers

Motivated by the need for efficient estimation of conditional expectations, we consider a least-squares function approximation problem with heavily polluted data. Existing methods that are effective in the small-noise regime are suboptimal…

Machine Learning · Statistics 2026-05-26 Ben Adcock , Bernhard Hientzsch , Akil Narayan , Yiming Xu

The power of sparse signal coding with learned dictionaries has been demonstrated in a variety of applications and fields, from signal processing to statistical inference and machine learning. However, the statistical properties of these…

Information Theory · Computer Science 2010-10-25 Ignacio Ramírez , Guillermo Sapiro

This article considers Bayesian model selection via mean-field (MF) variational approximation. Towards this goal, we study the non-asymptotic properties of MF inference under the Bayesian framework that allows latent variables and model…

Methodology · Statistics 2023-12-29 Yangfan Zhang , Yun Yang

The past few years have seen impressive progress in the development of deep generative models capable of producing high-dimensional, complex, and photo-realistic data. However, current methods for evaluating such models remain incomplete:…

Machine Learning · Computer Science 2024-03-14 Marco Jiralerspong , Avishek Joey Bose , Ian Gemp , Chongli Qin , Yoram Bachrach , Gauthier Gidel

We reconstruct the velocity field of incompressible flows given a finite set of measurements. For the spatial approximation, we introduce the Sparse Fourier divergence-free (SFdf) approximation based on a discrete $L^2$ projection. Within…

Fluid Dynamics · Physics 2021-10-13 Luis Espath , Dmitry Kabanov , Jonas Kiessling , Raúl Tempone

LISA Pathfinder (LPF), ESA's precursor mission to a gravitational wave observatory, will measure the degree to which two test-masses can be put into free-fall, aiming to demonstrate a residual relative acceleration with a power spectral…

We propose a model for functional data registration that compares favorably to the best methods of functional data registration currently available. It also extends current inferential capabilities for unregistered data by providing a…

Methodology · Statistics 2016-06-06 Cecilia Earls , Giles Hooker

Coupling arguments are a central tool for bounding the deviation between two stochastic processes, but traditionally have been limited to Wasserstein metrics. In this paper, we apply the shifted composition rule--an information-theoretic…

Statistics Theory · Mathematics 2024-12-25 Jason M. Altschuler , Sinho Chewi

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

Many functional datasets are observed sparsely and irregularly. Ordering such data is challenging because only limited information is available from each observation, while the underlying trajectories remain infinite-dimensional. This paper…

Methodology · Statistics 2026-05-21 Hyemin Yeon , Xiongtao Dai , Sara Lopez-Pintado

We provide a number of extensions and further interpretations of the Parameterized-Background Data-Weak (PBDW) formulation, a real-time and in-situ Data Assimilation (DA) framework for physical systems modeled by parametrized Partial…

Numerical Analysis · Mathematics 2017-12-29 Yvon Maday , Tommaso Taddei

We propose an adaptive zeroth-order method for minimizing differentiable functions with $L$-Lipschitz continuous gradients. The method is designed to take advantage of the eventual compressibility of the gradient of the objective function,…

Optimization and Control · Mathematics 2025-07-16 Geovani Nunes Grapiglia , Daniel McKenzie

We propose a new numerical scheme for approximating level-sets of Lipschitz multivariate functions which is robust to stochastic noise. The algorithm's main feature is an adaptive grid-based stochastic approximation strategy which…

Numerical Analysis · Mathematics 2025-09-19 Matteo Croci , Abdul-Lateef Haji-Ali , Ian C. J. Powell

This note establishes a theoretical framework for finding (potentially overparameterized) approximations of a function on a compact set with a-priori bounds for the generalization error. The approximation method considered is to choose,…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Arthur C. B. de Oliveira , Ruigang Wang , Ian R. Manchester , Eduardo D. Sontag

We present a method for contraction-based feedback motion planning of locally incrementally exponentially stabilizable systems with unknown dynamics that provides probabilistic safety and reachability guarantees. Given a dynamics dataset,…

Robotics · Computer Science 2022-03-02 Glen Chou , Necmiye Ozay , Dmitry Berenson

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

We extend deconvolution in a periodic setting to deal with functional data. The resulting functional deconvolution model can be viewed as a generalization of a multitude of inverse problems in mathematical physics where one needs to recover…

Statistics Theory · Mathematics 2009-03-09 Marianna Pensky , Theofanis Sapatinas

We develop a unifying framework for Bayesian nonparametric regression to study the rates of contraction with respect to the integrated $L_2$-distance without assuming the regression function space to be uniformly bounded. The framework is…

Statistics Theory · Mathematics 2019-04-30 Fangzheng Xie , Wei Jin , Yanxun Xu

Automated model selection is an important application in science and engineering. In this work, we develop a learning approach for identifying structured dynamical systems from undersampled and noisy spatiotemporal data. The learning is…

Machine Learning · Statistics 2023-05-31 Xiaofan Lu , Linan Zhang , Hongjin He

Spatial functional data arise in many settings, such as particulate matter curves observed at monitoring stations and age population curves at each areal unit. Most existing functional regression models have limited applicability because…

Methodology · Statistics 2025-04-25 Heesang Lee , Dagun Oh , Sunhwa Choi , Jaewoo Park