English
Related papers

Related papers: Evaluation of Generalized Degrees of Freedom for S…

200 papers

Diffusion probabilistic models (DPMs) are widely adopted for their outstanding generative fidelity, yet their sampling is computationally demanding. Polynomial-based multistep samplers mitigate this cost by accelerating inference; however,…

Machine Learning · Computer Science 2026-03-17 Soochul Park , Yeon Ju Lee , SeongJin Yoon , Jiyub Shin , Juhee Lee , Seongwoon Jo

Measuring the growth rate of large-scale structures (f) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of…

As datasets grow larger, they are often distributed across multiple machines that compute in parallel and communicate with a central machine through short messages. In this paper, we focus on sparse regression and propose a new procedure…

Methodology · Statistics 2023-03-14 Sifan Liu , Snigdha Panigrahi

Many real-world datasets can be represented in the form of a graph whose edge weights designate similarities between instances. A discrete Gaussian random field (GRF) model is a finite-dimensional Gaussian process (GP) whose prior…

Machine Learning · Computer Science 2012-09-18 Yifei Ma , Roman Garnett , Jeff Schneider

This paper explores the problem of generalized phase retrieval, which involves reconstructing a length-$n$ signal $\bm{x}$ from its $m$ phaseless samples $y_k = \left|\langle \bm{a}_k,\bm{x}\rangle\right|^2$, where $k = 1,2,...,m$, and…

Information Theory · Computer Science 2026-04-16 Jianfeng Cai , Huiping Li , Jiayi Li

We study Gaussian Process Thompson Sampling (GP-TS) for sequential decision-making over compact, continuous action spaces and provide a frequentist regret analysis based on fractional Gaussian process posteriors, without relying on domain…

Statistics Theory · Mathematics 2026-02-17 Somjit Roy , Prateek Jaiswal , Anirban Bhattacharya , Debdeep Pati , Bani K. Mallick

We analyze sparse frame based regularization of inverse problems by means of a diagonal frame decomposition (DFD) for the forward operator, which generalizes the SVD. The DFD allows to define a non-iterative (direct) operator-adapted frame…

Numerical Analysis · Mathematics 2019-12-13 Jürgen Frikel , Markus Haltmeier

This paper addresses the challenge of reconstructing full-field structural mode shapes from sparse sensor data. While Gaussian Process Regression (GPR) offers a robust non-parametric framework for spatial interpolation and uncertainty…

Numerical Analysis · Mathematics 2026-05-25 Farid Ghahari

Different from a typical independent identically distributed (IID) element assumption, this paper studies the estimation of IID row random matrix for the generalized linear model constructed by a linear mixing space and a row-wise mapping…

Information Theory · Computer Science 2021-09-28 Qiuyun Zou , Hongwen Yang

In this paper we introduce a general theory for nonlinear sufficient dimension reduction, and explore its ramifications and scope. This theory subsumes recent work employing reproducing kernel Hilbert spaces, and reveals many parallels…

Statistics Theory · Mathematics 2013-04-03 Kuang-Yao Lee , Bing Li , Francesca Chiaromonte

Sparse identification of differential equations aims to compute the analytic expressions from the observed data explicitly. However, there exist two primary challenges. Firstly, it exhibits sensitivity to the noise in the observed data,…

Numerical Analysis · Mathematics 2024-01-23 Yuhuang Meng , Yue Qiu

We investigate the effects of finite size corrections on the overlap probabilities in the Generalized Random Energy Model (GREM) in two situations where replica symmetry is broken in the thermodynamic limit. Our calculations do not use…

Disordered Systems and Neural Networks · Physics 2018-02-14 Bernard Derrida , Peter Mottishaw

The problem of selecting a handful of truly relevant variables in supervised machine learning algorithms is a challenging problem in terms of untestable assumptions that must hold and unavailability of theoretical assurances that selection…

Methodology · Statistics 2023-11-10 Mehdi Rostami , Olli Saarela

Finding corresponding pixels within a pair of images is a fundamental computer vision task with various applications. Due to the specific requirements of different tasks like optical flow estimation and local feature matching, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Songyan Zhang , Xinyu Sun , Hao Chen , Bo Li , Chunhua Shen

Gaussian Processes (GP) are widely used for probabilistic modeling and inference for nonparametric regression. However, their computational complexity scales cubicly with the sample size rendering them unfeasible for large data sets. To…

Statistics Theory · Mathematics 2022-05-11 Amine Hadji , Tammo Hesselink , Botond Szabó

The Fr\'echet regression is a useful method for modeling random objects in a general metric space given Euclidean covariates. However, the conventional approach could be sensitive to outlying objects in the sense that the distance from the…

Computation · Statistics 2026-01-21 Hao Li , Shonosuke Sugasawa , Shota Katayama

This paper studies the generalization properties of a recently proposed kernel method, the Random Feature models with Learnable Activation Functions (RFLAF). By applying a data-dependent sampling scheme for generating features, we provide…

Machine Learning · Computer Science 2025-10-20 Zailin Ma , Jiansheng Yang , Yaodong Yang

We study the replica field theory which describes the pinning of elastic manifolds of arbitrary internal dimension d in a random potential, with the aim of bridging the gap between mean field and renormalization theory. The full effective…

Condensed Matter · Physics 2009-07-10 Pierre Le Doussal , Kay Joerg Wiese

In this paper, we propose \texttt{FGPR}: a Federated Gaussian process ($\mathcal{GP}$) regression framework that uses an averaging strategy for model aggregation and stochastic gradient descent for local client computations. Notably, the…

Machine Learning · Statistics 2024-04-01 Xubo Yue , Raed Al Kontar

Regularized m-estimators are widely used due to their ability of recovering a low-dimensional model in high-dimensional scenarios. Some recent efforts on this subject focused on creating a unified framework for establishing oracle bounds,…

Methodology · Statistics 2023-09-06 Eduardo F. Mendes , Gabriel J. P. Pinto