English
Related papers

Related papers: Infinite-Dimensional Integration in Weighted Hilbe…

200 papers

Binary embedding is a nonlinear dimension reduction methodology where high dimensional data are embedded into the Hamming cube while preserving the structure of the original space. Specifically, for an arbitrary $N$ distinct points in…

Data Structures and Algorithms · Computer Science 2019-01-24 Xinyang Yi , Constantine Caramanis , Eric Price

High-dimensional functional data are becoming increasingly common in fields such as environmental monitoring and neuroimaging. This paper studies high-dimensional functional linear regression models that relate a scalar response to…

Methodology · Statistics 2026-05-08 Xingche Guo , Yehua Li , Pang Du

We develop a comprehensive theory for a general class of multi-parameter function spaces of Besov-Triebel-Lizorkin type, with a matrix weight. We prove the equivalence of different quasi-norms, the identification of function and sequence…

Functional Analysis · Mathematics 2026-03-27 Fan Bu , Yiqun Chen , Tuomas Hytönen , Dachun Yang , Wen Yuan

Despite significant research on the optimization aspects of federated learning, the exploration of generalization error, especially in the realm of heterogeneous federated learning, remains an area that has been insufficiently investigated,…

Machine Learning · Statistics 2025-09-17 Saptarshi Chakraborty , Peter L. Bartlett

We consider nonparametric regression with functional covariates, that is, they are elements of an infinite-dimensional Hilbert space. A locally polynomial estimator is constructed, where an orthonormal basis and various tuning parameters…

Statistics Theory · Mathematics 2025-04-09 Moritz Jirak , Alois Kneip , Alexander Meister , Mario Pahl

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

Functional data clustering is concerned with grouping functions that share similar structure, yet most existing methods implicitly operate on sampled grids, causing cluster assignments to depend on resolution, sampling density, or…

Machine Learning · Computer Science 2026-02-27 Anirudh Thatipelli , Ali Siahkoohi

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

We are concerned with the numerical integration of functions from the Sobolev space $H^{r,\text{mix}}([0,1]^d)$ of dominating mixed smoothness $r\in\mathbb{N}$ over the $d$-dimensional unit cube. In 1976, K. K. Frolov introduced a…

Numerical Analysis · Mathematics 2016-03-17 David Krieg

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

We consider the problem of variable selection in high-dimensional sparse additive models. We focus on the case that the components belong to nonparametric classes of functions. The proposed method is motivated by geometric considerations in…

Statistics Theory · Mathematics 2015-02-03 Martin Wahl

Model merging provides a cost-effective and data-efficient combination of specialized deep neural networks through parameter integration. This technique leverages expert models across downstream tasks without requiring retraining. Most…

Machine Learning · Computer Science 2025-10-17 Levy Chaves , Eduardo Valle , Sandra Avila

High dimensional integrals can be approximated well by quasi-Monte Carlo methods. However, determining the number of function values needed to obtain the desired accuracy is difficult without some upper bound on an appropriate semi-norm of…

Numerical Analysis · Mathematics 2017-06-27 Fred J. Hickernell , Lluís Antoni Jiménez Rugama , Da Li

In this paper, we propose a random gradient-free method for optimization in infinite dimensional Hilbert spaces, applicable to functional optimization in diverse settings. Though such problems are often solved through finite-dimensional…

Optimization and Control · Mathematics 2025-12-25 Caio Lins Peixoto , Daniel Csillag , Bernardo F. P. da Costa , Yuri F. Saporito

This paper develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of…

Methodology · Statistics 2021-07-20 Rui Tuo , Shiyuan He , Arash Pourhabib , Yu Ding , Jianhua Z. Huang

Optimal higher-order Sobolev type embeddings are shown to follow via isoperimetric inequalities. This establishes a higher-order analogue of a well-known link between first-order Sobolev embeddings and isoperimetric inequalities. Sobolev…

Functional Analysis · Mathematics 2013-11-04 Andrea Cianchi , Luboš Pick , Lenka Slavíková

We consider an enlarged dimension reduction space in functional inverse regression. Our operator and functional analysis based approach facilitates a compact and rigorous formulation of the functional inverse regression problem. It also…

Statistics Theory · Mathematics 2015-03-13 Ting-Li Chen , Su-Yun Huang , Yanyuan Ma , I-Ping Tu

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a…

Methodology · Statistics 2011-07-06 Jelena Bradic , Jianqing Fan , Weiwei Wang

Weight-ensembles are formed when the parameters of multiple neural networks are directly averaged into a single model. They have demonstrated generalization capability in-distribution (ID) and out-of-distribution (OOD) which is not…

Machine Learning · Computer Science 2024-09-05 Alex Rojas , David Alvarez-Melis

In the present work, we investigate the computational efficiency afforded by higher-order finite-element discretization of the saddle-point formulation of orbital-free density functional theory. We first investigate the robustness of viable…

Computational Physics · Physics 2015-05-30 Phani Motamarri , Mrinal Iyer , Jaroslaw Knap , Vikram Gavini