English
Related papers

Related papers: Constructive discretization and approximation in r…

200 papers

Sampling from discrete distributions is a ubiquitous task in machine learning, recently revisited by the emergence of discrete diffusion models. While Langevin algorithms constitute the state of the art for continuous spaces, discrete…

Statistics Theory · Mathematics 2026-02-18 Armand Gissler , Saeed Saremi , Francis Bach

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

Discretization of the uniform norm of functions from a given finite dimensional subspace of continuous functions is studied. We pay special attention to the case of trigonometric polynomials with frequencies from an arbitrary finite set…

Numerical Analysis · Mathematics 2021-12-14 Boris Kashin , Sergei Konyagin , Vladimir Temlyakov

This work focuses on multidimensional summation-by-parts (SBP) discretizations of linear elliptic operators with variable coefficients. We consider a general SBP discretization with dense simultaneous approximation terms (SATs), which serve…

Numerical Analysis · Mathematics 2016-12-28 Jianfeng Yan , Jared Crean , Jason E. Hicken

Supervised dimensionality reduction has emerged as an important theme in the last decade. Despite the plethora of models and formulations, there is a lack of a simple model which aims to project the set of patterns into a space defined by…

Machine Learning · Statistics 2016-10-28 Anthony O. Smith , Anand Rangarajan

In this paper, we discuss the solution of certain matrix-valued partial differential equations. Such PDEs arise, for example, when constructing a Riemannian contraction metric for a dynamical system given by an autonomous ODE. We develop…

Numerical Analysis · Mathematics 2017-06-29 Peter Giesl , Holger Wendland

We derive a new discretisation method for first order PDEs of arbitrary spatial dimension, which is based upon a meshfree spatial approximation. This spatial approximation is similar to the SPH (smoothed particle hydrodynamics) technique…

Numerical Analysis · Mathematics 2016-01-25 Tobias Ramming , Holger Wendland

Generalizing previous work of Iwaniec, Luo, and Sarnak (2000), we use information from one-level density theorems to estimate the proportion of non-vanishing of $L$-functions in a family at a low-lying height on the critical line (measured…

Number Theory · Mathematics 2022-10-17 Emanuel Carneiro , Andrés Chirre , Micah B. Milinovich

In this paper, we consider a squared $L_1/L_2$ regularized model for sparse signal recovery from noisy measurements. We first establish the existence of optimal solutions to the model under mild conditions. Next, we propose a proximal…

Optimization and Control · Mathematics 2025-11-10 Na Zhang , Hong Chen , Qia Li , Junpeng Zhou

This paper introduces the sparsifying preconditioner for the pseudospectral approximation of highly indefinite systems on periodic structures, which include the frequency-domain response problems of the Helmholtz equation and the…

Numerical Analysis · Mathematics 2014-09-18 Lexing Ying

We analyze constrained and unconstrained minimization problems on patches of tetrahedra sharing a common vertex with discontinuous piecewise polynomial data of degree p. We show that the discrete minimizers in the spaces of piecewise…

Numerical Analysis · Mathematics 2024-07-29 T. Chaumont-Frelet , M. Vohralik

This work is devoted to establish the strong convergence results of an iterative algorithm generated by the shrinking projection method in Hilbert spaces. The proposed approximation sequence is used to find a common element in the set of…

Functional Analysis · Mathematics 2018-03-07 Abdul Ghaffar , Zafar Ullah , Muhammad Aqeel Ahmad Khan , Faisal Mumtaz

This paper considers the minimization of a continuously differentiable function over a cardinality constraint. We focus on smooth and relatively smooth functions. These smoothness criteria result in new descent lemmas. Based on the new…

Optimization and Control · Mathematics 2024-09-26 Fatih Selim Aktas , Mustafa Celebi Pinar

This paper reports an effort to consolidate numerous coherence-based sparse signal recovery results available in the literature. We present a single theory that applies to general Hilbert spaces with the sparsity of a signal defined as the…

Information Theory · Computer Science 2012-05-22 Graeme Pope , Helmut Bölcskei

This is the second of two papers to describe a matrix sparsification algorithm that takes a general real or complex matrix as input and produces a sparse output matrix of the same size. The first paper presented the original algorithm, its…

Numerical Analysis · Mathematics 2013-04-29 Chetan Jhurani

In the field of data mining, how to deal with high-dimensional data is an inevitable problem. Unsupervised feature selection has attracted more and more attention because it does not rely on labels. The performance of spectral-based…

Machine Learning · Computer Science 2021-01-01 Zhengxin Li , Feiping Nie , Jintang Bian , Xuelong Li

In this article, we propose a general nonlinear sufficient dimension reduction (SDR) framework when both the predictor and response lie in some general metric spaces. We construct reproducing kernel Hilbert spaces whose kernels are fully…

Statistics Theory · Mathematics 2022-06-24 Joni Virta , Kuang-Yao Lee , Lexin Li

Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data…

Statistics Theory · Mathematics 2023-10-03 Meimei Liu , Zuofeng Shang , Yun Yang

This work studies the convergence and finite sample approximations of entropic regularized Wasserstein distances in the Hilbert space setting. Our first main result is that for Gaussian measures on an infinite-dimensional Hilbert space,…

Machine Learning · Statistics 2021-02-16 Minh Ha Quang

We present a new methodology for sufficient dimension reduction (SDR). Our methodology derives directly from the formulation of SDR in terms of the conditional independence of the covariate $X$ from the response $Y$, given the projection of…

Statistics Theory · Mathematics 2009-08-14 Kenji Fukumizu , Francis R. Bach , Michael I. Jordan