English
Related papers

Related papers: Linear versus Non-linear Acquisition of Step-Funct…

200 papers

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

Signal Processing · Electrical Eng. & Systems 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

This paper investigates model reduction methods for efficiently approximating the solution of parameter-dependent PDEs with a multi-parameter vector $\vec{\mu} \in \mathbb{R}^p$. In cases where the Kolmogorov $N$-width decays fast enough,…

Numerical Analysis · Mathematics 2026-01-21 Joubine Aghili , Hassan Ballout , Yvon Maday , Christophe Prud'homme

Isotonic regression provides a flexible, tuning-free approach to estimating monotonic functions without imposing global curvature constraints, yet the estimated regression function is inherently a step function. This paper addresses a key…

Methodology · Statistics 2026-05-19 Timo Kuosmanen , Juan F. Monge , José L. Ruiz , Xun Zhou

Integral transforms are invaluable mathematical tools to map functions into spaces where they are easier to characterize. We introduce the hyperdimensional transform as a new kind of integral transform. It converts square-integrable…

Machine Learning · Computer Science 2023-10-26 Pieter Dewulf , Michiel Stock , Bernard De Baets

This paper analyzes representations of continuous piecewise linear functions with infinite width, finite cost shallow neural networks using the rectified linear unit (ReLU) as an activation function. Through its integral representation, a…

Machine Learning · Computer Science 2023-09-26 Sarah McCarty

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

We study reconstruction operators on a Hilbert space that are exact on a given reconstruction subspace. Among those the reconstruction operator obtained by the least squares fit has the smallest operator norm, and therefore is most stable…

Numerical Analysis · Mathematics 2019-09-18 Peter Berger , Karlheinz Gröchenig , Gerald Matz

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

We study the fixed design segmented regression problem: Given noisy samples from a piecewise linear function $f$, we want to recover $f$ up to a desired accuracy in mean-squared error. Previous rigorous approaches for this problem rely on…

Machine Learning · Computer Science 2016-07-15 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but…

Machine Learning · Statistics 2021-11-01 Emile Mathieu , Adam Foster , Yee Whye Teh

This work presents a new constructive uniqueness proof for Calder\'on's inverse problem of electrical impedance tomography, subject to local Cauchy data, for a large class of piecewise constant conductivities that we call "piecewise…

Analysis of PDEs · Mathematics 2020-08-18 Henrik Garde

The purpose of this manuscript is to derive new convergence results for several subgradient methods applied to minimizing nonsmooth convex functions with H\"olderian growth. The growth condition is satisfied in many applications and…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Pierre Moulin

Many separable nonlinear optimization problems can be approximated by their nonlinear objective functions with piecewise linear functions. A natural question arising from applying this approach is how to break the interval of interest into…

Optimization and Control · Mathematics 2019-09-10 Carlos Ugaz , Lanshan Han , Alvin Lim

The problem of reconstructing an object from the measurements of the light it scatters is common in numerous imaging applications. While the most popular formulations of the problem are based on linearizing the object-light relationship,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-15 Yanting Ma , Hassan Mansour , Dehong Liu , Petros T. Boufounos , Ulugbek S. Kamilov

Variational approaches are among the most powerful modern techniques to approximately solve quantum many-body problems. These encompass both variational states based on tensor or neural networks, and parameterized quantum circuits in…

Strongly Correlated Electrons · Physics 2021-02-02 Kevin Zhang , Samuel Lederer , Kenny Choo , Titus Neupert , Giuseppe Carleo , Eun-Ah Kim

Finite elasticity problems commonly include material and geometric nonlinearities and are solved using various numerical methods. However, for highly nonlinear problems, achieving convergence is relatively difficult and requires small load…

Numerical Analysis · Mathematics 2018-05-01 Yue Mei , Daniel E. Hurtado , Sanjay Pant , Ankush Aggarwal

The principal aim of this article is to establish an iteration method on the space of resurgent functions. We discuss endless continuability of iterated convolution products of resurgent functions and derive their estimates developing the…

Classical Analysis and ODEs · Mathematics 2016-10-20 Shingo Kamimoto

We introduce a sampling theoretic framework for the recovery of smooth surfaces and functions living on smooth surfaces from few samples. The proposed approach can be thought of as a nonlinear generalization of union of subspace models…

Signal Processing · Electrical Eng. & Systems 2019-03-05 Qing Zou , Mathews Jacob

The inversion of linear systems is a fundamental step in many inverse problems. Computational challenges exist when trying to invert large linear systems, where limited computing resources mean that only part of the system can be kept in…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-05 Yushan Gao , Thomas Blumensath