English
Related papers

Related papers: A direct approach for function approximation on da…

200 papers

The practical deployment of learning-based autonomous systems would greatly benefit from tools that flexibly obtain safety guarantees in the form of certificate functions from data. While the geometrical properties of such certificate…

Machine Learning · Computer Science 2025-04-04 Samuel Tesfazgi , Leonhard Sprandl , Sandra Hirche

Normalizing Flows (NFs) are universal density estimators based on Neural Networks. However, this universality is limited: the density's support needs to be diffeomorphic to a Euclidean space. In this paper, we propose a novel method to…

Machine Learning · Computer Science 2022-02-02 Christian Horvat , Jean-Pascal Pfister

Scientists and engineers rely on accurate mathematical models to quantify the objects of their studies, which are often high-dimensional. Unfortunately, high-dimensional models are inherently difficult, i.e. when observations are sparse or…

Machine Learning · Computer Science 2018-02-13 Robert A. Bridges , Chris Felder , Chelsey Hoff

We present here a new method for approximating functions defined on superreflexive Banach spaces by differentiable functions with $\alpha$-H\"older derivatives (for some $0<\alpha\leq 1$). The smooth approximation is given by means of an…

Functional Analysis · Mathematics 2016-09-07 Manuel Cepedello Boiso

We first investigate on the asymptotics of the Kolmogorov metric entropy and nonlinear n-widths of approximation spaces on some function classes on manifolds and quasi-metric measure spaces. Secondly, we develop constructive algorithms to…

Numerical Analysis · Mathematics 2018-05-17 Martin Ehler , Frank Filbir

The subject of deep learning has recently attracted users of machine learning from various disciplines, including: medical diagnosis and bioinformatics, financial market analysis and online advertisement, speech and handwriting recognition,…

Machine Learning · Computer Science 2018-03-12 Charles K. Chui , Shao-Bo Lin , Ding-Xuan Zhou

In this paper, we evaluate the effectiveness of deep operator networks (DeepONets) in solving both forward and inverse problems of partial differential equations (PDEs) on unknown manifolds. By unknown manifolds, we identify the manifold by…

Numerical Analysis · Mathematics 2024-07-09 Anran Jiao , Qile Yan , Jhn Harlim , Lu Lu

We theoretically discuss why deep neural networks (DNNs) performs better than other models in some cases by investigating statistical properties of DNNs for non-smooth functions. While DNNs have empirically shown higher performance than…

Machine Learning · Statistics 2018-07-10 Masaaki Imaizumi , Kenji Fukumizu

Functions of one or more variables are usually approximated with a basis: a complete, linearly-independent system of functions that spans a suitable function space. The topic of this paper is the numerical approximation of functions using…

Numerical Analysis · Mathematics 2018-11-07 Ben Adcock , Daan Huybrechs

Given the necessity of connecting the unconnected, covering blind spots has emerged as a critical task in the next-generation wireless communication network. A direct solution involves obtaining a coverage manifold that visually showcases…

Networking and Internet Architecture · Computer Science 2023-12-12 Ruibo Wang , Washim Uddin Mondal , Mustafa A. Kishk , Vaneet Aggarwal , Mohamed-Slim Alouini

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Perspective functions arise explicitly or implicitly in various forms in applied mathematics and in statistical data analysis. To date, no systematic strategy is available to solve the associated, typically nonsmooth, optimization problems.…

Optimization and Control · Mathematics 2016-12-15 Patrick L. Combettes , Christian L. Müller

We build on the dynamical systems approach to deep learning, where deep residual networks are idealized as continuous-time dynamical systems, from the approximation perspective. In particular, we establish general sufficient conditions for…

Machine Learning · Computer Science 2020-06-09 Qianxiao Li , Ting Lin , Zuowei Shen

Statistical shape modeling (SSM) has recently taken advantage of advances in deep learning to alleviate the need for a time-consuming and expert-driven workflow of anatomy segmentation, shape registration, and the optimization of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jadie Adams , Riddhish Bhalodia , Shireen Elhabian

Learning to reconstruct depths in a single image by watching unlabeled videos via deep convolutional network (DCN) is attracting significant attention in recent years. In this paper, we introduce a surface normal representation for…

Computer Vision and Pattern Recognition · Computer Science 2017-11-13 Zhenheng Yang , Peng Wang , Wei Xu , Liang Zhao , Ramakant Nevatia

Deep Operator Networks (DeepONets) provide a branch-trunk neural architecture for approximating nonlinear operators acting between function spaces. In the classical operator approximation framework, the input is a function $u\in C(K_1)$…

Machine Learning · Computer Science 2026-03-13 Vugar Ismailov

Deep learning provides a new avenue for image restoration, which demands a delicate balance between fine-grained details and high-level contextualized information during recovering the latent clear image. In practice, however, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Man Zhou , Zeyu Xiao , Xueyang Fu , Aiping Liu , Gang Yang , Zhiwei Xiong

Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypothesis, which states that observed data lies on a…

Machine Learning · Statistics 2022-11-30 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Jesse C. Cresswell , Anthony L. Caterini

Graph Laplacian based algorithms for data lying on a manifold have been proven effective for tasks such as dimensionality reduction, clustering, and denoising. In this work, we consider data sets whose data points lie on a manifold that is…

Machine Learning · Computer Science 2024-07-01 Eitan Rosen , Paulina Hoyos , Xiuyuan Cheng , Joe Kileel , Yoel Shkolnisky