中文
相关论文

相关论文: Constructive Universal High-Dimensional Distributi…

200 篇论文

Flow Matching, a promising approach in generative modeling, has recently gained popularity. Relying on ordinary differential equations, it offers a simple and flexible alternative to diffusion models, which are currently the…

机器学习 · 统计学 2026-03-13 Lea Kunkel

In this paper, we consider robust nonparametric regression using deep neural networks with ReLU activation function. While several existing theoretically justified methods are geared towards robustness against identical heavy-tailed noise…

统计方法学 · 统计学 2023-11-01 Juntong Chen

Gaussian distributions are commonly used as a key building block in many generative models. However, their applicability has not been well explored in deep networks. In this paper, we propose a novel deep generative model named as Normal…

计算机视觉与模式识别 · 计算机科学 2018-05-15 Jay Nandy , Wynne Hsu , Mong Li Lee

We derive upper bounds on the generalization error of learning algorithms based on their \emph{algorithmic transport cost}: the expected Wasserstein distance between the output hypothesis and the output hypothesis conditioned on an input…

机器学习 · 统计学 2018-11-09 Jingwei Zhang , Tongliang Liu , Dacheng Tao

The challenge of approximating functions in infinite-dimensional spaces from finite samples is widely regarded as formidable. We delve into the challenging problem of the numerical approximation of Sobolev-smooth functions defined on…

最优化与控制 · 数学 2024-10-11 Massimo Fornasier , Pascal Heid , Giacomo Enrico Sodini

We study the problem of constructing strong approximate unitary $k$-designs on $D$-dimensional grids (and more generally on Cartesian products of graphs), building on the work of Schuster et al. arXiv:2509.26310 which establishes strong…

量子物理 · 物理学 2026-05-06 Marten Folkertsma , Lorenzo Grevink , Jonas Helsen , Alicja Dutkiewicz

Analyzing neural network dynamics via stochastic gradient descent (SGD) is crucial to building theoretical foundations for deep learning. Previous work has analyzed structured inputs within the \textit{hidden manifold model}, often under…

机器学习 · 统计学 2025-12-01 Jaeyong Bae , Hawoong Jeong

We present a novel multiscale super-resolution framework (SRLBM) that applies deep learning directly to the mesoscopic density distribution functions of the lattice Boltzmann method for high-fidelity flow reconstruction. Two neural network…

流体动力学 · 物理学 2025-09-19 Gengchao Yang , Renyu Luo , Qinghe Yao , Peiji Wang , Jinxiu Zhang

We present a near linear time algorithm for constructing hierarchical nets in finite metric spaces with constant doubling dimension. This data-structure is then applied to obtain improved algorithms for the following problems: Approximate…

数据结构与算法 · 计算机科学 2007-05-23 Sariel Har-Peled , Manor Mendel

1-Lipschitz neural networks are fundamental for generative modelling, inverse problems, and robust classifiers. In this paper, we focus on 1-Lipschitz residual networks (ResNets) based on explicit Euler steps of negative gradient flows and…

机器学习 · 计算机科学 2025-10-14 Davide Murari , Takashi Furuya , Carola-Bibiane Schönlieb

We investigate the Distributionally Robust Regret-Optimal (DR-RO) control of discrete-time linear dynamical systems with quadratic cost over an infinite horizon. Regret is the difference in cost obtained by a causal controller and a…

系统与控制 · 电气工程与系统科学 2024-01-01 Taylan Kargin , Joudi Hajar , Vikrant Malik , Babak Hassibi

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

最优化与控制 · 数学 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

Deep neural networks rely heavily on normalization methods to improve their performance and learning behavior. Although normalization methods spurred the development of increasingly deep and efficient architectures, they also increase the…

机器学习 · 计算机科学 2021-10-06 Alexander Fuchs , Christian Knoll , Franz Pernkopf

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

机器学习 · 统计学 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

机器学习 · 统计学 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks that would trigger misclassification of DNNs but may be imperceptible to human perception. Adversarial defense has been an important way to improve the robustness…

机器学习 · 计算机科学 2023-02-22 Qicheng Wang , Shuhai Zhang , Jiezhang Cao , Jincheng Li , Mingkui Tan , Yang Xiang

This paper develops a randomized approach for incrementally building deep neural networks, where a supervisory mechanism is proposed to constrain the random assignment of the weights and biases, and all the hidden layers have direct links…

机器学习 · 计算机科学 2018-03-19 Dianhui Wang , Ming Li

Recent results in nonparametric regression show that deep learning, i.e., neural network estimates with many hidden layers, are able to circumvent the so-called curse of dimensionality in case that suitable restrictions on the structure of…

机器学习 · 统计学 2020-09-30 Michael Kohler , Sophie Langer

We consider a one-hidden-layer leaky ReLU network of arbitrary width trained by stochastic gradient descent (SGD) following an arbitrary initialization. We prove that SGD produces neural networks that have classification accuracy…

机器学习 · 计算机科学 2021-02-16 Spencer Frei , Yuan Cao , Quanquan Gu

Deep learning methods continue to have a decided impact on machine learning, both in theory and in practice. Statistical theoretical developments have been mostly concerned with approximability or rates of estimation when recovering…

统计理论 · 数学 2021-04-07 Yuexi Wang , Veronika Ročková