English
Related papers

Related papers: Scaffolding Simulations with Deep Learning for Hig…

200 papers

While deep learning offers powerful capabilities for scientific research, its application is often hindered by a lack of quantitative reliability. To address this, we introduce a probabilistic denoising framework that simultaneously…

Strongly Correlated Electrons · Physics 2026-05-11 Younsik Kim , Changyoung Kim

Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypothesis, which states that observed data lies on a…

Machine Learning · Statistics 2022-11-30 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Jesse C. Cresswell , Anthony L. Caterini

Many analyses in particle and nuclear physics use simulations to infer fundamental, effective, or phenomenological parameters of the underlying physics models. When the inference is performed with unfolded cross sections, the observables…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Owen Long , Benjamin Nachman

The focus of modern biomedical studies has gradually shifted to explanation and estimation of joint effects of high dimensional predictors on disease risks. Quantifying uncertainty in these estimates may provide valuable insight into…

Methodology · Statistics 2021-03-09 Zhe Fei , Yi Li

We present a generative learning framework for probabilistic sampling based on an extension of the Probabilistic Learning on Manifolds (PLoM) approach, which is designed to generate statistically consistent realizations of a random vector…

Machine Learning · Statistics 2025-06-04 Dimitris G Giovanis , Nikolaos Evangelou , Ioannis G Kevrekidis , Roger G Ghanem

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

Machine Learning · Computer Science 2020-04-28 Ozan Sener , Vladlen Koltun

Model reduction of high-dimensional dynamical systems alleviates computational burdens faced in various tasks from design optimization to model predictive control. One popular model reduction approach is based on projecting the governing…

Dynamical Systems · Mathematics 2018-08-24 Francisco J. Gonzalez , Maciej Balajewicz

The measurements performed by particle physics experiments must account for the imperfect response of the detectors used to observe the interactions. One approach, unfolding, statistically adjusts the experimental data for detector effects.…

High Energy Physics - Experiment · Physics 2025-04-02 Alexander Shmakov , Kevin Greif , Michael James Fenton , Aishik Ghosh , Pierre Baldi , Daniel Whiteson

Deep unfolding is a method of growing popularity that fuses iterative optimization algorithms with tools from neural networks to efficiently solve a range of tasks in machine learning, signal and image processing, and communication systems.…

Signal Processing · Electrical Eng. & Systems 2019-10-09 Alexios Balatsoukas-Stimming , Christoph Studer

High-energy physics experiments rely heavily on precise measurements of energy and momentum, yet face significant challenges due to detector limitations, calibration errors, and the intrinsic nature of particle interactions. Traditional…

Data Analysis, Statistics and Probability · Physics 2024-06-05 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

Random sampling is a fundamental tool in modern machine learning and numerical linear algebra for reducing the computational cost of large-scale matrix problems. Existing analyses, however, rely primarily on subspace embedding guarantees,…

Numerical Analysis · Mathematics 2026-05-26 Chengmei Niu , Sachin Garg , Michał Dereziński , Zhenyu Liao

There is a well-known series expansion (Neumann series) in functional analysis for perturbative inversion of specific operators on Banach spaces. However, operators that appear in signal processing (e.g. folding and convolution of…

Mathematical Physics · Physics 2007-05-23 András László

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

We investigate possibilities to speed up iterative algorithms for non-blind image deconvolution. We focus on algorithms in which convolution with the point-spread function to be deconvolved is used in each iteration, and aim at accelerating…

Computer Vision and Pattern Recognition · Computer Science 2013-04-29 Martin Welk , Martin Erler

Supervised learning is classically formulated as training a model to minimize a fixed loss function over a fixed distribution, or task. However, an emerging paradigm instead views model training as extracting enough information from data so…

Machine Learning · Computer Science 2025-11-03 Sivaraman Balakrishnan , Nika Haghtalab , Daniel Hsu , Brian Lee , Eric Zhao

As an integral component of blind image deblurring, non-blind deconvolution removes image blur with a given blur kernel, which is essential but difficult due to the ill-posed nature of the inverse problem. The predominant approach is based…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Dong Gong , Zhen Zhang , Qinfeng Shi , Anton van den Hengel , Chunhua Shen , Yanning Zhang

Fitting an unknown number of hyperplanes to data is a fundamental yet challenging problem in machine learning, characterized by its non-convexity, non-differentiability, and unknown model order. Existing approaches often struggle with local…

Machine Learning · Computer Science 2026-05-28 Zhiqin Cheng , Yu Zhan , Mingjin Zhang , Lingbo Liu , Liang Lin

Learning mappings of data on manifolds is an important topic in contemporary machine learning, with applications in astrophysics, geophysics, statistical physics, medical diagnosis, biochemistry, 3D object analysis. This paper studies the…

Numerical Analysis · Mathematics 2020-07-21 Guido Montúfar , Yu Guang Wang

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…

For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous nonsmooth theory is challenging. Even when the objective is…

Optimization and Control · Mathematics 2023-01-19 X. Y. Han , Adrian S. Lewis