English
Related papers

Related papers: Computationally efficient reductions between some …

200 papers

Our goal is to develop a general strategy to decompose a random variable $X$ into multiple independent random variables, without sacrificing any information about unknown parameters. A recent paper showed that for some well-known natural…

Methodology · Statistics 2025-12-23 Ameer Dharamshi , Anna Neufeld , Keshav Motwani , Lucy L. Gao , Daniela Witten , Jacob Bien

Optimization software enables the solution of problems with millions of variables and associated parameters. These parameters are, however, often uncertain and represented with an analytical description of the parameter's distribution or…

Optimization and Control · Mathematics 2025-01-17 John R. Birge

In the framework of learned image compression, the context model plays a pivotal role in capturing the dependencies among latent representations. To reduce the decoding time resulting from the serial autoregressive context model, the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-01 Yang Sui , Ding Ding , Xiang Pan , Xiaozhong Xu , Shan Liu , Bo Yuan , Zhenzhong Chen

We present in this paper a way to transform a constrained statistical inference problem into an unconstrained one in order to be able to use modern computational methods, such as those based on automatic differentiation, GPU computing,…

Computation · Statistics 2023-01-23 Jean-Benoist Leger

This paper presents a neural network--enhanced surrogate modeling approach for diffusion problems with spatially varying random field coefficients. The method builds on numerical homogenization, which compresses fine-scale coefficients into…

Numerical Analysis · Mathematics 2025-09-17 Fabian Kröpfl , Daniel Peterseim , Elisabeth Ullmann

While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice. To address this issue, transfer learning has emerged as an…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Tianyu Xie , Shiyue Zhang , Cheng Zhang

This paper studies the notion of computational entropy. Using techniques from convex optimization, we investigate the following problems: (a) Can we derandomize the computational entropy? More precisely, for the computational entropy, what…

Information Theory · Computer Science 2013-05-17 Maciej Skórski

Sampling from distributions of implicitly defined shapes enables analysis of various energy functionals used for image segmentation. Recent work describes a computationally efficient Metropolis-Hastings method for accomplishing this task.…

Computer Vision and Pattern Recognition · Computer Science 2012-05-17 Jason Chang , John W. Fisher

Complex computer codes are often too time expensive to be directly used to perform uncertainty propagation studies, global sensitivity analysis or to solve optimization problems. A well known and widely used method to circumvent this…

Applications · Statistics 2008-04-06 Amandine Marrel , Bertrand Iooss , Francois Van Dorpe , Elena Volkova

In all but special circumstances, measurements of time-dependent processes reflect internal structures and correlations only indirectly. Building predictive models of such hidden information sources requires discovering, in some way, the…

Probability · Mathematics 2009-11-10 Nihat Ay , James P. Crutchfield

As transformer-based language models are trained on increasingly large datasets and with vast numbers of parameters, finding more efficient alternatives to the standard Transformer has become very valuable. While many efficient Transformers…

Machine Learning · Computer Science 2024-11-12 Kai Yang , Jan Ackermann , Zhenyu He , Guhao Feng , Bohang Zhang , Yunzhen Feng , Qiwei Ye , Di He , Liwei Wang

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

Revolutionary advances in both manufacturing and computational morphogenesis raise critical questions about design sensitivity. Sensitivity questions are especially critical in contexts, such as topology optimization, that yield structures…

Computational Engineering, Finance, and Science · Computer Science 2025-03-21 Hazhir Aliahmadi , Aidan Sheedy , Greg van Anders

Projection-based reduced order models are effective at approximating parameter-dependent differential equations that are parametrically separable. When parametric separability is not satisfied, which occurs in both linear and nonlinear…

Numerical Analysis · Mathematics 2021-10-22 Peter Sentz , Kristian Beckwith , Eric C. Cyr , Luke N. Olson , Ravi Patel

Latent space model plays a crucial role in network analysis, and accurate estimation of latent variables is essential for downstream tasks such as link prediction. However, the large number of parameters to be estimated presents a…

Methodology · Statistics 2025-09-22 Kuangnan Fang , Ruixuan Qin , Xinyan Fan

In many real-world applications, researchers aim to deploy models trained in a source domain to a target domain, where obtaining labeled data is often expensive, time-consuming, or even infeasible. While most existing literature assumes…

Methodology · Statistics 2025-08-26 Seong-ho Lee , Yanyuan Ma , Jiwei Zhao

Sparse coding aims to model data vectors as sparse linear combinations of basis elements, but a majority of related studies are restricted to continuous data without spatial or temporal structure. A new model-based sparse coding (MSC)…

Methodology · Statistics 2021-08-24 Xin Xing , Rui Xie , Wenxuan Zhong

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

One of the crucial tasks in many inference problems is the extraction of sparse information out of a given number of high-dimensional measurements. In machine learning, this is frequently achieved using, as a penality term, the $L_p$ norm…

Disordered Systems and Neural Networks · Physics 2012-02-09 Alejandro Lage-Castellanos , Andrea Pagnani , Martin Weigt

The description of complex physical phenomena often involves sophisticated models that rely on a large number of parameters, with many dimensions and scales. One practical way to simplify that kind of models is to discard some of the…

Soft Condensed Matter · Physics 2025-11-11 Simone Rusconi , Christina Schenk , Razvan Ceuca , Arghir Zarnescu , Elena Akhmatskaya