English
Related papers

Related papers: Consistency of Learned Sparse Grid Quadrature Rule…

200 papers

Transport map methods offer a powerful statistical learning tool that can couple a target high-dimensional random variable with some reference random variable using invertible transformations. This paper presents new computational…

Numerical Analysis · Mathematics 2023-03-07 Tiangang Cui , Sergey Dolgov , Olivier Zahm

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

Machine Learning · Computer Science 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

Continual learning, the ability of a model to adapt to an ongoing sequence of tasks without forgetting earlier ones, is a central goal of artificial intelligence. To better understand its underlying mechanisms, we study the limitations of…

Machine Learning · Statistics 2026-04-21 Hossein Taheri , Avishek Ghosh , Arya Mazumdar

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

Robotics · Computer Science 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

Square-root (loss) regularized models have recently become popular in linear regression due to their nice statistical properties. Moreover, some of these models can be interpreted as the distributionally robust optimization counterparts of…

Optimization and Control · Mathematics 2023-10-06 Hong T. M. Chu , Kim-Chuan Toh , Yangjing Zhang

We develop a framework for the analysis of deep neural networks and neural ODE models that are trained with stochastic gradient algorithms. We do that by identifying the connections between control theory, deep learning and theory of…

Probability · Mathematics 2021-03-18 Jean-François Jabir , David Šiška , Łukasz Szpruch

This paper provides proofs of the rate stability, Harris recurrence, and epsilon-optimality of CSMA algorithms where the backoff parameter of each node is based on its backlog. These algorithms require only local information and are easy to…

Information Theory · Computer Science 2009-07-08 Libin Jiang , Devavrat Shah , Jinwoo Shin , Jean Walrand

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

Fast exact algorithms are known for Hamiltonian paths in undirected and directed bipartite graphs through elegant though involved algorithms that are quite different from each other. We devise algorithms that are simple and similar to each…

Data Structures and Algorithms · Computer Science 2025-12-10 V. Arvind , Srijan Chakraborty , Samir Datta , Asif Khan

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

The present project aims to use machine learning, specifically neural networks (NN), to learn the trajectories of a set of coupled ordinary differential equations (ODEs) and decrease compute times for obtaining ODE solutions by using this…

Machine Learning · Computer Science 2020-09-18 Camila Faccini de Lima , Juliano Ferrari Gianlupi , John Metzcar , Juliette Zerick

In optimal transport, quadratic regularization is a sparse alternative to entropic regularization: the solution measure tends to have small support. Computational experience suggests that the support decreases monotonically to the…

Optimization and Control · Mathematics 2025-04-16 Alberto González-Sanz , Marcel Nutz , Andrés Riveros Valdevenito

While modern representation learning relies heavily on global error signals, decentralized algorithms driven by local interactions offer a fundamental distributed alternative. However, the macroscopic convergence properties of these…

Machine Learning · Computer Science 2026-04-21 Zilin Li , Weiwei Xu , Xuchun Tong , Xuanbo Lu , Xuanqi Zhao

Precise congestion prediction from a placement solution plays a crucial role in circuit placement. This work proposes the lattice hypergraph (LH-graph), a novel graph formulation for circuits, which preserves netlist data during the whole…

Machine Learning · Computer Science 2022-03-25 Bowen Wang , Guibao Shen , Dong Li , Jianye Hao , Wulong Liu , Yu Huang , Hongzhong Wu , Yibo Lin , Guangyong Chen , Pheng Ann Heng

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the…

Machine Learning · Statistics 2018-02-21 Mathieu Blondel , Vivien Seguy , Antoine Rolet

We study realizable continual linear regression under random task orderings, a common setting for developing continual learning theory. In this setup, the worst-case expected loss after $k$ learning iterations admits a lower bound of…

Machine Learning · Computer Science 2025-10-28 Ran Levinstein , Amit Attia , Matan Schliserman , Uri Sherman , Tomer Koren , Daniel Soudry , Itay Evron

We consider the supervised learning problem of learning the price of an option or the implied volatility given appropriate input data (model parameters) and corresponding output data (option prices or implied volatilities). The majority of…

Computational Finance · Quantitative Finance 2026-01-30 Serena Della Corte , Laurens Van Mieghem , Antonis Papapantoleon , Jonas Papazoglou-Hennig

We propose an image restoration algorithm that can control the perceptual quality and/or the mean square error (MSE) of any pre-trained model, trading one over the other at test time. Our algorithm is few-shot: Given about a dozen images…

Artificial Intelligence · Computer Science 2024-08-13 Theo Adrai , Guy Ohayon , Tomer Michaeli , Michael Elad

Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aniket Pramanik , M. Bridget Zimmerman , Mathews Jacob

In this paper, we propose a new framework named Communication Optimal Transport (CommOT) for computing the rate distortion (RD) function. This work is motivated by observing the fact that the transition law and the relative entropy in…

Information Theory · Computer Science 2022-12-21 Shitong Wu , Wenhao Ye , Hao Wu , Huihui Wu , Wenyi Zhang , Bo Bai