English
Related papers

Related papers: Variational Approach for Efficient KL Divergence E…

200 papers

The following detection problem is studied, in which there are $M$ sequences of samples out of which one outlier sequence needs to be detected. Each typical sequence contains $n$ independent and identically distributed (i.i.d.) continuous…

Information Theory · Computer Science 2015-10-08 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

We describe a Monte Carlo method to approximate the maximum likelihood estimate (MLE), when there are missing data and the observed data likelihood is not available in closed form. This method uses simulated missing data that are…

Statistics Theory · Mathematics 2007-08-22 Yun Ju Sung , Charles J. Geyer

We study the problem of spectrum estimation from transmission data of a known phantom. The goal is to reconstruct an x-ray spectrum that can accurately model the x-ray transmission curves and reflects a realistic shape of the typical energy…

Medical Physics · Physics 2021-07-14 Wooseok Ha , Emil Y. Sidky , Rina Foygel Barber , Taly Gilat Schmidt , Xiaochuan Pan

Instrumental variable analysis is a powerful tool for estimating causal effects when randomization or full control of confounders is not possible. The application of standard methods such as 2SLS, GMM, and more recent variants are…

Machine Learning · Statistics 2020-06-08 Andrew Bennett , Nathan Kallus , Tobias Schnabel

Flexible regression methods where interest centres on the way that the whole distribution of a response vector changes with covariates are very useful in some applications. A recently developed technique in this regard uses the…

Computation · Statistics 2016-03-01 Meng Hwee Victor Ong , David J. Nott , Ajay Jasra

We consider the problem of constructing a least conservative estimator of the expected value $\mu$ of a non-negative heavy-tailed random variable. We require that the probability of overestimating the expected value $\mu$ is kept…

Optimization and Control · Mathematics 2026-04-21 Bart P. G. van Parys , Bert Zwart

Dirichlet Process Mixture (DPM) models have been increasingly employed to specify random partition models that take into account possible patterns within the covariates. Furthermore, to deal with large numbers of covariates, methods for…

Applications · Statistics 2016-11-01 William Barcella , Maria De Iorio , Gianluca Baio

Deep ensembles excel in large-scale image classification tasks both in terms of prediction accuracy and calibration. Despite being simple to train, the computation and memory cost of deep ensembles limits their practicability. While some…

Machine Learning · Computer Science 2021-10-28 Giung Nam , Jongmin Yoon , Yoonho Lee , Juho Lee

Kernel discrepancies are a powerful tool for analyzing worst-case errors in quasi-Monte Carlo (QMC) methods. Building on recent advances in optimizing such discrepancy measures, we extend the subset selection problem to the setting of…

Machine Learning · Statistics 2025-11-05 Deyao Chen , François Clément , Carola Doerr , Nathan Kirk

Recently, efficient Multimodal Large Language Models (MLLMs) have gained significant attention as a solution to their high computational complexity, making them more practical for real-world applications. In this regard, the knowledge…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jiwan Kim , Kibum Kim , Sangwoo Seo , Chanyoung Park

Spiking Neural Networks (SNNs) have emerged as a promising approach for energy-efficient and biologically plausible computation. However, due to limitations in existing training methods and inherent model constraints, SNNs often exhibit a…

Artificial Intelligence · Computer Science 2025-05-19 Tianqing Zhang , Zixin Zhu , Kairong Yu , Hongwei Wang

Data collection is a critical step in statistical inference and data science, and the goal of statistical experimental design (ED) is to find the data collection setup that can provide most information for the inference. In this work we…

Computation · Statistics 2020-07-01 Ziqiao Ao , Jinglai Li

Derivative based optimization methods are efficient at solving optimal control problems near local optima. However, their ability to converge halts when derivative information vanishes. The inference approach to optimal control does not…

Robotics · Computer Science 2022-03-01 Daniel Layeghi , Steve Tonneau , Michael Mistry

This paper considers the problem of optimizing the average tracking error for an elliptic partial differential equation with an uncertain lognormal diffusion coefficient. In particular, the application of the multilevel quasi-Monte Carlo…

Numerical Analysis · Mathematics 2021-09-30 Philipp A. Guth , Andreas Van Barel

Latent Dirichlet Allocation models discrete data as a mixture of discrete distributions, using Dirichlet beliefs over the mixture weights. We study a variation of this concept, in which the documents' mixture weight beliefs are replaced…

Machine Learning · Computer Science 2011-10-24 Philipp Hennig , David Stern , Ralf Herbrich , Thore Graepel

LLMs are increasingly explored for bundle generation, thanks to their reasoning capabilities and knowledge. However, deploying large-scale LLMs introduces significant efficiency challenges, primarily high computational costs during…

Computation and Language · Computer Science 2025-04-25 Kaidong Feng , Zhu Sun , Jie Yang , Hui Fang , Xinghua Qu , Wenyuan Liu

We study concentration inequalities for the Kullback--Leibler (KL) divergence between the empirical distribution and the true distribution. Applying a recursion technique, we improve over the method of types bound uniformly in all regimes…

Information Theory · Computer Science 2019-10-22 Jay Mardia , Jiantao Jiao , Ervin Tánczos , Robert D. Nowak , Tsachy Weissman

Distributionally Robust Reinforcement Learning (DR-RL) aims to derive a policy optimizing the worst-case performance within a predefined uncertainty set. Despite extensive research, previous DR-RL algorithms have predominantly favored…

Machine Learning · Computer Science 2024-06-26 Yudan Wang , Shaofeng Zou , Yue Wang

We introduce a Monte Carlo Virtual Element estimator based on Virtual Element discretizations for stochastic elliptic partial differential equations with random diffusion coefficients. We prove estimates for the statistical approximation…

Numerical Analysis · Mathematics 2026-04-16 Paola F. Antonietti , Francesca Bonizzoni , Ilaria Perugia , Marco Verani

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi