English
Related papers

Related papers: A Complete Decomposition of KL Error using Refined…

200 papers

We study the problem of learning a latent tree graphical model where samples are available only from a subset of variables. We propose two consistent and computationally efficient algorithms for learning minimal latent trees, that is, trees…

Machine Learning · Statistics 2010-09-15 Myung Jin Choi , Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

Score-based and flow-based generative models exhibit remarkable expressive capacity in capturing complex distributions, and have been extensively deployed in tasks ranging from image generation to reinforcement learning. Nevertheless, these…

Machine Learning · Computer Science 2026-05-29 Yiyan , Liang , Sifei Liu , Weitong Zhang

Although with progress in introducing auxiliary amortized inference models, learning discrete latent variable models is still challenging. In this paper, we show that the annoying difficulty of obtaining reliable stochastic gradients for…

Machine Learning · Statistics 2020-05-29 Zhijian Ou , Yunfu Song

The Linear Ballistic Accumulator (Brown & Heathcote, 2008) model is used as a measurement tool to answer questions about applied psychology. The analyses based on this model depend upon the model selected and its estimated parameters.…

Methodology · Statistics 2020-03-03 David Gunawan , Guy E. Hawkins , Minh-Ngoc Tran , Robert Kohn , Scott Brown

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

Coupling arguments are a central tool for bounding the deviation between two stochastic processes, but traditionally have been limited to Wasserstein metrics. In this paper, we apply the shifted composition rule--an information-theoretic…

Statistics Theory · Mathematics 2024-12-25 Jason M. Altschuler , Sinho Chewi

In the last two decades, the linear model of coregionalization (LMC) has been widely used to model multivariate spatial processes. However, it can be a challenging task to conduct likelihood-based inference for such models because of the…

Methodology · Statistics 2024-12-04 Renaud Alie , David A. Stephens , Alexandra M. Schmidt

Large Language Models (LLMs) are increasingly used to simulate social attitudes and behaviors, offering scalable "silicon samples" that can approximate human data. However, current simulation practice often collapses diversity into an…

Computers and Society · Computer Science 2026-04-09 Xiaoyou Qin , Zhihong Li , Xiaoxiao Cheng

Large Language Models (LLMs) face limitations due to the high demand on GPU memory and computational resources when handling long contexts. While sparsify the Key-Value (KV) cache of transformer model is a typical strategy to alleviate…

Machine Learning · Computer Science 2024-02-06 Yumeng Wang , Zhenyang Xiao

Integrating Large Language Models (LLMs) with Knowledge Graphs (KGs) results in complex systems with numerous hyperparameters that directly affect performance. While such systems are increasingly common in retrieval-augmented generation,…

Artificial Intelligence · Computer Science 2025-06-02 Vasilije Markovic , Lazar Obradovic , Laszlo Hajdu , Jovan Pavlovic

We provide a novel family of generative block-models for random graphs that naturally incorporates degree distributions: the block-constrained configuration model. Block-constrained configuration models build on the generalised…

Physics and Society · Physics 2021-02-24 Giona Casiraghi

We consider the problem of predicting the next observation given a sequence of past observations, and consider the extent to which accurate prediction requires complex algorithms that explicitly leverage long-range dependencies. Perhaps…

Machine Learning · Computer Science 2018-06-29 Vatsal Sharan , Sham Kakade , Percy Liang , Gregory Valiant

In many complex applications, data heterogeneity and homogeneity exist simultaneously. Ignoring either one will result in incorrect statistical inference. In addition, coping with complex data that are non-Euclidean becomes more common. To…

Methodology · Statistics 2021-05-28 Zixuan Han , Tao Li , Jinhong You

Efficient and scalable non-parametric or semi-parametric regression analysis and density estimation are of crucial importance to the fields of statistics and machine learning. However, available methods are limited in their ability to…

Machine Learning · Computer Science 2026-03-23 Zeyu Ding , Katja Ickstadt , Nadja Klein , Alexander Munteanu , Simon Omlor

A common approach to statistical learning with big-data is to randomly split it among $m$ machines and learn the parameter of interest by averaging the $m$ individual estimates. In this paper, focusing on empirical risk minimization, or…

Machine Learning · Statistics 2016-06-14 Jonathan Rosenblatt , Boaz Nadler

The paper proposes an approach for the efficient model order reduction of dynamic contact problems in linear elasticity. Instead of the augmented Lagrangian method that is widely used for mechanical contact problems, we prefer here the…

Numerical Analysis · Mathematics 2021-07-27 Diana Manvelyan , Bernd Simeon , Utz Wever

The Logarithmic Linear Relaxation (LLR) algorithm is an efficient method for computing densities of states for systems with a continuous spectrum. A key feature of this method is exponential error reduction, which allows us to evaluate the…

High Energy Physics - Lattice · Physics 2022-04-13 Biagio Lucini , Olmo Francesconi , Markus Holzmann , David Lancaster , Antonio Rago

Exponential families and mixture families are parametric probability models that can be geometrically studied as smooth statistical manifolds with respect to any statistical divergence like the Kullback-Leibler (KL) divergence or the…

Machine Learning · Computer Science 2018-03-21 Frank Nielsen , Gaëtan Hadjeres

Many physical systems are described by probability distributions that evolve in both time and space. Modeling these systems is often challenging to due large state space and analytically intractable or computationally expensive dynamics. To…

Biological Physics · Physics 2019-07-03 Oliver K. Ernst , Tom Bartol , Terrence Sejnowski , Eric Mjolsness

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji