English
Related papers

Related papers: Variational Cumulant Expansions for Intractable Di…

200 papers

An adaptive proximal method for a special class of variational inequalities and related problems is proposed. For example, the so-called mixed variational inequalities and composite saddle problems are considered. Some estimates of the…

Optimization and Control · Mathematics 2020-08-25 Fedor S. Stonyakin

We compute the perturbative expansion of the two- and four-point functions of color charges in the Color Glass Condensate framework considering the quartic correction to the McLerran-Venugopalan (MV) model of Gaussian color charge…

High Energy Physics - Phenomenology · Physics 2022-02-23 Andre V. Giannini , Yasushi Nara

Causal treatment effect estimation is a key problem that arises in a variety of real-world settings, from personalized medicine to governmental policy making. There has been a flurry of recent work in machine learning on estimating causal…

Machine Learning · Computer Science 2020-10-22 Niki Kilbertus , Matt J. Kusner , Ricardo Silva

In this paper, we develop an unsupervised generative clustering framework that combines the Variational Information Bottleneck and the Gaussian Mixture Model. Specifically, in our approach, we use the Variational Information Bottleneck…

Machine Learning · Computer Science 2020-04-22 Yigit Ugur , George Arvanitakis , Abdellatif Zaidi

Iterative imputation, in which variables are imputed one at a time each given a model predicting from all the others, is a popular technique that can be convenient and flexible, as it replaces a potentially difficult multivariate modeling…

Statistics Theory · Mathematics 2012-04-04 Jingchen Liu , Andrew Gelman , Jennifer Hill , Yu-Sung Su

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

In this paper a class of optimization problems with uncertain linear constraints is discussed. It is assumed that the constraint coefficients are random vectors whose probability distributions are only partially known. Possibility theory is…

Optimization and Control · Mathematics 2021-11-30 Romain Guillaume , Adam Kasperski , Pawel Zielinski

The adaptive perturbation chooses a non-standard decomposition. The Hamiltonian becomes a sum of solvable and perturbation parts. We calculate the spectrum using the adaptive perturbation method at the leading-order to compare to numerical…

Quantum Physics · Physics 2021-07-08 Chen-Te Ma

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

Machine Learning · Computer Science 2019-09-10 Saavan Patel , Sayeef Salahuddin

Inference methods are often formulated as variational approximations: these approximations allow easy evaluation of statistics by marginalization or linear response, but these estimates can be inconsistent. We show that by introducing…

Machine Learning · Statistics 2017-04-27 Jack Raymond , Federico Ricci-Tersenghi

A pre-trained unconditional diffusion model, combined with posterior sampling or maximum a posteriori (MAP) estimation techniques, can solve arbitrary inverse problems without task-specific training or fine-tuning. However, existing…

Machine Learning · Computer Science 2026-02-09 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

We develop a systematic method to obtain the solution of the collisionless Boltzmann equation which describes the growth of large-scale structures as a perturbative series over the initial density perturbations. We give an explicit…

Astrophysics · Physics 2009-11-06 P. Valageas

This paper addresses the problem of distributed detection in fixed and switching networks. A network of agents observe partially informative signals about the unknown state of the world. Hence, they collaborate with each other to identify…

Systems and Control · Computer Science 2016-01-01 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

We present a systematic derivation of the Heisenberg evolution of a trilinear bosonic Hamiltonian system in presence of a strong drive beyond the standard approximation of a classical, undepleted driving field. We employ a perturbative…

Quantum Physics · Physics 2026-04-01 Hanzhong Zhang , Avi Pe'er

We introduce incremental variational inference and apply it to latent Dirichlet allocation (LDA). Incremental variational inference is inspired by incremental EM and provides an alternative to stochastic variational inference. Incremental…

Machine Learning · Statistics 2015-07-23 Cedric Archambeau , Beyza Ermis

We establish a novel convergent iteration framework for a weak approximation of general switching diffusion. The key theoretical basis of the proposed approach is a restriction of the maximum number of switching so as to untangle and…

Numerical Analysis · Mathematics 2023-07-06 Qinjing Qiu , Reiichiro Kawai

We study distributional robustness in the context of Extreme Value Theory (EVT). We provide a data-driven method for estimating extreme quantiles in a manner that is robust against incorrect model assumptions underlying the application of…

Statistics Theory · Mathematics 2020-06-09 Jose Blanchet , Fei He , Karthyek R. A. Murthy

We have recently presented an extension of the standard variational calculus to include the presence of deformed derivatives in the Lagrangian of a system of particles and in the Lagrangian density of field-theoretic models. Classical…

Mathematical Physics · Physics 2017-06-30 J. Weberszpil , J. A. Helayël-Neto

We set up a method for a recursive calculation of the effective potential which is applied to a cubic potential with imaginary coupling. The result is resummed using variational perturbation theory (VPT), yielding an exponentially fast…

Quantum Physics · Physics 2009-12-06 Sebastian F. Brandt , Hagen Kleinert , Axel Pelster