English
Related papers

Related papers: Optimization-Free Concentrated Matrix-Exponentials

200 papers

We study large random matrices with i.i.d. entries conditioned to have prescribed row and column sums (margins), a problem connected to relative entropy minimization, Schr\"odinger bridges, contingency tables, and random graphs with given…

Probability · Mathematics 2025-07-02 Hanbaek Lyu , Sumit Mukherjee

We study the problem of constructing explicit families of matrices which cannot be expressed as a product of a few sparse matrices. In addition to being a natural mathematical question on its own, this problem appears in various…

Computational Complexity · Computer Science 2019-04-03 Mrinal Kumar , Ben Lee Volk

A packed community of exponentially proliferating microbes will spread in size exponentially. However, due to nutrient depletion, mechanical constraints, or other limitations, exponential proliferation is not indefinite, and the spreading…

Biological Physics · Physics 2026-02-02 Meiyi Yao , Joshua M. Jones , Joseph W. Larkin , Andrew Mugler

Recently much attention has been paid to deep generative models, since they have been used to great success for variational inference, generation of complex data types, and more. In most all of these settings, the goal has been to find a…

Machine Learning · Statistics 2019-03-19 Sean R. Bittner , John P. Cunningham

The study of probabilistic models for the analysis of complex networks represents a flourishing research field. Among the former, Exponential Random Graphs (ERGs) have gained increasing attention over the years. So far, only linear ERGs…

Physics and Society · Physics 2026-02-10 Mattia Marzi , Francesca Giuffrida , Diego Garlaschelli , Tiziano Squartini

We revisit the method of mixture technique, also known as the Laplace method, to study the concentration phenomenon in generic exponential families. Combining the properties of Bregman divergence associated with log-partition function of…

Machine Learning · Computer Science 2023-07-14 Sayak Ray Chowdhury , Patrick Saux , Odalric-Ambrym Maillard , Aditya Gopalan

Recent progress in center-based clustering algorithms combats poor local minima by implicit annealing, using a family of generalized means. These methods are variations of Lloyd's celebrated $k$-means algorithm, and are most appropriate for…

Machine Learning · Statistics 2022-06-23 Adithya Vellal , Saptarshi Chakraborty , Jason Xu

We establish exponential inequalities for a class of V-statistics under strong mixing conditions. Our theory is developed via a novel kernel expansion based on random Fourier features and the use of a probabilistic method. This type of…

Statistics Theory · Mathematics 2020-01-07 Yandi Shen , Fang Han , Daniela Witten

The beta family owes its privileged status within unit interval distributions to several relevant features such as, for example, easyness of interpretation and versatility in modeling different types of data. However, its flexibility at the…

Statistics Theory · Mathematics 2017-06-28 Carlo Orsi

We establish theoretical guarantees for the expected prediction error of the exponential weighting aggregate in the case of multivariate regression that is when the label vector is multidimensional. We consider the regression model with…

Statistics Theory · Mathematics 2018-06-26 Arnak S. Dalalyan

We show that the discrete complex, and numerous hypercomplex, Fourier transforms defined and used so far by a number of researchers can be unified into a single framework based on a matrix exponential version of Euler's formula…

Rings and Algebras · Mathematics 2012-09-13 Stephen J. Sangwine , Todd A. Ell

We give simple criteria to identify the exponential order of magnitude of the absolute value of the determinant for wide classes of random matrix models, not requiring the assumption of invariance. These include Gaussian matrices with…

Probability · Mathematics 2023-02-22 Gérard Ben Arous , Paul Bourgade , Benjamin McKenna

There is growing interest in developing statistical estimators that achieve exponential concentration around a population target even when the data distribution has heavier than exponential tails. More recent activity has focused on…

Statistics Theory · Mathematics 2025-04-22 Jakwang Kim , Jiyoung Park , Anirban Bhattacharya

Addressing selection bias in latent variable causal discovery is important yet underexplored, largely due to a lack of suitable statistical tools: While various tools beyond basic conditional independencies have been developed to handle…

Machine Learning · Computer Science 2025-12-15 Haoyue Dai , Yiwen Qiu , Ignavier Ng , Xinshuai Dong , Peter Spirtes , Kun Zhang

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai

Variational autoencoders (VAE) often use Gaussian or category distribution to model the inference process. This puts a limit on variational learning because this simplified assumption does not match the true posterior distribution, which is…

Machine Learning · Computer Science 2017-02-28 Ke Sun , Xiangliang Zhang

We introduce a lightweight, flexible and end-to-end trainable probability density model parameterized by a constrained Fourier basis. We assess its performance at approximating a range of multi-modal 1D densities, which are generally…

Machine Learning · Computer Science 2024-02-26 Alfredo De la Fuente , Saurabh Singh , Johannes Ballé

We propose an asympotically optimal choice of shared concentrated real poles of a family of rational approximants of time-dependent exponential functions $\exp(-tz)$ for $z \geq 0$ and $t$ in a positive time interval $T$. Our result extends…

Numerical Analysis · Mathematics 2025-12-01 Stefan Güttel , Shuai Shao

We consider the scattering by a one-dimensional random potential and derive the probability distribution of the corresponding Wigner time delay. It is shown that the limiting distribution is the same for two different models and coincides…

Disordered Systems and Neural Networks · Physics 2009-10-30 Alain Comtet , Christophe Texier

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji