English
Related papers

Related papers: A Polynomial Time Algorithm for Log-Concave Maximu…

200 papers

The maximum likelihood estimation of the left-truncated log-logistic distribution with a given truncation point is analyzed in detail from both mathematical and numerical perspectives. These maximum likelihood equations often do not possess…

We consider the classical problem of learning, with arbitrary accuracy, the natural parameters of a $k$-parameter truncated \textit{minimal} exponential family from i.i.d. samples in a computationally and statistically efficient manner. We…

Machine Learning · Computer Science 2023-09-13 Abhin Shah , Devavrat Shah , Gregory W. Wornell

We show how to compute any symmetric Boolean function on $n$ variables over any field (as well as the integers) with a probabilistic polynomial of degree $O(\sqrt{n \log(1/\epsilon)})$ and error at most $\epsilon$. The degree dependence on…

Data Structures and Algorithms · Computer Science 2016-11-18 Josh Alman , Ryan Williams

Given a convex function $f\colon\mathbb{R}^{d}\to\mathbb{R}$, the problem of sampling from a distribution $\propto e^{-f(x)}$ is called log-concave sampling. This task has wide applications in machine learning, physics, statistics, etc. In…

Quantum Physics · Physics 2023-12-11 Andrew M. Childs , Tongyang Li , Jin-Peng Liu , Chunhao Wang , Ruizhe Zhang

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

Methodology · Statistics 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

Machine Learning · Computer Science 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar

We resolve a long-standing open question, about the existence of a constant-factor approximation algorithm for the average-case \textsc{Decision Tree} problem with uniform probability distribution over the hypotheses. We answer the question…

Data Structures and Algorithms · Computer Science 2026-04-29 Michał Szyfelbein

In large-data applications, such as the inference process of diffusion models, it is desirable to design sampling algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of sampling, which is the…

Data Structures and Algorithms · Computer Science 2025-05-21 Huanjian Zhou , Baoxiang Wang , Masashi Sugiyama

There are few, if any, algorithms in statistical phylogenetics which are used more heavily than Felsenstein's 1973 pruning method for computing the likelihood of a tree. We present LvD, (Likelihood via Decomposition), an alternative to…

Populations and Evolution · Quantitative Biology 2026-01-28 David Bryant , Celine Scornavacca , David Swofford

We study the problem of maximum likelihood estimation of densities that are log-concave and lie in the graphical model corresponding to a given undirected graph $G$. We show that the maximum likelihood estimate (MLE) is the product of the…

Statistics Theory · Mathematics 2025-12-02 Kaie Kubjas , Olga Kuznetsova , Elina Robeva , Pardis Semnani , Luca Sodomaco

We propose an exact polynomial algorithm for a resource allocation problem with convex costs and constraints on partial sums of resource consumptions, in the presence of either continuous or integer variables. No assumption of strict…

Data Structures and Algorithms · Computer Science 2014-04-29 Thibaut Vidal , Patrick Jaillet , Nelson Maculan

We study and develop multilevel methods for the numerical approximation of a log-concave probability $\pi$ on $\mathbb{R}^d$, based on (over-damped) Langevin diffusion. In the continuity of \cite{art:egeapanloup2021multilevel} concentrated…

Numerical Analysis · Mathematics 2023-01-24 Maxime Egéa

Distributed optimization utilizes local computation and communication to realize a global aim of optimizing the sum of local objective functions. This article addresses a class of constrained distributed nonconvex optimization problems…

Optimization and Control · Mathematics 2024-05-07 Zhiyu He , Jianping He , Cailian Chen , Xinping Guan

In multi-objective optimization, computing the entire non-dominated set (also known as the Pareto front or the Pareto frontier) is often intractable. However, for any multiplicative factor greater than one, an approximation set can be…

Optimization and Control · Mathematics 2026-04-30 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

Since its introduction, the skew-$t$ distribution has received much attention in the literature both for the study of theoretical properties and as a model for data fitting in empirical work. A major motivation for this interest is the high…

Computation · Statistics 2019-07-25 Adelchi Azzalini , Mahdi Salehi

In this paper, we develop a theory of new classes of discrete convex functions, called L-extendable functions and alternating L-convex functions, defined on the product of trees. We establish basic properties for optimization: a…

Optimization and Control · Mathematics 2016-01-19 Hiroshi Hirai

In this paper, we consider the following $k$-dispersion problem. Given a set $S$ of $n$ points placed in the plane in a convex position, and an integer $k$ ($0<k<n$), the objective is to compute a subset $S'\subset S$ such that $|S'|=k$ and…

Computational Geometry · Computer Science 2022-05-05 Vishwanath R. Singireddy , Manjanna Basappa

We present an algorithmic approach to estimate the value distributions of random variables of probabilistic loops whose statistical moments are (partially) known. Based on these moments, we apply two statistical methods, Maximum Entropy and…

We consider the problem of optimizing an approximately convex function over a bounded convex set in $\mathbb{R}^n$ using only function evaluations. The problem is reduced to sampling from an \emph{approximately} log-concave distribution…

Numerical Analysis · Computer Science 2020-07-27 Alexandre Belloni , Tengyuan Liang , Hariharan Narayanan , Alexander Rakhlin

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir