English
Related papers

Related papers: Active Set and EM Algorithms for Log-Concave Densi…

200 papers

The EM algorithm is a novel numerical method to obtain maximum likelihood estimates and is often used for practical calculations. However, many of maximum likelihood estimation problems are nonconvex, and it is known that the EM algorithm…

Machine Learning · Statistics 2016-08-16 Hideyuki Miyahara , Koji Tsumura

Phenotypic variability in a population of cells can work as the bet-hedging of the cells under an unpredictably changing environment, the typical example of which is the bacterial persistence. To understand the strategy to control such…

Populations and Evolution · Quantitative Biology 2019-12-02 So Nakashima , Yuki Sughiyama , Tetsuya J. Kobayashi

We propose a novel iterative algorithm for solving a large sparse linear system. The method is based on the EM algorithm. If the system has a unique solution, the algorithm guarantees convergence with a geometric rate. Otherwise,…

Numerical Analysis · Mathematics 2018-08-03 Minwoo Chae , Stephen G. Walker

MONI (Rossi et al., {\it JCB} 2022) is a BWT-based compressed index for computing the matching statistics and maximal exact matches (MEMs) of a pattern (usually a DNA read) with respect to a highly repetitive text (usually a database of…

Data Structures and Algorithms · Computer Science 2023-11-09 Adrián Goga , Lore Depuydt , Nathaniel K. Brown , Jan Fostier , Travis Gagie , Gonzalo Navarro

We propose an accelerated meta-algorithm, which allows to obtain accelerated methods for convex unconstrained minimization in different settings. As an application of the general scheme we propose nearly optimal methods for minimizing…

Sampling from Gibbs distributions and computing their log-partition function are fundamental tasks in statistics, machine learning, and statistical physics. While efficient algorithms are known for log-concave densities, the worst-case…

Machine Learning · Statistics 2026-04-24 David Holzmüller , Francis Bach

In many applications the process of generating label information is expensive and time consuming. We present a new method that combines active and semi-supervised deep learning to achieve high generalization performance from a deep…

Machine Learning · Computer Science 2018-03-06 Matthias Rottmann , Karsten Kahl , Hanno Gottschalk

Visual attention mechanisms are a key component of neural network models for computer vision. By focusing on a discrete set of objects or image regions, these mechanisms identify the most relevant features and use them to build more…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 António Farinhas , André F. T. Martins , Pedro M. Q. Aguiar

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

In this paper, we propose a dynamical systems perspective of the Expectation-Maximization (EM) algorithm. More precisely, we can analyze the EM algorithm as a nonlinear state-space dynamical system. The EM algorithm is widely adopted for…

Optimization and Control · Mathematics 2018-10-05 Orlando Romero , Sarthak Chatterjee , Sérgio Pequito

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

The Student-$t$ distribution is widely used in statistical modeling of datasets involving outliers since its longer-than-normal tails provide a robust approach to hand such data. Furthermore, data collected over time may contain censored or…

This paper summarises the design of the candidate ED for the Challenge on Learned Image Compression 2024. This candidate aims at providing an anchor based on conventional coding technologies to the learning-based approaches mostly targeted…

Image and Video Processing · Electrical Eng. & Systems 2024-01-05 Pierrick Philippe , Théo Ladune , Stéphane Davenet , Thomas Leguay

We study nonparametric maximum likelihood estimation for two classes of multivariate distributions that imply strong forms of positive dependence; namely log-supermodular (MTP$_2$) distributions and log-$L^\#$-concave (LLC) distributions.…

Statistics Theory · Mathematics 2020-07-10 Elina Robeva , Bernd Sturmfels , Ngoc Tran , Caroline Uhler

This study proposes a data condensation method for multivariate kernel density estimation by genetic algorithm. First, our proposed algorithm generates multiple subsamples of a given size with replacement from the original sample. The…

Methodology · Statistics 2022-03-04 Kiheiji Nishida

Energy-based models (EBMs) are versatile density estimation models that directly parameterize an unnormalized log density. Although very flexible, EBMs lack a specified normalization constant of the model, making the likelihood of the model…

Machine Learning · Computer Science 2024-02-20 Louis Grenioux , Éric Moulines , Marylou Gabrié

We present a first procedure that can estimate -- with statistical consistency guarantees -- any local-maxima of a density, under benign distributional conditions. The procedure estimates all such local maxima, or $\textit{modal-sets}$, of…

Machine Learning · Statistics 2017-05-30 Heinrich Jiang , Samory Kpotufe

The application of Compresses Sensing is a promising physical layer technology for the joint activity and data detection of signals. Detecting the activity pattern correctly has severe impact on the system performance and is therefore of…

Information Theory · Computer Science 2014-04-04 Fabian Monsees , Carsten Bockelmann , Dirk Wübben , Armin Dekorsy

Regression analysis with missing data is a long-standing and challenging problem, particularly when there are many missing variables with arbitrary missing patterns. Likelihood-based methods, although theoretically appealing, are often…

Methodology · Statistics 2024-10-16 Ngok Sang Kwok , Kin Yau Wong

In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The…

Optimization and Control · Mathematics 2023-03-01 Spyridon Pougkakiotis , Jacek Gondzio , Dionysios S. Kalogerias