English
Related papers

Related papers: Efficient first-order algorithms for large-scale, …

200 papers

Contextual bandits can solve a huge range of real-world problems. However, current popular algorithms to solve them either rely on linear models, or unreliable uncertainty estimation in non-linear models, which are required to deal with the…

Machine Learning · Computer Science 2023-02-01 Adam Elwood , Marco Leonardi , Ashraf Mohamed , Alessandro Rozza

Hierarchical decision making problems, such as bilevel programs and Stackelberg games, are attracting increasing interest in both the engineering and machine learning communities. Yet, existing solution methods lack either convergence…

Optimization and Control · Mathematics 2024-03-29 Panagiotis D. Grontas , Giuseppe Belgioioso , Carlo Cenedese , Marta Fochesato , John Lygeros , Florian Dörfler

The expectation-maximization (EM) algorithm is a well-known iterative method for computing maximum likelihood estimates from incomplete data. Despite its numerous advantages, a main drawback of the EM algorithm is its frequently observed…

Computation · Statistics 2018-08-14 Nicholas C. Henderson , Ravi Varadhan

Selecting an optimal subset of features or instances under an information theoretic criterion has become an effective preprocessing strategy for reducing data complexity while preserving essential information. This study investigates two…

Optimization and Control · Mathematics 2025-08-25 Taotao He , Jun Luo , Junkai Zhao

Recent works have proposed various explanations for the ability of modern large language models (LLMs) to perform in-context prediction. We propose an alternative conceptual viewpoint from an information-geometric and statistical…

Information Theory · Computer Science 2026-02-23 Sreejith Sreekumar , Nir Weinberger

In this work, a novel sequential Monte Carlo filter is introduced which aims at efficient sampling of high-dimensional state spaces with a limited number of particles. Particles are pushed forward from the prior to the posterior density…

Machine Learning · Statistics 2018-05-30 Manuel Pulido , Peter Jan vanLeeuwen

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

The Maximum Entropy Modeling Toolkit supports parameter estimation and prediction for statistical language models in the maximum entropy framework. The maximum entropy framework provides a constructive method for obtaining the unique…

cmp-lg · Computer Science 2008-02-03 Eric Sven Ristad

Maximum likelihood estimation is a valuable tool often applied to inverse problems in quantum theory. Estimation from small data sets can, however, have non unique solutions. We discuss this problem and propose to use Jaynes maximum entropy…

Data Analysis, Statistics and Probability · Physics 2009-11-10 J. Rehacek , Z. Hradil

Clustering is a widely used technique with a long and rich history in a variety of areas. However, most existing algorithms do not scale well to large datasets, or are missing theoretical guarantees of convergence. This paper introduces a…

Machine Learning · Statistics 2024-10-16 Yijia Zhou , Kyle A. Gallivan , Adrian Barbu

The main goal of this paper is to extend and apply the principle of maximum entropy (MaxEnt) to incomplete quantum process estimation tasks. We will define a so-called process entropy function being the von Neumann entropy of the state…

Quantum Physics · Physics 2009-11-13 Mario Ziman

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

Maximum entropy approach to classification is very well studied in applied statistics and machine learning and almost all the methods that exists in literature are discriminative in nature. In this paper, we introduce a maximum entropy…

Information Theory · Computer Science 2013-12-31 Ambedkar Dukkipati , Gaurav Pandey , Debarghya Ghoshdastidar , Paramita Koley , D. M. V. Satya Sriram

The missing data problem has been broadly studied in the last few decades and has various applications in different areas such as statistics or bioinformatics. Even though many methods have been developed to tackle this challenge, most of…

Machine Learning · Statistics 2021-06-10 Thu Nguyen , Khoi Minh Nguyen-Duy , Duy Ho Minh Nguyen , Binh T. Nguyen , Bruce Alan Wade

We discuss how maximum entropy methods may be applied to the reconstruction of Markov processes underlying empirical time series and compare this approach to usual frequency sampling. It is shown that, at least in low dimension, there…

Risk Management · Quantitative Finance 2015-06-23 Gregor Chliamovitch , Alexandre Dupuis , Bastien Chopard , Anton Golub

We derive several numerical methods for designing optimized first-order algorithms in unconstrained convex optimization settings. Our methods are based on the Performance Estimation Problem (PEP) framework, which casts the worst-case…

Optimization and Control · Mathematics 2025-07-29 Yassine Kamri , Julien M. Hendrickx , François Glineur

This paper aims at proposing a procedure to derive distributed algorithms for distributed consensus-based optimization by using distributed algorithms for network resource allocation and vice versa over switching networks with/without…

Optimization and Control · Mathematics 2022-08-04 Seyyed Shaho Alaviani , Atul Gajanan Kelkar , Umesh Vaidya

Simplified mechanistic models in ecology have been criticized for the fact that a good fit to data does not imply the mechanism is true: pattern does not equal process. In parallel, the maximum entropy principle (MaxEnt) has been applied in…

Populations and Evolution · Quantitative Biology 2017-05-02 James P. O'Dwyer , Andrew Rominger , Xiao Xiao

For a multinomial distribution, suppose that we have prior knowledge of the sum of the probabilities of some categories. This allows us to construct a submodel in a full (i.e., no-restriction) model. Maximum likelihood estimation (MLE)…

Statistics Theory · Mathematics 2021-06-07 Yo Sheena

The capability of a novel Kullback-Leibler divergence method is examined herein within the Kalman filter framework to select the input-parameter-state estimation execution with the most plausible results. This identification suffers from…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Marios Impraimakis