English
Related papers

Related papers: Adaptive Mixture Methods Based on Bregman Divergen…

200 papers

Bayes linear analysis and approximate Bayesian computation (ABC) are techniques commonly used in the Bayesian analysis of complex models. In this article we connect these ideas by demonstrating that regression-adjustment ABC algorithms…

Methodology · Statistics 2012-12-10 D. J. Nott , Y. Fan , L. Marshall , S. A. Sisson

Regularized regression models are well studied and, under appropriate conditions, offer fast and statistically interpretable results. However, large data in many applications are heterogeneous in the sense of harboring distributional…

Methodology · Statistics 2022-10-25 Konstantinos Perrakis , Thomas Lartigue , Frank Dondelinger , Sach Mukherjee

Many exact Markov chain Monte Carlo algorithms have been developed for posterior inference in Bayesian nonparametric models which involve infinite-dimensional priors. However, these methods are not generic and special methodology must be…

Computation · Statistics 2014-05-22 Jim E. Griffin

Building upon recent works on linesearch-free adaptive proximal gradient methods, this paper proposes adaPG$^{q,r}$, a framework that unifies and extends existing results by providing larger stepsize policies and improved lower bounds.…

Optimization and Control · Mathematics 2024-07-11 Puya Latafat , Andreas Themelis , Panagiotis Patrinos

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

In this paper, we present an efficient algorithm for solving a linear optimization problem with entropic constraints, a class of problems that arises in game theory and information theory. Our analysis distinguishes between the cases of…

Optimization and Control · Mathematics 2026-04-29 Luis M. Briceño-Arias , Maël Le Treust

Linear spectral unmixing under nonnegativity and sum-to-one constraints is a convex optimization problem for which many algorithms were proposed. In practice, especially for supervised unmixing (i.e., with a large dictionary), solutions…

Signal Processing · Electrical Eng. & Systems 2025-12-19 Nils Foix-Colonier , Sébastien Bourguignon

In this paper, we derive a practical, general framework for creating adaptive iterative (linearization or splitting) algorithms to solve multi-physics problems. This means that, given an iterative method, we derive \textit{a posteriori}…

Numerical Analysis · Mathematics 2026-01-26 Jakob S. Stokke , Kundan Kumar , Florin A. Radu

This paper introduces a Transformer-based integrative feature and cost aggregation network designed for dense matching tasks. In the context of dense matching, many works benefit from one of two forms of aggregation: feature aggregation,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Sunghwan Hong , Seokju Cho , Seungryong Kim , Stephen Lin

In this paper, using the Bregman distance, we introduce a new projection-type algorithm for finding a common element of the set of solutions of an equilibrium problem and the set of fixed points. Then the strong convergence of the sequence…

Optimization and Control · Mathematics 2021-12-28 Mostafa Ghadampour , Ebrahim Soori , Ravi P. Agarwal , Donal O'Regan

Classical model reduction techniques project the governing equations onto a linear subspace of the original state space. More recent data-driven techniques use neural networks to enable nonlinear projections. Whilst those often enable…

Numerical Analysis · Mathematics 2024-06-19 Tjeerd Jan Heeringa , Christoph Brune , Mengwu Guo

The discovery of linear embedding is the key to the synthesis of linear control techniques for nonlinear systems. In recent years, while Koopman operator theory has become a prominent approach for learning these linear embeddings through…

Robotics · Computer Science 2026-03-02 Rajpal Singh , Chandan Kumar Sah , Jishnu Keshavan

The random demodulator is a recent compressive sensing architecture providing efficient sub-Nyquist sampling of sparse band-limited signals. The compressive sensing paradigm requires an accurate model of the analog front-end to enable…

Information Theory · Computer Science 2013-03-26 Pawel Jerzy Pankiewicz , Thomas Arildsen , Torben Larsen

This work proposes a mathematically founded mixed precision accumulation strategy for the inference of neural networks. Our strategy is based on a new componentwise forward error analysis that explains the propagation of errors in the…

Machine Learning · Computer Science 2025-12-03 El-Mehdi El Arar , Silviu-Ioan Filip , Theo Mary , Elisa Riccietti

In this article, we propose a data-driven methodology for combining the solutions of a set of competing turbulence models. The individual model predictions are linearly combined for providing an ensemble solution accompanied by estimates of…

Fluid Dynamics · Physics 2023-01-24 Maximilien de Zordo-Banliat , Grégory Dergham , Xavier Merle , Paola Cinnella

Many metric learning tasks, such as triplet learning, nearest neighbor retrieval, and visualization, are treated primarily as embedding tasks where the ultimate metric is some variant of the Euclidean distance (e.g., cosine or Mahalanobis),…

Machine Learning · Computer Science 2023-11-22 Fred Lu , Edward Raff , Francis Ferraro

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

Employing nonparametric methods for density estimation has become routine in Bayesian statistical practice. Models based on discrete nonparametric priors such as Dirichlet Process Mixture (DPM) models are very attractive choices due to…

Methodology · Statistics 2017-07-03 J. J. Quinlan , F. A. Quintana , G. L. Page