English
Related papers

Related papers: Variable Projected Augmented Lagrangian Methods fo…

200 papers

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

Optimization and Control · Mathematics 2023-07-28 Sai Wang , Yi Gong

Non-smooth optimization is a core ingredient of many imaging or machine learning pipelines. Non-smoothness encodes structural constraints on the solutions, such as sparsity, group sparsity, low-rank and sharp edges. It is also the basis for…

Optimization and Control · Mathematics 2022-05-04 Clarice Poon , Gabriel Peyré

Large scale Gaussian process (GP) regression is infeasible for larger data sets due to cubic scaling of flops and quadratic storage involved in working with covariance matrices. Remedies in recent literature focus on divide-and-conquer,…

Methodology · Statistics 2020-05-28 Adam M. Edwards , Robert B. Gramacy

This paper considers a generic convex minimization template with affine constraints over a compact domain, which covers key semidefinite programming applications. The existing conditional gradient methods either do not apply to our template…

Optimization and Control · Mathematics 2019-01-16 Alp Yurtsever , Olivier Fercoq , Volkan Cevher

We develop hybrid projection methods for computing solutions to large-scale inverse problems, where the solution represents a sum of different stochastic components. Such scenarios arise in many imaging applications (e.g., anomaly detection…

Numerical Analysis · Mathematics 2022-06-15 Julianne Chung , Jiahua Jiang , Scot M. Miller , Arvind K. Saibaba

The optimal transport (OT) problem and its related problems have attracted significant attention and have been extensively studied in various applications. In this paper, we focus on a class of group-quadratic regularized OT problems which…

Optimization and Control · Mathematics 2024-04-04 Lei Yang , Ling Liang , Hong T. M. Chu , Kim-Chuan Toh

The multi-contact nonlinear complementarity problem (NCP) is a naturally arising challenge in robotic simulations. Achieving high performance in terms of both accuracy and efficiency remains a significant challenge, particularly in…

Robotics · Computer Science 2025-02-25 Jeongmin Lee , Minji Lee , Sunkyung Park , Jinhee Yun , Dongjun Lee

Modern approaches to perform Bayesian variable selection rely mostly on the use of shrinkage priors. That said, an ideal shrinkage prior should be adaptive to different signal levels, ensuring that small effects are ruled out, while keeping…

Methodology · Statistics 2024-11-14 Santiago Marin , Bronwyn Loong , Anton H. Westveld

We propose a practical inexact augmented Lagrangian method (iALM) for nonconvex problems with nonlinear constraints. We characterize the total computational complexity of our method subject to a verifiable geometric condition, which is…

Optimization and Control · Mathematics 2022-04-22 Mehmet Fatih Sahin , Armin Eftekhari , Ahmet Alacaoglu , Fabian Latorre , Volkan Cevher

In this paper, we develop a novel primal-dual semismooth Newton method for solving linearly constrained multi-block convex composite optimization problems. First, a differentiable augmented Lagrangian (AL) function is constructed by…

Optimization and Control · Mathematics 2024-05-17 Zhanwang Deng , Kangkang Deng , Jiang Hu , Zaiwen Wen

Language-augmented scene representations hold great promise for large-scale robotics applications such as search-and-rescue, smart cities, and mining. Many of these scenarios are time-sensitive, requiring rapid scene encoding while also…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Laszlo Szilagyi , Francis Engelmann , Jeannette Bohg

Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We…

Machine Learning · Statistics 2010-08-16 Matthias W. Seeger , Hannes Nickisch

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

Variational methods in imaging are nowadays developing towards a quite universal and flexible tool, allowing for highly successful approaches on tasks like denoising, deblurring, inpainting, segmentation, super-resolution, disparity, and…

Optimization and Control · Mathematics 2014-12-16 Martin Burger , Alex Sawatzky , Gabriele Steidl

We reinterpret Visual Autoregressive (VAR) models as iterative refinement models to identify which design choices drive their quality-efficiency trade-off. Instead of treating VAR only as next-scale autoregression, we formalise it as a…

Machine Learning · Computer Science 2026-02-17 Steve Hong , Samuel Belkadi

Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms…

Machine Learning · Statistics 2013-06-06 Mohammad Emtiyaz Khan , Aleksandr Y. Aravkin , Michael P. Friedlander , Matthias Seeger

We propose a variational regularisation approach for the problem of template-based image reconstruction from indirect, noisy measurements as given, for instance, in X-ray computed tomography. An image is reconstructed from such measurements…

Optimization and Control · Mathematics 2019-04-02 Lukas F. Lang , Sebastian Neumayer , Ozan Öktem , Carola-Bibiane Schönlieb

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

This paper develops the proximal method of multipliers for a class of nonsmooth convex optimization. The method generates a sequence of minimization problems (subproblems). We show that the sequence of approximations to the solutions of the…

Numerical Analysis · Mathematics 2020-01-14 Tomoya Takeuchi

Existing Vision-Language Pretraining (VLP) methods have achieved remarkable improvements across a variety of vision-language tasks, confirming their effectiveness in capturing coarse-grained semantic correlations. However, their capability…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yeyuan Wang , Dehong Gao , Lei Yi , Linbo Jin , Jinxia Zhang , Libin Yang , Xiaoyan Cai