English
Related papers

Related papers: Dimensionality Reduction of Affine Variational Ine…

200 papers

We present a novel variational approach to image restoration (e.g., denoising, inpainting, labeling) that enables to complement established variational approaches with a histogram-based prior enforcing closeness of the solution to some…

Optimization and Control · Mathematics 2013-07-18 Paul Swoboda , Christoph Schnörr

Dimensionality reduction-based dictionary learning methods in the literature have often used iterative random projections. The dimensionality of such a random projection matrix is a random number that might not lead to a separable subspace…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 G. Madhuri , Atul Negi , Kaluri V. Rangarao

We present a simple algorithm to approximate the viscosity solution of Hamilton-Jacobi (HJ) equations by means of an artificial deep neural network. The algorithm uses a stochastic gradient descent-based method to minimize the least square…

Numerical Analysis · Mathematics 2024-12-31 Carlos Esteve-Yagüe , Richard Tsai , Alex Massucco

We propose a computational method (with acronym ALDI) for sampling from a given target distribution based on first-order (overdamped) Langevin dynamics which satisfies the property of affine invariance. The central idea of ALDI is to run an…

Numerical Analysis · Mathematics 2020-04-10 Alfredo Garbuno-Inigo , Nikolas Nüsken , Sebastian Reich

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex.…

Optimization and Control · Mathematics 2024-06-07 Wei Jiang , Sifan Yang , Wenhao Yang , Yibo Wang , Yuanyu Wan , Lijun Zhang

We present a first-order method for solving constrained optimization problems. The method is derived from our previous work, a modified search direction method inspired by singular value decomposition. In this work, we simplify its…

Optimization and Control · Mathematics 2023-02-24 Long Chen , Kai-Uwe Bletzinger , Nicolas R. Gauger , Yinyu Ye

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

In this paper we propose a method for the approximation of high-dimensional functions over finite intervals with respect to complete orthonormal systems of polynomials. An important tool for this is the multivariate classical analysis of…

Numerical Analysis · Mathematics 2022-01-31 Daniel Potts , Michael Schmischke

We present a novel artificial diffusion method to circumvent the instabilities associated with the standard finite element approximation of convection-diffusion equations. Motivated by the micromorphic approach, we introduce an auxiliary…

Numerical Analysis · Mathematics 2025-06-19 Soheil Firooz , B. Daya Reddy , Paul Steinmann

Rational approximation appears in many contexts throughout science and engineering, playing a central role in linear systems theory, special function approximation, and many others. There are many existing methods for solving the rational…

Numerical Analysis · Mathematics 2018-12-03 Jeffrey M. Hokanson , Caleb C. Magruder

The article is devoted to the development of algorithmic methods ensuring efficient complexity bounds for strongly convex-concave saddle point problems in the case when one of the groups of variables is high-dimensional, and the other is…

Optimization and Control · Mathematics 2022-10-26 Egor Gladin , Ilya Kuruzov , Fedor Stonyakin , Dmitry Pasechnyuk , Mohammad Alkousa , Alexander Gasnikov

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

Visual Deformation Measurement (VDM) aims to recover dense deformation fields by tracking surface motion from camera observations. Traditional image-based methods rely on minimal inter-frame motion to constrain the correspondence search…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yuliang Wu , Wei Zhai , Yuxin Cui , Tiesong Zhao , Yang Cao , Zheng-Jun Zha

We develop a new proximal-gradient method for minimizing the sum of a differentiable, possibly nonconvex, function plus a convex, possibly non differentiable, function. The key features of the proposed method are the definition of a…

Numerical Analysis · Mathematics 2016-05-13 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

In this paper, we study randomized reduction methods, which reduce high-dimensional features into low-dimensional space by randomized methods (e.g., random projection, random hashing), for large-scale high-dimensional classification.…

Machine Learning · Computer Science 2015-07-21 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

In this paper, we address learning problems for high dimensional data. Previously, oblivious random projection based approaches that project high dimensional features onto a random subspace have been used in practice for tackling…

Machine Learning · Computer Science 2016-12-07 Yi Xu , Haiqin Yang , Lijun Zhang , Tianbao Yang

While nowadays visual anomaly detection algorithms use deep neural networks to extract salient features from images, the high dimensionality of extracted features makes it difficult to apply those algorithms to large data with 1000s of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Teng-Yok Lee

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

Optimization and Control · Mathematics 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava