English
Related papers

Related papers: A Constrained BA Algorithm for Rate-Distortion and…

200 papers

Non-reference metrics (NRMs) can assess the visual quality of images and videos without a reference, making them well-suited for the evaluation of user-generated content. Nonetheless, rate-distortion optimization (RDO) in video coding is…

Image and Video Processing · Electrical Eng. & Systems 2026-02-18 Xin Xiong , Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega , Neil Birkbeck , Balu Adsumilli

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

Nesterov's accelerated forward-backward algorithm (AFBA) is an efficient algorithm for solving a class of two-term convex optimization models consisting of a differentiable function with a Lipschitz continuous gradient plus a…

Numerical Analysis · Mathematics 2021-12-14 Yizun Lin , Si Li , Yunzhong Zhang

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

We study binary optimization problems of the form \( \min_{x\in\{-1,1\}^n} f(Ax-b) \) with possibly nonsmooth loss \(f\). Following the lifted rank-one semidefinite programming (SDP) approach\cite{qian2023matrix}, we develop a…

Optimization and Control · Mathematics 2026-01-07 Lianghai Xiao , Yitian Qian , Shaohua Pan

One popular approach to soft-decision decoding of Reed-Solomon (RS) codes is based on using multiple trials of a simple RS decoding algorithm in combination with erasing or flipping a set of symbols or bits in each trial. This paper…

Information Theory · Computer Science 2015-03-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

Nowadays, the Hough (discrete Radon) transform (HT/DRT) has proved to be an extremely powerful and widespread tool harnessed in a number of application areas, ranging from general image processing to X-ray computed tomography. Efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Danil Kazimirov , Dmitry Nikolaev , Ekaterina Rybakova , Arseniy Terekhin

The Boosted Difference of Convex functions Algorithm (BDCA) has been recently introduced to accelerate the performance of the classical Difference of Convex functions Algorithm (DCA). This acceleration is achieved thanks to an extrapolation…

Optimization and Control · Mathematics 2022-08-03 Francisco J. Aragón Artacho , Rubén Campoy , Phan T. Vuong

This paper describes an adaptive Lagrange multiplier determination method for rate-quality optimisation in video compression. Inspired by the experimental results of a Lagrange multiplier selection test, the presented approach adaptively…

Image and Video Processing · Electrical Eng. & Systems 2021-06-16 Fan Zhang , David R. Bull

In this paper, we accomplish a unified convergence analysis of a second-order method of multipliers (i.e., a second-order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the…

Optimization and Control · Mathematics 2021-10-01 Liang Chen , Junyuan Zhu , Xinyuan Zhao

In this paper, we are motivated by two important applications: entropy-regularized optimal transport problem and road or IP traffic demand matrix estimation by entropy model. Both of them include solving a special type of optimization…

Optimization and Control · Mathematics 2017-09-27 Pavel Dvurechensky , Alexander Gasnikov , Sergey Omelchenko , Alexander Tiurin

Mini-batch optimization has proven to be a powerful paradigm for large-scale learning. However, the state of the art parallel mini-batch algorithms assume synchronous operation or cyclic update orders. When worker nodes are heterogeneous…

Optimization and Control · Mathematics 2015-05-20 Hamid Reza Feyzmahdavian , Arda Aytekin , Mikael Johansson

Random reshuffling with momentum (RRM) corresponds to the SGD optimizer with momentum option enabled, as found in many machine learning libraries like PyTorch and TensorFlow. Despite its widespread use, the convergence properties of RRM do…

Optimization and Control · Mathematics 2026-03-24 Junwen Qiu , Bohao Ma , Andre Milzarek

The multi-reference alignment (MRA) problem entails estimating an image from multiple noisy and rotated copies of itself. If the noise level is low, one can reconstruct the image by estimating the missing rotations, aligning the images, and…

Signal Processing · Electrical Eng. & Systems 2022-06-17 Noam Janco , Tamir Bendory

This study introduces an iterative Bayesian Robbins--Monro (IBRM) sequence, which unites the classical Robbins--Monro sequence with statistical estimation for faster root-finding under noisy observations. Although the standard…

Optimization and Control · Mathematics 2025-08-19 Siwei Liu , Ke Ma , Stephan M. Goetz

Proximal gradient algorithms (PGA), while foundational for inverse problems like image reconstruction, often yield unstable convergence and suboptimal solutions by violating the critical non-negativity constraint. We identify the gradient…

Machine Learning · Computer Science 2025-10-28 Hanzhang Wang , Zonglin Liu , Jingyi Xu , Chenyang Wang , Zhiwei Zhong , Qiangqiang Shen

An adaptive regularization algorithm for unconstrained nonconvex optimization is proposed that is capable of handling inexact objective-function and derivative values, and also of providing approximate minimizer of arbitrary order. In…

Optimization and Control · Mathematics 2021-11-30 N. I. M. Gould , Ph. L. Toint

In this work, we develop a discretisation method for the mixed formulation of the magnetostatic problem supporting arbitrary orders and polyhedral meshes. The method is based on a global discrete de Rham (DDR) sequence, obtained by patching…

Numerical Analysis · Mathematics 2020-11-12 Daniele A. Di Pietro , Jérôme Droniou

This paper introduces a novel algorithmic solution for the approximation of a given multivariate function by a nomographic function that is composed of a one-dimensional continuous and monotone outer function and a sum of univariate…

Information Theory · Computer Science 2015-07-14 Steffen Limmer , Jafar Mohammadi , Slawomir Stanczak