English
Related papers

Related papers: A Block Coordinate Descent Proximal Method for Sim…

200 papers

This article provides next step towards solving speed bottleneck of any system that intensively uses convolutions operations (e.g. CNN). Method described in the article is applied on deformable part models (DPM) algorithm. Method described…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 D. V. Parkhomenko , I. L. Mazurenko

We consider the problem of minimizing a convex function over a closed convex set, with Projected Gradient Descent (PGD). We propose a fully parameter-free version of AdaGrad, which is adaptive to the distance between the initialization and…

Machine Learning · Statistics 2023-06-01 Evgenii Chzhen , Christophe Giraud , Gilles Stoltz

Many real-world problems are categorized as large-scale problems, and metaheuristic algorithms as an alternative method to solve large-scale problem; they need the evaluation of many candidate solutions to tackle them prior to their…

Neural and Evolutionary Computing · Computer Science 2020-09-14 Shahryar Rahnamayan , Seyed Jalaleddin Mousavirad

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

In this paper, we study the convergence properties of a randomized block-coordinate descent algorithm for the minimization of a composite convex objective function, where the block-coordinates are updated asynchronously and randomly…

Optimization and Control · Mathematics 2023-04-14 Cheik Traoré , Saverio Salzo , Silvia Villa

In this study, we introduce a refined method for ascertaining error estimations in numerical simulations of dynamical systems via an innovative application of composition techniques. Our approach involves a dual application of a basic…

General Mathematics · Mathematics 2024-09-18 Ahmad Deeb , Denys Dutykh

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

We study low-complexity iterative decoding algorithms for product codes. We revisit two algorithms recently proposed by the authors based on bounded distance decoding (BDD) of the component codes that improve the performance of conventional…

Information Theory · Computer Science 2018-06-29 Alireza Sheikh , Alexandre Graell i Amat , Gianluigi Liva , Christian Häger , Henry D. Pfister

Approximate Bayesian Computation (ABC) is typically used when the likelihood is either unavailable or intractable but where data can be simulated under different parameter settings using a forward model. Despite the recent interest in ABC,…

Methodology · Statistics 2019-12-24 Rafael Izbicki , Ann B. Lee , Taylor Pospisil

Most of existing correlation filter-based tracking approaches only estimate simple axis-aligned bounding boxes, and very few of them is capable of recovering the underlying similarity transformation. To tackle this challenging problem, in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Yang Li , Jianke Zhu , Steven C. H. Hoi , Wenjie Song , Zhefeng Wang , Hantang Liu

In the era of Big Data, scalable and accurate clustering algorithms for high-dimensional data are essential. We present new Bayesian Distance Clustering (BDC) models and inference algorithms with improved scalability while maintaining the…

Methodology · Statistics 2024-09-02 Rafael Cabral , Maria de Iorio , Andrew Harris

The recent development of deep learning methods provides a new approach to optimize the belief propagation (BP) decoding of linear codes. However, the limitation of existing works is that the scale of neural networks increases rapidly with…

Information Theory · Computer Science 2021-02-11 Jincheng Dai , Kailin Tan , Zhongwei Si , Kai Niu , Mingzhe Chen , H. Vincent Poor , Shuguang Cui

In this paper we develop a randomized block-coordinate descent method for minimizing the sum of a smooth and a simple nonsmooth block-separable convex function and prove that it obtains an $\epsilon$-accurate solution with probability at…

Optimization and Control · Mathematics 2011-07-15 Peter Richtárik , Martin Takáč

Quantum low-density parity-check (qLDPC) codes are promising for realizing scalable fault-tolerant quantum computation due to their potential for low-overhead protocols. A common approach to decoding qLDPC codes is to use the belief…

Quantum Physics · Physics 2025-10-13 Kento Tsubouchi , Hayata Yamasaki , Shiro Tamiya

As the number of samples and dimensionality of optimization problems related to statistics an machine learning explode, block coordinate descent algorithms have gained popularity since they reduce the original problem to several smaller…

Machine Learning · Computer Science 2016-06-24 Rémi Flamary , Alain Rakotomamonjy , Gilles Gasso

We investigate the properties of a Block Decomposition Method (BDM), which extends the power of a Coding Theorem Method (CTM) that approximates local estimations of algorithmic complexity based upon Solomonoff-Levin's theory of algorithmic…

Information Theory · Computer Science 2018-06-20 Hector Zenil , Santiago Hernández-Orozco , Narsis A. Kiani , Fernando Soler-Toscano , Antonio Rueda-Toicen

High dimensional unconstrained quadratic programs (UQPs) involving massive datasets are now common in application areas such as web, social networks, etc. Unless computational resources that match up to these datasets are available, solving…

Optimization and Control · Mathematics 2014-07-15 Gugan Thoppe , Vivek S. Borkar , Dinesh Garg

Stochastic Dual Coordinate Descent (SDCD) has become one of the most efficient ways to solve the family of $\ell_2$-regularized empirical risk minimization problems, including linear SVM, logistic regression, and many others. The vanilla…

Machine Learning · Computer Science 2015-04-07 Cho-Jui Hsieh , Hsiang-Fu Yu , Inderjit S. Dhillon

POD-DL-ROMs have been recently proposed as an extremely versatile strategy to build accurate and reliable reduced order models (ROMs) for nonlinear parametrized partial differential equations, combining (i) a preliminary dimensionality…

Numerical Analysis · Mathematics 2023-05-09 Simone Brivio , Stefania Fresca , Nicola Rares Franco , Andrea Manzoni

We define the bidirectional distance profile (BDP) of a convolutional code as the minimum of the distance profiles of the code and its corresponding "reverse" code. We present tables of codes with the optimum BDP (OBDP), which minimize the…

Information Theory · Computer Science 2023-11-30 Ivan Stanojević , Vojin Šenk