English
Related papers

Related papers: A Homotopy Coordinate Descent Optimization Method …

200 papers

We introduce a novel multi-resolution Localized Orthogonal Decomposition (LOD) for time-harmonic acoustic scattering problems that can be modeled by the Helmholtz equation. The method merges the concepts of LOD and operator-adapted wavelets…

Numerical Analysis · Mathematics 2022-11-24 Moritz Hauck , Daniel Peterseim

Coordinate descent methods have considerable impact in global optimization because global (or, at least, almost global) minimization is affordable for low-dimensional problems. Coordinate descent methods with high-order regularized models…

Optimization and Control · Mathematics 2023-04-28 V. S. Amaral , R. Andreani , E. G. Birgin , D. S. Marcondes , J. M. Martínez

The problem of finding sparse solutions to underdetermined systems of linear equations arises in several applications (e.g. signal and image processing, compressive sensing, statistical inference). A standard tool for dealing with sparse…

Optimization and Control · Mathematics 2016-08-03 Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

In this paper we propose a novel parallel stochastic coordinate descent (SCD) algorithm with convergence guarantees that exhibits strong scalability. We start by studying a state-of-the-art parallel implementation of SCD and identify…

Machine Learning · Computer Science 2019-11-19 Nikolas Ioannou , Celestine Mendler-Dünner , Thomas Parnell

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

The Homotopy Analysis Method (HAM) is a powerful technique which allows to derive approximate solutions of both ordinary and partial differential equations. We propose to use a variational approach based on the Least Action Principle (LAP)…

Computational Physics · Physics 2025-01-28 Gervais Nazaire Chendjou Beukam , Jean Pierre Nguenang , Stefano Ruffo , Andrea Trombettoni

We propose an algorithm for the computational homogenization of locally periodic hyperelastic structures undergoing large deformations due to external quasi-static loading. The algorithm performs clustering of macroscopic deformations into…

Numerical Analysis · Mathematics 2026-02-26 Vladimír Lukeš , Eduard Rohan

Simultaneous variable selection and robust data fitting are important aspects of many mathematical modelling projects and a wide array of optimisation tools and techniques exist to support them. When the intention is to embed this…

Mathematical Software · Computer Science 2025-10-28 Stephen Michael Wright

In this paper, the hybrid sparse/diffuse (HSD) channel model in frequency domain is proposed. Based on the structural analysis on the resolvable paths and diffuse scattering statistics in the channel, the Hybrid Atomic-Least-Squares (HALS)…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Lei Lyu , Urbashi Mitra

In this paper, we propose a method of distributed stochastic gradient descent (SGD), with low communication load and computational complexity, and still fast convergence. To reduce the communication load, at each iteration of the algorithm,…

Machine Learning · Computer Science 2020-03-30 Naeimeh Omidvar , Mohammad Ali Maddah-Ali , Hamed Mahdavi

A least-squares neural network (LSNN) method was introduced for solving scalar linear and nonlinear hyperbolic conservation laws (HCLs) in [7, 6]. This method is based on an equivalent least-squares (LS) formulation and uses ReLU neural…

Numerical Analysis · Mathematics 2023-05-09 Zhiqiang Cai , Jingshuang Chen , Min Liu

Image hashing provides compact representations for efficient storage and retrieval but is inherently limited to global comparison and cannot reason about where changes occur. This limitation prevents hashing from being directly applicable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Anh-Kiet Duong , Marie-Claire Iatrides , Petra Gomez-Krämer , Jean-Michel Carozza

This paper is focused on the design of phase sequences with good (aperiodic) autocorrelation properties in terms of Peak Sidelobe Level (PSL) and Integrated Sidelobe Level (ISL). The problem is formulated as a bi-objective Pareto…

Information Theory · Computer Science 2016-12-20 M. Alaee , A. Aubry , A. De Maio , M. M. Naghsh , M. Modarres-Hashemi

Randomized Fast Subspace Descent (RFASD) Methods are developed and analyzed for smooth and non-constraint convex optimization problems. The efficiency of the method relies on a space decomposition which is stable in $A$-norm, and meanwhile,…

Optimization and Control · Mathematics 2020-06-12 Long Chen , Xiaozhe Hu , Huiwen Wu

Image-based anomaly detection systems are of vital importance in various manufacturing applications. The resolution and acquisition rate of such systems is increasing significantly in recent years under the fast development of image sensing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Shancong Mou , Jianjun Shi

Semi-supervised change detection (SSCD) aims to detect changes between bi-temporal remote sensing images by utilizing limited labeled data and abundant unlabeled data. Existing methods struggle in complex scenarios, exhibiting poor…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Qi'ao Xu , Pengfei Wang , Yanjun Li , Tianwen Qian , Xiaoling Wang

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

Optimization and Control · Mathematics 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

We first propose a decentralized proximal stochastic gradient tracking method (DProxSGT) for nonconvex stochastic composite problems, with data heterogeneously distributed on multiple workers in a decentralized connected network. To save…

Optimization and Control · Mathematics 2023-03-01 Yonggui Yan , Jie Chen , Pin-Yu Chen , Xiaodong Cui , Songtao Lu , Yangyang Xu

By the use of homotopy perturbation method-Pad\'e (HPM-Pad\'e) technique, a new analytical approximation of luminosity distance in the flat universe is proposed, which has the advantage of significant improvement for accuracy in…

Cosmology and Nongalactic Astrophysics · Physics 2021-01-20 Bo Yu , Jian-Chen Zhang , Tong-Jie Zhang , Tingting Zhang

Compressed sensing (CS) schemes are proposed for monostatic as well as synthetic aperture radar (SAR) imaging with chirped signals and Ultra-Narrowband (UNB) continuous waveforms. In particular, a simple, perturbation method is developed to…

Data Analysis, Statistics and Probability · Physics 2015-06-11 Albert Fannjiang , Hsiao-Chieh Tseng