English
Related papers

Related papers: Steepest Descent Multimodulus Algorithm for Blind …

200 papers

Stochastic gradient descent based algorithms are typically used as the general optimization tools for most deep learning models. A Restricted Boltzmann Machine (RBM) is a probabilistic generative model that can be stacked to construct deep…

Machine Learning · Statistics 2017-04-07 Kai Fan

This paper deals with SC/FDE within a MU-MIMO system where a large number of BS antennas is adopted. In this context, either linear or reduced-complexity iterative DF detection techniques are considered. Regarding performance evaluation by…

Information Theory · Computer Science 2015-02-20 Paulo Torres , Luis Charrua , Antonio Gusmao

Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning. We propose the quasi-hyperbolic momentum algorithm (QHM) as an extremely simple alteration of momentum SGD, averaging a plain SGD step with a…

Machine Learning · Computer Science 2019-05-03 Jerry Ma , Denis Yarats

Spike and slab priors play a key role in inducing sparsity for sparse signal recovery. The use of such priors results in hard non-convex and mixed integer programming problems. Most of the existing algorithms to solve the optimization…

Methodology · Statistics 2019-04-02 Fekadu L. Bayisa , Zhiyong Zhou , Ottmar Cronie , Jun Yu

A neighborhood restricted Mixed Gibbs Sampling (MGS) based approach is proposed for low-complexity high-order modulation large-scale Multiple-Input Multiple-Output (LS-MIMO) detection. The proposed LS-MIMO detector applies a neighborhood…

Information Theory · Computer Science 2021-04-20 Alex Mussi , Taufik Abrão

Monocular Metric Depth Estimation (MMDE) is essential for physically intelligent systems, yet accurate depth estimation for underrepresented classes in complex scenes remains a persistent challenge. To address this, we propose RAD, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Michael Baltaxe , Dan Levi , Sagie Benaim

Two-dimensional (2D) Multiple Signal Classification algorithm is a powerful technique for high-resolution direction-of-arrival (DOA) estimation in array signal processing. However, the exhaustive search over the 2D an-gular domain leads to…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Bo Zhou , Kaijie Xu , Yinghui Quan , Mengdao Xing

Classical primal-dual algorithms attempt to solve $\max_{\mu}\min_{x} \mathcal{L}(x,\mu)$ by alternatively minimizing over the primal variable $x$ through primal descent and maximizing the dual variable $\mu$ through dual ascent. However,…

Optimization and Control · Mathematics 2023-11-20 Kaizhao Sun , Andy Sun

Stacked intelligent metasurfaces (SIM) provide a cost-effective and scalable solution for large-scale antenna communications.However, efficient channel state information acquisition and phase shift optimization remain critical challenges.…

Information Theory · Computer Science 2026-05-26 Qian Zhang , Ju Liu , Yao Ge , Yufei Zhao , Wali Ullah Khan , Zheng Dong , Yong Liang Guan , Chau Yuen

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

We propose Dual-Feedback Generalized Proximal Gradient Descent (DFGPGD) as a new, hardware-friendly, operator splitting algorithm. We then establish convergence guarantees under approximate computational errors and we derive theoretical…

Optimization and Control · Mathematics 2023-06-30 Anis Hamadouche , Yun Wu , Andrew M. Wallace , Joao F. C. Mota

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

We consider stochastic convex optimization problems where the objective is an expectation over smooth functions. For this setting we suggest a novel gradient estimate that combines two recent mechanism that are related to notion of…

Machine Learning · Computer Science 2025-03-06 Tehila Dahan , Kfir Y. Levy

We consider randomized block coordinate stochastic mirror descent (RBSMD) methods for solving high-dimensional stochastic optimization problems with strongly convex objective functions. Our goal is to develop RBSMD schemes that achieve a…

Optimization and Control · Mathematics 2019-02-15 Nahidsadat Majlesinasab , Farzad Yousefian , Arash Pourhabib

We study two variants of the mirror descent-ascent (MDA) algorithm for solving min-max problems on the space of measures: simultaneous and alternating. We work under assumptions of convexity-concavity and relative smoothness of the payoff…

Optimization and Control · Mathematics 2026-05-08 Razvan-Andrei Lascu , Mateusz B. Majka , Łukasz Szpruch

This paper presents adaptive bidirectional minimum mean-square error (MMSE) parameter estimation algorithms for fast-fading channels. The time correlation between successive channel gains is exploited to improve the estimation and tracking…

Information Theory · Computer Science 2013-06-12 Patrick Clarke , Rodrigo C. de Lamare

This paper presents a computationally efficient decoder for multiple antenna systems. The proposed algorithm can be used for any constellation (QAM or PSK) and any labeling method. The decoder is based on matrix-lifting Semi-Definite…

Information Theory · Computer Science 2007-09-12 Amin Mobasher , Amir K. Khandani

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

Low-light image enhancement is challenging due to complex degradations, including amplified noise, artifacts, and color distortion. While Retinex-based deep learning methods have achieved promising results, they primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Youssef Aboelwafa , Hicham G. Elmongui , Marwan Torki

This paper proposes novel pilot optimization and channel estimation algorithm for the downlink multiuser massive multiple input multiple output (MIMO) system with $K$ decentralized single antenna mobile stations (MSs), and time division…

Applications · Statistics 2014-02-07 Tadilo Endeshaw Bogale , Long Bao Le