English
Related papers

Related papers: A Learning Aided Flexible Gradient Descent Approac…

200 papers

Precoding design for maximizing weighted sum-rate (WSR) is a fundamental problem for downlink of massive multi-user multiple-input multiple-output (MU-MIMO) systems. It is well-known that this problem is generally NP-hard due to the…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Xiaotong Zhao , Siyuan Lu , Qingjiang Shi , Zhi-Quan Luo

Large Language Models (LLMs) are very demanding in terms of their computational resources. Low-rank decompositions of LLM weights, e.g. via Singular Value Decomposition (SVD), is a promising approach for LLM compression, but presents…

Machine Learning · Computer Science 2025-12-04 Roman Rausch , David Jansen , Sukhbinder Singh , Román Orús

The graphical Lasso (GLASSO) is a widely used algorithm for learning high-dimensional undirected Gaussian graphical models (GGM). Given i.i.d. observations from a multivariate normal distribution, GLASSO estimates the precision matrix by…

Methodology · Statistics 2026-01-15 Ha Nguyen , Sumanta Basu

Multiple-input multiple-output (MIMO) systems play a key role in wireless communication technologies. A widely considered approach to realize scalable MIMO systems involves architectures comprised of multiple separate modules, each with its…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Ohad Levy , Nir Shlezinger

The optimization algorithms are crucial in training physics-informed neural networks (PINNs), as unsuitable methods may lead to poor solutions. Compared to the common gradient descent (GD) algorithm, implicit gradient descent (IGD)…

Machine Learning · Computer Science 2025-08-04 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

This paper explores the benefit of using some of the machine learning techniques and Big data optimization tools in approximating maximum likelihood (ML) detection of Large Scale MIMO systems. First, large scale MIMO detection problem is…

Information Theory · Computer Science 2018-01-17 Anis Elgabli , Ali Elghariani , Abubakr O. Al-Abbasi , Mark Bell

This paper proposes a novel liquid intelligent metasurface (LIM)-assisted downlink multi-user multiple-input single-output (MISO) system, wherein both the base station (BS) and the metasurface are respectively equipped with fluid antennas…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Li-Hsiang Shen

Owing to the unique advantages of low cost and controllability, reconfigurable intelligent surface (RIS) is a promising candidate to address the blockage issue in millimeter wave (mmWave) communication systems, consequently has captured…

Information Theory · Computer Science 2022-02-24 Yuqian Zhu , Zhu Bo , Ming Li , Yang Liu , Qian Liu , Zheng Chang , Yulin Hu

Stacked intelligent metasurfaces (SIM) provide a cost-effective and scalable solution for large-scale antenna communications.However, efficient channel state information acquisition and phase shift optimization remain critical challenges.…

Information Theory · Computer Science 2026-05-26 Qian Zhang , Ju Liu , Yao Ge , Yufei Zhao , Wali Ullah Khan , Zheng Dong , Yong Liang Guan , Chau Yuen

Stochastic gradient descent (SGD) is a standard optimization method to minimize a training error with respect to network parameters in modern neural network learning. However, it typically suffers from proliferation of saddle points in the…

Machine Learning · Computer Science 2017-11-23 Haiping Huang , Taro Toyoizumi

We consider a distributed learning problem over multiple access channel (MAC) using a large wireless network. The computation is made by the network edge and is based on received data from a large number of distributed nodes which transmit…

Machine Learning · Computer Science 2020-06-24 Tomer Sery , Kobi Cohen

In this work, we explore the capabilities of multiplexed gradient descent (MGD), a scalable and efficient perturbative zeroth-order training method for estimating the gradient of a loss function in hardware and training it via stochastic…

Machine Learning · Computer Science 2025-05-01 Bakhrom G. Oripov , Andrew Dienstfrey , Adam N. McCaughan , Sonia M. Buckley

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

Communication efficiency is of importance for wireless federated learning systems. In this paper, we propose a communication-efficient strategy for federated learning over multiple-input multiple-output (MIMO) multiple access channels…

Information Theory · Computer Science 2022-06-14 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Namyoon Lee

SGD (Stochastic Gradient Descent) is a popular algorithm for large scale optimization problems due to its low iterative cost. However, SGD can not achieve linear convergence rate as FGD (Full Gradient Descent) because of the inherent…

Machine Learning · Computer Science 2017-12-05 Aixiang Chen , Bingchuan Chen , Xiaolong Chai , Rui Bian , Hengguang Li

We consider a distributed learning problem in a wireless network, consisting of N distributed edge devices and a parameter server (PS). The objective function is a sum of the edge devices' local loss functions, who aim to train a shared…

Machine Learning · Computer Science 2021-10-11 Raz Paul , Yuval Friedman , Kobi Cohen

Characterizing the global maximum of weighted sum-rate (WSR) for the K-user Gaussian interference channel (GIC), with the interference treated as Gaussian noise, is a key problem in wireless communication. However, due to the users' mutual…

Information Theory · Computer Science 2016-11-17 Liang Liu , Rui Zhang , Kee-Chaing Chua

In this paper, we consider hybrid beamforming designs for multiuser massive multiple-input multiple-output (MIMO)-orthogonal frequency division multiplexing (OFDM) systems. Aiming at maximizing the weighted spectral efficiency, we propose…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Jingbo Du , Wei Xu , Chunming Zhao , Luc Vandendorpe

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

Integrating massive multiple-input multiple-output (mMIMO) systems with intelligent reflecting surfaces (IRS) presents a promising paradigm for enhancing physical-layer security (PLS) in wireless communications. However, deploying…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Weijie Xiong , Jian Yang , Jingran Lin , Hongli Liu , Zhiling Xiao , Qiang Li