English
Related papers

Related papers: Fast Optimization with Zeroth-Order Feedback in Di…

200 papers

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Feedback optimization has emerged as a promising approach for optimizing the steady-state operation of dynamical systems while requiring minimal modeling efforts. Unfortunately, most existing feedback optimization methods rely on knowledge…

Optimization and Control · Mathematics 2025-09-16 Amir Mehrnoosh , Gianluca Bianchin

We study the design of receivers in extra-large scale MIMO (XL-MIMO) systems, i.e. systems in which the base station is equipped with an antenna array of extremely large dimensions. While XL-MIMO can significantly increase the system's…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Abolfazl Amiri , Sajad Rezaie , Carles Navarro Manchon , Elisabeth de Carvalho

Min-max optimization is emerging as a key framework for analyzing problems of robustness to strategically and adversarially generated data. We propose a random reshuffling-based gradient free Optimistic Gradient Descent-Ascent algorithm for…

Optimization and Control · Mathematics 2022-02-22 Chinmay Maheshwari , Chih-Yuan Chiu , Eric Mazumdar , S. Shankar Sastry , Lillian J. Ratliff

For the multiuser multiple-input multiple-output (MIMO) downlink channel, the users feedback their channel state information (CSI) to help the base station (BS) schedule users and improve the system sum rate. However, this incurs a large…

Information Theory · Computer Science 2011-03-22 Jin-Hao Li , Hsuan-Jung Su , Yu-Lun Tsai

In this paper, we study the communication and (sub)gradient computation costs in distributed optimization and give a sharp complexity analysis for the proposed distributed accelerated gradient methods. We present two algorithms based on the…

Optimization and Control · Mathematics 2020-08-19 Huan Li , Cong Fang , Wotao Yin , Zhouchen Lin

Cell-free massive multiple-input multiple-output (mMIMO) and extremely large-scale MIMO (XL-MIMO) are regarded as promising innovations for the forthcoming generation of wireless communication systems. Their significant advantages in…

Information Theory · Computer Science 2023-10-04 Zhilong Liu , Jiayi Zhang , Ziheng Liu , Hongyang Du , Zhe Wang , Dusit Niyato , Mohsen Guizani , Bo Ai

Resource allocation and multiple access schemes are instrumental for the success of communication networks, which facilitate seamless wireless connectivity among a growing population of uncoordinated and non-synchronized users. In this…

Signal Processing · Electrical Eng. & Systems 2023-06-22 Sajad Daei , Saeed Razavikia , Marios Kountouris , Mikael Skoglund , Gabor Fodor , Carlo Fischione

We analyze scheduling algorithms for multiuser communication systems with users having multiple antennas and linear receivers. When there is no feedback of channel information, we consider a common round robin scheduling algorithm, and…

Information Theory · Computer Science 2016-11-18 Raymond H. Y. Louie , Matthew R. McKay , Iain B. Collings

In this paper, we derive new closed-form expressions for the gradient of the mutual information with respect to arbitrary parameters of the two-user multiple access channel (MAC). The derived relations generalize the fundamental relation…

Information Theory · Computer Science 2014-11-07 Samah A. M. Ghanem

In this paper, resource allocation for multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) downlink networks with large numbers of base station antennas is studied. Assuming perfect channel state…

Information Theory · Computer Science 2012-11-16 Derrick Wing Kwan Ng , Robert Schober

Massive connectivity for extra large-scale multi-input multi-output (XL-MIMO) systems is a challenging issue due to the near-field access channels and the prohibitive cost. In this paper, we propose an uplink grant-free massive access…

Information Theory · Computer Science 2023-04-04 Yikun Mei , Zhen Gao , De Mi , Mingyu Zhou , Dezhi Zheng , Michail Matthaiou , Pei Xiao , Robert Schober

In this paper, we employ deep reinforcement learning to develop a novel radio resource allocation and packet scheduling scheme for different Quality of Service (QoS) requirements applicable to LTEadvanced and 5G networks. In addition,…

Signal Processing · Electrical Eng. & Systems 2020-08-18 Mahdi Nouri Boroujerdi , Mohammad Akbari , Roghayeh Joda , Mohammad Ali Maddah-Ali , Babak Hossein Khalaj

We present a hybrid systems framework for multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is a hybrid version of parallelized coordinate descent.…

Optimization and Control · Mathematics 2021-10-04 Katherine Hendrickson , Dawn Hustig-Schultz , Matthew Hale , Ricardo G. Sanfelice

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose a unified framework named Online Compressed Gradient Tracking (OCGT),…

Optimization and Control · Mathematics 2025-12-08 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao , Xiangyong Chen

Massive multiple-input multiple-output (mMIMO) regime reaps the benefits of spatial diversity and multiplexing gains, subject to precise channel state information (CSI) acquisition. In the current communication architecture, the downlink…

Information Theory · Computer Science 2022-08-26 Muhammad Karam Shehzad , Luca Rose , Stefan Wesemann , Mohamad Assaad , Syed Ali Hassan

A deep learning (DL)-based power control algorithm that solves the max-min user fairness problem in a cell-free massive multiple-input multiple-output (MIMO) system is proposed. Max-min rate optimization problem in a cell-free massive MIMO…

Signal Processing · Electrical Eng. & Systems 2021-02-23 Nuwanthika Rajapaksha , K. B. Shashika Manosha , Nandana Rajatheva , Matti Latva-aho

The rapid development of mobile networks proliferates the demands of high data rate, low latency, and high-reliability applications for the fifth-generation (5G) and beyond (B5G) mobile networks. Concurrently, the massive…

Networking and Internet Architecture · Computer Science 2024-04-02 Chih-Wei Huang , Yen-Cheng Chou , Hong-Yunn Chen , Cheng-Fu Chou

Fine-tuning large language models (LLMs) has achieved remarkable success across various NLP tasks, but the substantial memory overhead during backpropagation remains a critical bottleneck, especially as model scales grow. Zeroth-order (ZO)…

Computation and Language · Computer Science 2026-01-09 Feihu Jin , Shipeng Cen , Ying Tan