English
Related papers

Related papers: An Unsupervised Deep Unrolling Framework for Const…

200 papers

This work focuses on a class of general decentralized constraint-coupled optimization problems. We propose a novel nested primal-dual gradient algorithm (NPGA), which can achieve linear convergence under the weakest known condition, and its…

Optimization and Control · Mathematics 2025-05-06 Jingwang Li , Housheng Su

Obtaining pairs of low/normal-light videos, with motions, is more challenging than still images, which raises technical issues and poses the technical route of unpaired learning as a critical role. This paper makes endeavors in the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Lingyu Zhu , Wenhan Yang , Baoliang Chen , Hanwei Zhu , Zhangkai Ni , Qi Mao , Shiqi Wang

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

Networking and Internet Architecture · Computer Science 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

Decentralized distributed optimization over time-varying graphs (networks) is nowadays a very popular branch of research in optimization theory and consensus theory. One of the motivations to consider such networks is an application to…

Optimization and Control · Mathematics 2020-06-24 Alexander Rogozin , Alexander Gasnikov

We develop a novel framework to study smooth and strongly convex optimization algorithms, both deterministic and stochastic. Focusing on quadratic functions we are able to examine optimization algorithms as a recursive application of linear…

Optimization and Control · Mathematics 2015-03-25 Yossi Arjevani , Shai Shalev-Shwartz , Ohad Shamir

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

In this work we propose a new paradigm for designing efficient deep unrolling networks using operator sketching. The deep unrolling networks are currently the state-of-the-art solutions for imaging inverse problems. However, for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Junqi Tang , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regularizer with a…

Machine Learning · Computer Science 2021-12-24 Zhuo-Xu Cui , Jing Cheng , Qingyong Zhu , Yuanyuan Liu , Sen Jia , Kankan Zhao , Ziwen Ke , Wenqi Huang , Haifeng Wang , Yanjie Zhu , Dong Liang

Within the current sphere of deep learning research, despite the extensive application of optimization algorithms such as Stochastic Gradient Descent (SGD) and Adaptive Moment Estimation (Adam), there remains a pronounced inadequacy in…

Machine Learning · Computer Science 2025-10-30 Zhifeng Wang , Longlong Li , Chunyan Zeng

Deep learning based methods hold state-of-the-art results in image denoising, but remain difficult to interpret due to their construction from poorly understood building blocks such as batch-normalization, residual learning, and feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang

Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with…

Optimization and Control · Mathematics 2023-12-29 Bo Zhang , YueLin Gao , Xia Liu , XiaoLi Huang

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

Solving linear programs is often a challenging task in distributed settings. While there are good algorithms for solving packing and covering linear programs in a distributed manner (Kuhn et al.~2006), this is essentially the only class of…

Data Structures and Algorithms · Computer Science 2017-09-12 Michael Dinitz , Yasamin Nazari

Multi-user multiple-input multiple-output (MU-MIMO) beamforming design is typically formulated as a non-convex weighted sum rate (WSR) maximization problem that is known to be NP-hard. This problem is solved either by iterative algorithms,…

Signal Processing · Electrical Eng. & Systems 2022-10-28 Jing-Yuan Xia , Zhixiong Yang , Tong Qiu , Huaizhang Liao , Deniz Gunduz

Smart and reconfigurable wireless communication environments can be established by exploiting well-designed intelligent reflecting surfaces (IRSs) to shape the communication channels. In this paper, we investigate how multiple IRSs affect…

Generalized Benders decomposition (GBD) is a globally optimal algorithm for mixed integer nonlinear programming (MINLP) problems, which are NP-hard and can be widely found in the area of wireless resource allocation. The main idea of GBD is…

Information Theory · Computer Science 2020-10-16 Mengyuan Lee , Ning Ma , Guanding Yu , Huaiyu Dai

This paper focuses on integrating the networks and adversarial training into constrained optimization problems to develop a framework algorithm for constrained optimization problems. For such problems, we first transform them into minimax…

Optimization and Control · Mathematics 2024-07-08 Gang Bao , Dong Wang , Boyi Zou

Deep neural networks provide unprecedented performance gains in many real world problems in signal and image processing. Despite these gains, future development and practical deployment of deep networks is hindered by their blackbox nature,…

Image and Video Processing · Electrical Eng. & Systems 2020-08-10 Vishal Monga , Yuelong Li , Yonina C. Eldar

We present a unified analytical framework within which power control, rate allocation, routing, and congestion control for wireless networks can be optimized in a coherent and integrated manner. We consider a multi-commodity flow model with…

Networking and Internet Architecture · Computer Science 2007-09-18 Yufang Xi , Edmund M. Yeh

In frequency division duplex (FDD) massive MIMO systems, reliable downlink channel estimation is essential for the subsequent data transmission but is realized at the cost of massive pilot overhead due to hundreds of antennas at base…

Signal Processing · Electrical Eng. & Systems 2022-11-01 An Chen , Wenbo Xu , Liyang Lu , Yue Wang