English
Related papers

Related papers: Alternating Minimization Schemes for Computing Rat…

200 papers

The optimal power flow (OPF) problem, which plays a central role in operating electrical networks is considered. The problem is nonconvex and is in fact NP hard. Therefore, designing efficient algorithms of practical relevance is crucial,…

Optimization and Control · Mathematics 2014-08-20 S. Magnússon , P. C. Weeraddana , C. Fischione

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

We address the problem of solving mixed random linear equations. We have unlabeled observations coming from multiple linear regressions, and each observation corresponds to exactly one of the regression models. The goal is to learn the…

Machine Learning · Statistics 2020-08-13 Avishek Ghosh , Kannan Ramchandran

A novel neural network (NN) approach is proposed for constrained optimization. The proposed method uses a specially designed NN architecture and training/optimization procedure called Neural Optimization Machine (NOM). The objective…

Machine Learning · Statistics 2022-08-10 Jie Chen , Yongming Liu

Deformable Attention Transformers (DAT) have shown remarkable performance in computer vision tasks by adaptively focusing on informative image regions. However, their data-dependent sampling mechanism introduces irregular memory access…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Wendong Mao , Mingfan Zhao , Jianfeng Guan , Qiwei Dong , Zhongfeng Wang

Sparse signal recovery based on nonconvex and nonsmooth optimization problems has significant applications and demonstrates superior performance in signal processing and machine learning. This work deals with a scale-invariant…

Optimization and Control · Mathematics 2025-09-29 Lang Yu , Nanjing Huang

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

Machine Learning · Computer Science 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

Alternating minimization (AM) procedures are practically efficient in many applications for solving convex and non-convex optimization problems. On the other hand, Nesterov's accelerated gradient is theoretically optimal first-order method…

Optimization and Control · Mathematics 2021-09-16 Sergey Guminov , Pavel Dvurechensky , Nazarii Tupitsa , Alexander Gasnikov

This paper presents an efficient optimization technique for super-resolution two-dimensional (2D) direction of arrival (DOA) estimation by introducing a new formulation of atomic norm minimization (ANM). ANM allows gridless angle estimation…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhi Tian , Zhe Zhang , Yue Wang

We consider the computation of the entanglement-assisted quantum rate-distortion function, which plays a central role in quantum information theory. We propose an efficient alternating minimization algorithm based on the Lagrangian…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Deheng Yuan , Wenyi Zhang , Hao Wu , Huihui Wu

The relaxed optimal $k$-thresholding pursuit (ROTP) is a recent algorithm for linear inverse problems. This algorithm is based on the optimal $k$-thresholding technique which performs vector thresholding and error metric reduction…

Information Theory · Computer Science 2024-11-14 Zhong-Feng Sun , Yun-Bin Zhao , Jin-Chuan Zhou , Zheng-Hai Huang

This paper considers an optimization problem that components of the objective function are available at different nodes of a network and nodes are allowed to only exchange information with their neighbors. The decentralized alternating…

Optimization and Control · Mathematics 2015-11-27 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi

This paper presents an efficient optimization technique for gridless {2-D} line spectrum estimation, named decoupled atomic norm minimization (D-ANM). The framework of atomic norm minimization (ANM) is considered, which has been…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhe Zhang , Yue Wang , Zhi Tian

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class…

Optimization and Control · Mathematics 2025-01-14 Ganzhao Yuan

The storage and computation requirements of Convolutional Neural Networks (CNNs) can be prohibitive for exploiting these models over low-power or embedded devices. This paper reduces the computational complexity of the CNNs by minimizing an…

Neural and Evolutionary Computing · Computer Science 2017-01-17 Farkhondeh Kiaee , Christian Gagné , Mahdieh Abbasi

This paper proposes a two-level distributed algorithmic framework for solving the AC optimal power flow (OPF) problem with convergence guarantees. The presence of highly nonconvex constraints in OPF poses significant challenges to…

Optimization and Control · Mathematics 2021-06-14 Kaizhao Sun , Xu Andy Sun

The electrical network reconfiguration problem aims to minimize losses in a distribution system by adjusting switches while ensuring radial topology. The growing use of renewable energy and the complexity of managing modern power grids make…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Yacine Mokhtari , Patrick Coirault , Emmanuel Moulay , Jérôme Le Ny , Didier Larraillet

The rate-distortion-perception function (RDPF; Blau and Michaeli, 2019) has emerged as a useful tool for thinking about realism and distortion of reconstructions in lossy compression. Unlike the rate-distortion function, however, it is…

Information Theory · Computer Science 2021-04-29 Lucas Theis , Aaron B. Wagner