English
Related papers

Related papers: Revisiting Atomic Norm Minimization: A Sequential …

200 papers

Recht, Fazel, and Parrilo provided an analogy between rank minimization and $\ell_0$-norm minimization. Subject to the rank-restricted isometry property, nuclear norm minimization is a guaranteed algorithm for rank minimization. The…

Numerical Analysis · Mathematics 2009-05-01 Kiryung Lee , Yoram Bresler

Sharpness-Aware Minimization (SAM) is an optimization method that improves generalization performance of machine learning models. Despite its superior generalization, SAM has not been actively used in real-world applications due to its…

Machine Learning · Computer Science 2025-03-17 Junhyuk Jo , Jihyun Lim , Sunwoo Lee

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

In this paper, we have proposed a novel algorithm for identifying the modulation scheme of an unknown incoming signal in order to mitigate the interference with primary user in Cognitive Radio systems, which is facilitated by using…

Signal Processing · Electrical Eng. & Systems 2018-06-21 K. Pavan Kumar Reddy , K. Lakhan Shiva , K. Abhilash , Y. Yoganandam

Parametric channel estimation in mmWave not only enables the anticipated large spectral efficiency gains of \acs{MIMO} systems but also reveals important propagation parameters, allowing for a low complexity representation of the channel…

Information Theory · Computer Science 2024-09-04 Álvaro Callejas-Ramos , Matilde Sánchez-Fernández , Antonia Tulino , Jaime Llorca

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

Iterative Refinement (IR) is a classical computing technique for obtaining highly precise solutions to linear systems of equations, as well as linear optimization problems. In this paper, motivated by the limited precision of quantum…

Optimization and Control · Mathematics 2023-12-19 Mohammadhossein Mohammadisiahroudi , Brandon Augustino , Pouya Sampourmahani , Tamás Terlaky

We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic…

Machine Learning · Computer Science 2012-07-03 Haim Avron , Satyen Kale , Shiva Kasiviswanathan , Vikas Sindhwani

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

L1-minimization refers to finding the minimum L1-norm solution to an underdetermined linear system b=Ax. Under certain conditions as described in compressive sensing theory, the minimum L1-norm solution is also the sparsest solution. In…

Computer Vision and Pattern Recognition · Computer Science 2012-08-28 Allen Y. Yang , Zihan Zhou , Arvind Ganesh , S. Shankar Sastry , Yi Ma

The widely used nuclear norm heuristic for rank minimization problems introduces a regularization parameter which is difficult to tune. We have recently proposed a method to approximate the regularization path, i.e., the optimal solution as…

Systems and Control · Computer Science 2015-04-22 Niclas Blomberg , Cristian R. Rojas , Bo Wahlberg

PhaseLift is a noted convex optimization technique for phase retrieval that can recover a signal exactly from amplitude measurements only, with high probability. Conventional PhaseLift requires a relatively large number of samples that…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhe Zhang , Zhi Tian

Modern applications of atomic physics, including the determination of frequency standards, and the analysis of astrophysical spectra, require prediction of atomic properties with exquisite accuracy. For complex atomic systems,…

Atomic Physics · Physics 2024-08-02 Pavlo Bilous , Charles Cheung , Marianna Safronova

Spectral decomposition of linear operators plays a central role in many areas of machine learning and scientific computing. Recent work has explored training neural networks to approximate eigenfunctions of such operators, enabling scalable…

Machine Learning · Computer Science 2025-10-28 J. Jon Ryu , Samuel Zhou , Gregory W. Wornell

In this article we propose a new deep learning approach to approximate operators related to parametric partial differential equations (PDEs). In particular, we introduce a new strategy to design specific artificial neural network (ANN)…

Numerical Analysis · Mathematics 2026-05-01 Arnulf Jentzen , Adrian Riekert , Philippe von Wurstemberger

Sharpness-Aware Minimization (SAM) has proven highly effective in improving model generalization in machine learning tasks. However, SAM employs a fixed hyperparameter associated with the regularization to characterize the sharpness of the…

Machine Learning · Computer Science 2024-12-24 Jinping Zou , Xiaoge Deng , Tao Sun

The alternating minimization (AM) method is a fundamental method for minimizing convex functions whose variable consists of two blocks. How to efficiently solve each subproblems when applying the AM method is the most concerned task. In…

Optimization and Control · Mathematics 2015-01-16 Hui Zhang , Lizhi Cheng

The low rank tensor completion (LRTC) problem has attracted great attention in computer vision and signal processing. How to acquire high quality image recovery effect is still an urgent task to be solved at present. This paper proposes a…

Numerical Analysis · Mathematics 2022-07-12 Hongbing Zhang , Xinyi Liu , Hongtao Fan , Yajing Li , Yinlin Ye

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability. Indeed, optimizing only the training loss value, as is commonly done, can easily lead to suboptimal model…

Machine Learning · Computer Science 2021-04-30 Pierre Foret , Ariel Kleiner , Hossein Mobahi , Behnam Neyshabur