中文
相关论文

相关论文: Proximal Gradient-Based Unfolding for Massive Rand…

200 篇论文

We study the problem of estimating high-dimensional regression models regularized by a structured sparsity-inducing penalty that encodes prior structural information on either the input or output variables. We consider two widely adopted…

机器学习 · 统计学 2012-07-02 Xi Chen , Qihang Lin , Seyoung Kim , Jaime G. Carbonell , Eric P. Xing

In this paper, we propose an efficient and flexible algorithm to solve dynamic mean-field planning problems based on an accelerated proximal gradient method. Besides an easy-to-implement gradient descent step in this algorithm, a crucial…

最优化与控制 · 数学 2021-03-01 Jiajia Yu , Rongjie Lai , Wuchen Li , Stanley Osher

Recovering images from undersampled linear measurements typically leads to an ill-posed linear inverse problem, that asks for proper statistical priors. Building effective priors is however challenged by the low train and test overhead…

人工智能 · 计算机科学 2017-11-29 Morteza Mardani , Hatef Monajemi , Vardan Papyan , Shreyas Vasanawala , David Donoho , John Pauly

We consider network topology identification subject to a signal smoothness prior on the nodal observations. A fast dual-based proximal gradient algorithm is developed to efficiently tackle a strongly convex, smoothness-regularized network…

机器学习 · 计算机科学 2021-10-20 Seyed Saman Saboksayr , Gonzalo Mateos

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

机器学习 · 统计学 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

图像与视频处理 · 电气工程与系统科学 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. Recent advances using the distributed gradient…

最优化与控制 · 数学 2019-05-14 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

We propose a novel joint activity, channel, and data estimation (JACDE) scheme for cell-free multiple-input multiple-output (MIMO) systems compliant with fifth-generation (5G) new radio (NR) orthogonal frequency-division multiplexing (OFDM)…

信号处理 · 电气工程与系统科学 2020-09-29 Hiroki Iimori , Takumi Takahashi , Koji Ishibashi , Giuseppe Thadeu Freitas de Abreu , Wei Yu

The lack of an efficient preamble detection algorithm remains a challenge for solving preamble collision problems in intelligent random access (RA) in the cellular Internet of Things (IoT). To address this problem, we present an early…

信息论 · 计算机科学 2025-01-22 Xin Zhu , Ahmet Enis Cetin

This paper investigates the grant-free random access with massive IoT devices. By embedding the data symbols in the signature sequences, joint device activity detection and data decoding can be achieved, which, however, significantly…

机器学习 · 计算机科学 2020-01-29 Jialin Dong , Jun Zhang , Yuanming Shi , Jessie Hui Wang

Proximal gradient algorithms (PGA), while foundational for inverse problems like image reconstruction, often yield unstable convergence and suboptimal solutions by violating the critical non-negativity constraint. We identify the gradient…

机器学习 · 计算机科学 2025-10-28 Hanzhang Wang , Zonglin Liu , Jingyi Xu , Chenyang Wang , Zhiwei Zhong , Qiangqiang Shen

In recent years, even though Stochastic Gradient Descent (SGD) and its variants are well-known for training neural networks, it suffers from limitations such as the lack of theoretical guarantees, vanishing gradients, and excessive…

最优化与控制 · 数学 2022-02-17 Junxiang Wang , Hongyi Li , Liang Zhao

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

分布式、并行与集群计算 · 计算机科学 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan

Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants - using importance values defined by the complete gradient information which changes…

机器学习 · 计算机科学 2017-11-08 Sebastian U. Stich , Anant Raj , Martin Jaggi

We propose an optimization proxy in terms of iterative implicit gradient methods for solving constrained optimization problems with nonconvex loss functions. This framework can be applied to a broad range of machine learning settings,…

最优化与控制 · 数学 2025-10-14 Harshal D. Kaushik , Ming Jin

Compressive imaging aims to recover a latent image from under-sampled measurements, suffering from a serious ill-posed inverse problem. Recently, deep neural networks have been applied to this problem with superior results, owing to the…

图像与视频处理 · 电气工程与系统科学 2021-10-26 Yixiao Yang , Ran Tao , Kaixuan Wei , Ying Fu

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

机器学习 · 统计学 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

We study the overparametrization bounds required for the global convergence of stochastic gradient descent algorithm for a class of one hidden layer feed-forward neural networks, considering most of the activation functions used in…

机器学习 · 计算机科学 2022-11-17 Bartłomiej Polaczyk , Jacek Cyranka

This paper considers non-smooth optimization problems where we seek to minimize the pointwise maximum of a continuously parameterized family of functions. Since the objective function is given as the solution to a maximization problem,…

最优化与控制 · 数学 2026-01-12 Dimitris Boskos , Jorge Cortés , Sonia Martínez

A method for perfusion imaging with DCE-MRI is developed based on two popular paradigms: the low-rank + sparse model for optimisation-based reconstruction, and the deep unfolding. A learnable algorithm derived from a proximal algorithm is…

信号处理 · 电气工程与系统科学 2024-10-28 Ondřej Mokrý , Jiří Vitouš , Pavel Rajmic , Radovan Jiřík