English
Related papers

Related papers: An Integrated Constrained Gradient Descent (iCGD) …

200 papers

Ill-posed linear inverse problems appear in many scientific setups, and are typically addressed by solving optimization problems, which are composed of data fidelity and prior terms. Recently, several works have considered a back-projection…

Optimization and Control · Mathematics 2021-08-10 Tom Tirer , Raja Giryes

The conjugate gradient (CG) method is an efficient iterative method for solving large-scale strongly convex quadratic programming (QP). In this paper we propose some generalized CG (GCG) methods for solving the $\ell_1$-regularized…

Optimization and Control · Mathematics 2016-02-15 Zhaosong Lu , Xiaojun Chen

Sketched gradient algorithms have been recently introduced for efficiently solving the large-scale constrained Least-squares regressions. In this paper we provide novel convergence analysis for the basic method {\it Gradient Projection…

Optimization and Control · Mathematics 2017-06-05 Junqi Tang , Mohammad Golbabaee , Mike Davies

Provably solving stochastic convex optimization problems with constraints is essential for various problems in science, business, and statistics. Recently proposed XOR-Stochastic Gradient Descent (XOR-SGD) provides a convergence rate…

Optimization and Control · Mathematics 2022-03-23 Fan Ding , Yijie Wang , Jianzhu Ma , Yexiang Xue

Elliptically-contoured distributions (ECD) play a significant role, in computer vision, image processing, radar, and biomedical signal processing. Maximum likelihood. estimation (MLE) of ECD leads to a system of non-linear equations,…

Signal Processing · Electrical Eng. & Systems 2020-11-06 Jialun Zhou , Salem Said , Yannick Berthoumieu

We present a novel non-iterative learnable method for partial-to-partial 3D shape registration. The partial alignment task is extremely complex, as it jointly tries to match between points and identify which points do not appear in the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Dvir Ginzburg , Dan Raviv

We propose a novel algorithm for the fitting of 3D human shape to images. Combining the accuracy and refinement capabilities of iterative gradient-based optimization techniques with the robustness of deep neural networks, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jie Song , Xu Chen , Otmar Hilliges

Stochastic gradient descent (SGD) algorithm and its variations have been effectively used to optimize neural network models. However, with the rapid growth of big data and deep learning, SGD is no longer the most suitable choice due to its…

Machine Learning · Computer Science 2024-02-13 Anuraganand Sharma

Integrated Sensing and Communication (ISAC) has emerged as a promising technology for next-generation wireless networks. In this work, we tackle an ill-posed parameter estimation problem within ISAC, formulating it as a joint blind…

Information Theory · Computer Science 2024-10-14 Zeyu Xiang , Haifeng Wang , Jiayi Lv , Yujie Wang , Yuxue Wang , Yuxuan Ma , Jinchi Chen

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

Ptychography is a popular microscopic imaging modality for many scientific discoveries and sets the record for highest image resolution. Unfortunately, the high image resolution for ptychographic reconstruction requires significant amount…

Image and Video Processing · Electrical Eng. & Systems 2022-12-19 Xiao Wang , Aristeidis Tsaris , Debangshu Mukherjee , Mohamed Wahib , Peng Chen , Mark Oxley , Olga Ovchinnikova , Jacob Hinkle

We propose new, more efficient targeted white-box attacks against deep neural networks. Our attacks better align with the attacker's goal: (1) tricking a model to assign higher probability to the target class than to any other class, while…

Machine Learning · Computer Science 2022-06-22 Weiran Lin , Keane Lucas , Lujo Bauer , Michael K. Reiter , Mahmood Sharif

Recently, there has been growing interest in developing optimization methods for solving large-scale machine learning problems. Most of these problems boil down to the problem of minimizing an average of a finite set of smooth and strongly…

Optimization and Control · Mathematics 2018-02-09 Aryan Mokhtari , Mert Gürbüzbalaban , Alejandro Ribeiro

Computed Tomography (CT) reconstruction is a fundamental component to a wide variety of applications ranging from security, to healthcare. The classical techniques require measuring projections, called sinograms, from a full 180$^\circ$…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Rushil Anirudh , Hyojin Kim , Jayaraman J. Thiagarajan , K. Aditya Mohan , Kyle Champley , Timo Bremer

Computed Tomography (CT) image reconstruction is crucial for accurate diagnosis and deep learning approaches have demonstrated significant potential in improving reconstruction quality. However, the choice of loss function profoundly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Yipeng Sun , Yixing Huang , Linda-Sophie Schneider , Mareike Thies , Mingxuan Gu , Siyuan Mei , Siming Bayer , Andreas Maier

The randomized coordinate descent (RCD) method is a classical algorithm with simple, lightweight iterations that is widely used for various optimization problems, including the solution of positive semidefinite linear systems. As a linear…

Numerical Analysis · Mathematics 2026-02-13 Jackie Lok , Elizaveta Rebrova

The constrained gradient method (CGM) has recently been proposed to solve convex optimization and monotone variational inequality (VI) problems with general functional constraints. While existing literature has established convergence…

Optimization and Control · Mathematics 2025-11-24 Danqing Zhou , Hongmei Chen , Shiqian Ma , Junfeng Yang

In this paper, we propose a scalable algorithm for spectral embedding. The latter is a standard tool for graph clustering. However, its computational bottleneck is the eigendecomposition of the graph Laplacian matrix, which prevents its…

Machine Learning · Computer Science 2019-04-12 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

Estimating accurate 3D locations of objects from monocular images is a challenging problem because of lacking depth. Previous work shows that utilizing the object's keypoint projection constraints to estimate multiple depth candidates…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yingyan Li , Yuntao Chen , Jiawei He , Zhaoxiang Zhang

This paper considers the problem of implementing large-scale gradient descent algorithms in a distributed computing setting in the presence of {\em straggling} processors. To mitigate the effect of the stragglers, it has been previously…

Machine Learning · Statistics 2019-01-04 Raj Kumar Maity , Ankit Singh Rawat , Arya Mazumdar