English
Related papers

Related papers: Fast, Robust and Non-convex Subspace Recovery

200 papers

We focus on a class of non-smooth optimization problems over the Stiefel manifold in the decentralized setting, where a connected network of $n$ agents cooperatively minimize a finite-sum objective function with each component being weakly…

Optimization and Control · Mathematics 2023-04-03 Jinxin Wang , Jiang Hu , Shixiang Chen , Zengde Deng , Anthony Man-Cho So

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

We propose a new quantum state reconstruction method that combines ideas from compressed sensing, non-convex optimization, and acceleration methods. The algorithm, called Momentum-Inspired Factored Gradient Descent (\texttt{MiFGD}), extends…

Quantum Physics · Physics 2022-03-24 Junhyung Lyle Kim , George Kollias , Amir Kalev , Ken X. Wei , Anastasios Kyrillidis

We analyze stochastic algorithms for optimizing nonconvex, nonsmooth finite-sum problems, where the nonconvex part is smooth and the nonsmooth part is convex. Surprisingly, unlike the smooth case, our knowledge of this fundamental problem…

Optimization and Control · Mathematics 2016-05-24 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

Non-maximum suppression is an integral part of the object detection pipeline. First, it sorts all detection boxes on the basis of their scores. The detection box M with the maximum score is selected and all other detection boxes with a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Navaneeth Bodla , Bharat Singh , Rama Chellappa , Larry S. Davis

We present a fast trajectory optimization algorithm for the soft capture of uncooperative tumbling space objects. Our algorithm generates safe, dynamically feasible, and minimum-fuel trajectories for a six-degree-of-freedom servicing…

Robotics · Computer Science 2024-05-03 Ibrahima Sory Sow , Geordan Gutow , Howie Choset , Zachary Manchester

Decentralized sparsity learning has attracted a significant amount of attention recently due to its rapidly growing applications. To obtain the robust and sparse estimators, a natural idea is to adopt the non-smooth median loss combined…

Machine Learning · Statistics 2022-03-02 Weidong Liu , Xiaojun Mao , Xin Zhang

Non-line-of-Sight (NLOS) imaging systems collect light at a diffuse relay surface and input this measurement into computational algorithms that output a 3D volumetric reconstruction. These algorithms utilize the Fast Fourier Transform (FFT)…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Talha Sultan , Alex Bocchieri , Chaoying Gu , Xiaochun Liu , Pavel Polynkin , Andreas Velten

The problem of recovering a one-dimensional signal from its Fourier transform magnitude, called Fourier phase retrieval, is ill-posed in most cases. We consider the closely-related problem of recovering a signal from its phaseless…

Information Theory · Computer Science 2017-07-25 Tamir Bendory , Yonina C. Eldar , Nicolas Boumal

Man-made environments typically comprise planar structures that exhibit numerous geometric relationships, such as parallelism, coplanarity, and orthogonality. Making full use of these relationships can considerably improve the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Yangbin Lin , Jialian Li , Cheng Wang , Zhonggui Chen , Zongyue Wang , Jonathan Li

This paper is concerned with convex composite minimization problems in a Hilbert space. In these problems, the objective is the sum of two closed, proper, and convex functions where one is smooth and the other admits a computationally…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Pierre Moulin

We propose some algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. With the key observation of the velocity observable and controllable in the…

Optimization and Control · Mathematics 2017-10-17 Bin Shi

Depth maps captured by modern depth cameras such as Kinect and Time-of-Flight (ToF) are usually contaminated by missing data, noises and suffer from being of low resolution. In this paper, we present a robust method for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2015-12-29 Wei Liu , Yun Gu , Chunhua Shen , Xiaogang Chen , Qiang Wu , Jie Yang

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad

This paper proposes a random subspace trust-region algorithm for general convex-constrained derivative-free optimization (DFO) problems. Similar to previous random subspace DFO methods, the convergence of our algorithm requires a certain…

Optimization and Control · Mathematics 2026-05-14 Yiwen Chen , Warren Hare , Amy Wiebe

In this paper, we propose an exact general algorithm for solving non-convex optimization problems, where the non-convexity arises due to the presence of an inverse S-shaped function. The proposed method involves iteratively approximating…

Optimization and Control · Mathematics 2023-07-27 Arka Das , Ankur Sinha , Sachin Jayaswal

We establish risk bounds for Regularized Empirical Risk Minimizers (RERM) when the loss is Lipschitz and convex and the regularization function is a norm. In a first part, we obtain these results in the i.i.d. setup under subgaussian…

Statistics Theory · Mathematics 2021-01-07 Geoffrey Chinot , Guillaume Lecué , Matthieu Lerasle

Non-line-of-sight (NLOS) imaging seeks to reconstruct hidden objects by analyzing reflections from intermediary surfaces. Existing methods typically model both the measurement data and the hidden scene in three dimensions, overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yijun Wei , Jianyu Wang , Leping Xiao , Zuoqiang Shi , Xing Fu , Lingyun Qiu

Insufficient capability of existing subspace clustering methods to handle data coming from nonlinear manifolds, data corruptions, and out-of-sample data hinders their applicability to address real-world clustering and classification…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Dario Sitnik , Ivica Kopriva

We revisit the inductive matrix completion problem that aims to recover a rank-$r$ matrix with ambient dimension $d$ given $n$ features as the side prior information. The goal is to make use of the known $n$ features to reduce sample and…

Machine Learning · Statistics 2018-03-06 Xiao Zhang , Simon S. Du , Quanquan Gu