English
Related papers

Related papers: A re-examination to the SCoTLASS problems for SPCA…

200 papers

We develop a first-order (pseudo-)gradient approach for optimizing functions over the stationary distribution of discrete-time Markov chains (DTMC). We give insights into why solving this optimization problem is challenging and show how…

Optimization and Control · Mathematics 2024-07-23 Nanne A. Dieleman , Joost Berkhout , Bernd Heidergott

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She

This paper investigates closed-loop stability of a linear discrete-time plant subject to bounded disturbances when controlled according to packetized predictive control (PPC) policies. In the considered feedback loop, the controller is…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Mohsen Barforooshan , Masaaki Nagahara , Jan Ostergaard

We describe a computational framework for simulating suspensions of rigid particles in Newtonian Stokes flow. One central building block is a collision-resolution algorithm that overcomes the numerical constraints arising from particle…

Computational Engineering, Finance, and Science · Computer Science 2020-06-24 Wen Yan , Eduardo Corona , Dhairya Malhotra , Shravan Veerapaneni , Michael Shelley

We provide a necessary and sufficient condition for the uniqueness of penalized least-squares estimators whose penalty term is given by a norm with a polytope unit ball, covering a wide range of methods including SLOPE, PACS, fused,…

Statistics Theory · Mathematics 2022-11-29 Ulrike Schneider , Patrick Tardivel

This paper studies the convergence rate of a continuous-time dynamical system for L1-minimization, known as the Locally Competitive Algorithm (LCA). Solving L1-minimization} problems efficiently and rapidly is of great interest to the…

Dynamical Systems · Mathematics 2017-04-26 Aurèle Balavoine , Christopher J. Rozell , Justin Romberg

Sketching algorithms have recently proven to be a powerful approach both for designing low-space streaming algorithms as well as fast polynomial time approximation schemes (PTAS). In this work, we develop new techniques to extend the…

Data Structures and Algorithms · Computer Science 2023-10-31 Gregory Dexter , Petros Drineas , David P. Woodruff , Taisuke Yasuda

SLOPE is a relatively new convex optimization procedure for high-dimensional linear regression via the sorted l1 penalty: the larger the rank of the fitted coefficient, the larger the penalty. This non-separable penalty renders many…

Machine Learning · Statistics 2019-07-18 Zhiqi Bu , Jason Klusowski , Cynthia Rush , Weijie Su

The Sloan Lens ACS (SLACS) is the best studied sample of strong lenses to date. Much of our knowledge of the SLACS lenses has been obtained by combining strong lensing with stellar kinematics constraints. However, interpreting stellar…

Astrophysics of Galaxies · Physics 2025-05-14 Alessandro Sonnenfeld

Spike sorting is a class of algorithms used in neuroscience to attribute the time occurences of particular electric signals, called action potential or spike, to neurons. We rephrase this problem as a particular optimization problem : Lasso…

Statistics Theory · Mathematics 2022-04-12 Laurent Dragoni , Rémi Flamary , Karim Lounici , Patricia Reynaud-Bouret

Fair principal component analysis (FPCA), a ubiquitous dimensionality reduction technique in signal processing and machine learning, aims to find a low-dimensional representation for a high-dimensional dataset in view of fairness. The FPCA…

Optimization and Control · Mathematics 2023-12-27 Meng Xu , Bo Jiang , Wenqiang Pu , Ya-Feng Liu , Anthony Man-Cho So

The theory of compressive sensing (CS) suggests that under certain conditions, a sparse signal can be recovered from a small number of linear incoherent measurements. An effective class of reconstruction algorithms involve solving a convex…

Information Theory · Computer Science 2015-05-13 Muhammad Salman Asif , Justin Romberg

We propose two sparsity-aware normalized subband adaptive filter (NSAF) algorithms by using the gradient descent method to minimize a combination of the original NSAF cost function and the l1-norm penalty function on the filter…

Signal Processing · Electrical Eng. & Systems 2018-10-18 Y. Yu , H. Zhao , R. C. de Lamare

Recent results in homotopy and solution paths demonstrate that certain well-designed greedy algorithms, with a range of values of the algorithmic parameter, can provide solution paths to a sequence of convex optimization problems. On the…

Statistics Theory · Mathematics 2009-09-29 Xiaoming Huo , Xuelei , Ni

The Attitude Determination and Control System is one of the critical boards of any satellite, specially the micro-satellites. The ADCS is the bridge linking sensors data to actuators by several computationally complex algorithms such as…

Systems and Control · Electrical Eng. & Systems 2020-03-18 Amir Hossein Alikhah Mishamandani

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

Machine Learning · Statistics 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang

We study equivalence, in the context of a variable diffusion problem, between (conforming) mixed methods and (primal) nonconforming methods defined on potentially general polytopal partitions. In this first paper of a series of two, we…

Numerical Analysis · Mathematics 2026-02-18 Simon Lemaire

Point cloud segmentation (PCS) is to classify each point in point clouds. The task enables robots to parse their 3D surroundings and run autonomously. According to different point cloud representations, existing PCS models can be roughly…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Bike Chen , Antti Tikanmäki , Juha Röning

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang