English
Related papers

Related papers: Signed Support Recovery for Single Index Models in…

200 papers

Joint sparsity has attracted considerable attention in recent years in many fields including sparse signal recovery in compressed sensing (CS), statistics, and machine learning. Traditional convex models suffer from the suboptimal…

Numerical Analysis · Computer Science 2017-06-27 Yaru Fan , Yilun Wang , Tingzhu Huang

Sparse variable selection improves interpretability and generalization in high-dimensional learning by selecting a small subset of informative features. Recent advances in Mixed Integer Programming (MIP) have enabled solving large-scale…

Machine Learning · Statistics 2025-10-28 Petros Prastakos , Kayhan Behdin , Rahul Mazumder

Diffusion models (DMs) have demonstrated to be powerful priors for signal recovery, but their application to 1-bit quantization tasks, such as 1-bit compressed sensing and logistic regression, remains a challenge. This difficulty stems from…

Machine Learning · Computer Science 2026-01-13 Youming Chen , Zhaoqiang Liu

Sufficient dimension reduction (SDR) is an effective tool for regression models, offering a viable approach to address and analyze the nonlinear nature of regression problems. This paper introduces the itdr R package, a comprehensive and…

Methodology · Statistics 2023-07-18 Tharindu P. De Alwis , S. Yaser Samadi , Jiaying Weng

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

We investigated the imaging performance of a fast convergent ordered-subsets algorithm with subiteration-dependent preconditioners (SDPs) for positron emission tomography (PET) image reconstruction. In particular, we considered the use of…

Numerical Analysis · Mathematics 2022-06-09 Jianfeng Guo , C. Ross Schmidtlein , Andrzej Krol , Si Li , Yizun Lin , Sangtae Ahn , Charles Stearns , Yuesheng Xu

The problem of estimating a sparse signal from low dimensional noisy observations arises in many applications, including super resolution, signal deconvolution, and radar imaging. In this paper, we consider a sparse signal model with…

Information Theory · Computer Science 2020-06-24 Youye Xie , Michael B. Wakin , Gongguo Tang

We show a new way to round vector solutions of semidefinite programming (SDP) hierarchies into integral solutions, based on a connection between these hierarchies and the spectrum of the input graph. We demonstrate the utility of our method…

Data Structures and Algorithms · Computer Science 2011-04-26 Boaz Barak , Prasad Raghavendra , David Steurer

Symbolic Regression (SR) enables the discovery of interpretable mathematical relationships from experimental and simulation data. These relationships are often coined descriptors which are defined as a fundamental materials property that is…

Computational Physics · Physics 2026-02-10 Udaykumar Gajera , Mohsen Sotoudeh , Kanchan Sarkar , Axel Groß

Motivated by the settings where sensing the entire tensor is infeasible, this paper proposes a novel tensor compressed sensing model, where measurements are only obtained from sensing each lateral slice via mutually independent matrices.…

Machine Learning · Computer Science 2024-12-24 Tongle Wu , Ying Sun , Jicong Fan

This paper introduces a popular dimension reduction method, sliced inverse regression (SIR), into multivariate statistical process monitoring. Provides an extension of SIR for the single-index model by adopting the idea from partial least…

Applications · Statistics 2012-02-03 Yue Yu , Zhijie Sun

We consider the problem of estimating the discrete clustering structures under the Sub-Gaussian Mixture Model. Our main results establish a hidden integrality property of a semidefinite programming (SDP) relaxation for this problem: while…

Machine Learning · Statistics 2021-10-05 Yingjie Fei , Yudong Chen

This paper studies the exact recovery threshold subject to preserving the privacy of connections in $h$-uniform hypergraphs. Privacy is characterized by the $(\epsilon, \delta)$-hyperedge differential privacy (DP), an extension of the…

Information Theory · Computer Science 2026-01-08 Javad Zahedi Moghaddam , Aria Nosratinia

The sparsity of signals in a transform domain or dictionary has been exploited in applications such as compression, denoising and inverse problems. More recently, data-driven adaptation of synthesis dictionaries has shown promise compared…

Machine Learning · Computer Science 2019-06-14 Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

This paper studies the problem of shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we consider the model $y = \Pi_* X \beta_* + w$,…

Statistics Theory · Mathematics 2024-02-16 Leon Lufkin , Yihong Wu , Jiaming Xu

In this paper, we study a class of fractional semi-infinite polynomial programming problems involving s.o.s-convex polynomial functions. For such a problem, by a conic reformulation proposed in our previous work and the quadratic modules…

Optimization and Control · Mathematics 2022-12-29 Feng Guo , Meijun Zhang

We study the high-dimensional dynamics of online stochastic gradient descent (SGD) for the multi-spiked tensor model. This multi-index model arises from the tensor principal component analysis (PCA) problem with multiple spikes, where the…

Machine Learning · Statistics 2025-10-24 Gérard Ben Arous , Cédric Gerbelot , Vanessa Piccolo

As a fundamental problem in machine learning and differential privacy (DP), DP linear regression has been extensively studied. However, most existing methods focus primarily on either regular data distributions or low-dimensional cases with…

Machine Learning · Computer Science 2025-06-10 Xizhi Tian , Meng Ding , Touming Tao , Zihang Xiang , Di Wang

One-bit compressed sensing (1bCS) is an extremely quantized signal acquisition method that has been proposed and studied rigorously in the past decade. In 1bCS, linear samples of a high dimensional signal are quantized to only one bit per…

Information Theory · Computer Science 2022-11-01 Namiko Matsumoto , Arya Mazumdar , Soumyabrata Pal

Sliced inverse regression (SIR) is a popular sufficient dimension reduction method that identifies a few linear transformations of the covariates without losing regression information with the response. In high-dimensional settings, SIR can…

Methodology · Statistics 2025-12-04 Linh H. Nghiem , Francis. K. C. Hui , Samuel Muller , A. H. Welsh