English
Related papers

Related papers: Safe subspace screening for the adaptive nuclear n…

200 papers

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

Machine Learning · Statistics 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

The standard approach to compressive sampling considers recovering an unknown deterministic signal with certain known structure, and designing the sub-sampling pattern and recovery algorithm based on the known structure. This approach…

Information Theory · Computer Science 2016-02-03 Yen-Huan Li , Volkan Cevher

Submodular functions are discrete analogs of convex functions, which have applications in various fields, including machine learning and computer vision. However, in large-scale applications, solving Submodular Function Minimization (SFM)…

Machine Learning · Statistics 2018-06-08 Weizhong Zhang , Bin Hong , Lin Ma , Wei Liu , Tong Zhang

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations…

Numerical Analysis · Mathematics 2023-06-28 Misha E. Kilmer , Eric de Sturler

We give safe screening rules to eliminate variables from regression with $\ell_0$ regularization or cardinality constraint. These rules are based on guarantees that a feature may or may not be selected in an optimal solution. The screening…

Machine Learning · Statistics 2020-04-21 Alper Atamtürk , Andrés Gómez

The lasso is a popular method to induce shrinkage and sparsity in the solution vector (coefficients) of regression problems, particularly when there are many predictors relative to the number of observations. Solving the lasso in this…

Machine Learning · Statistics 2024-05-14 Johan Larsson

A method is presented to exploit adaptive integration algorithms using importance sampling, like VEGAS, for the task of scanning theoretical predictions depending on a multi-dimensional parameter space. Usually, a parameter scan is…

High Energy Physics - Phenomenology · Physics 2010-04-05 Oliver Brein

In industrial X-ray Computed Tomography (CT), the need for rapid in-line inspection is critical. Sparse-angle tomography plays a significant role in this by reducing the required number of projections, thereby accelerating processing and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tianyuan Wang , Felix Lucka , Daniël M. Pelt , K. Joost Batenburg , Tristan van Leeuwen

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

Robust support vector machine (RSVM) has been shown to perform remarkably well to improve the generalization performance of support vector machine under the noisy environment. Unfortunately, in order to handle the non-convexity induced by…

Machine Learning · Computer Science 2019-12-25 Zhou Zhai , Bin Gu , Xiang Li , Heng Huang

This work concerns the minimization of the pseudospectral abscissa of a matrix-valued function dependent on parameters analytically. The problem is motivated by robust stability and transient behavior considerations for a linear control…

Numerical Analysis · Mathematics 2024-06-21 Nicat Aliyev , Emre Mengi

In this paper, we develop a simple yet effective screening rule strategy to improve the computational efficiency in solving structured optimization involving nonconvex $\ell_{q,p}$ regularization. Based on an iteratively reweighted $\ell_1$…

Machine Learning · Computer Science 2022-08-04 Tiange Li , Xiangyu Yang , Hao Wang

It is the main goal of this paper to propose a novel method to perform matrix completion on-line. Motivated by a wide variety of applications, ranging from the design of recommender systems to sensor network localization through seismic…

Machine Learning · Statistics 2014-01-13 Charanpal Dhanjal , Romaric Gaudel , Stéphan Clémençon

Extracting latent low-dimensional structure from high-dimensional data is of paramount importance in timely inference tasks encountered with `Big Data' analytics. However, increasingly noisy, heterogeneous, and incomplete datasets as well…

Machine Learning · Statistics 2015-06-19 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

Group Ordered Weighted $L_{1}$-Norm (Group OWL) regularized models have emerged as a useful procedure for high-dimensional sparse multi-task learning with correlated features. Proximal gradient methods are used as standard approaches to…

Machine Learning · Computer Science 2025-04-09 Runxue Bao , Quanchao Lu , Yanfu Zhang

We consider the tuning parameter selection rules for nuclear norm regularized multivariate linear regression (NMLR) in high-dimensional setting. High-dimensional multivariate linear regression is widely used in statistics and machine…

Statistics Theory · Mathematics 2019-01-23 Pan Shang , Lingchen Kong

In resource-constrained environments, one can employ spatial multiplexing cameras to acquire a small number of measurements of a scene, and perform effective reconstruction or high-level inference using purely data-driven neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Suhas Lohit , Rajhans Singh , Kuldeep Kulkarni , Pavan Turaga

To accelerate MRI, the field of compressed sensing is traditionally concerned with optimizing the image quality after a partial undersampling of the measurable $\textit{k}$-space. In our work, we propose to change the focus from the quality…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Artem Razumov , Oleg Y. Rogov , Dmitry V. Dylov

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement…

Machine Learning · Computer Science 2026-02-03 Minjae Kwon , Tyler Ingebrand , Ufuk Topcu , Lu Feng