English
Related papers

Related papers: Subset Selection for Matrices with Fixed Blocks

200 papers

In this paper, we present a new image segmentation method based on the concept of sparse subset selection. Starting with an over-segmentation, we adopt local spectral histogram features to encode the visual information of the small segments…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Fariba Zohrizadeh , Mohsen Kheirandishfard , Farhad Kamangar

We call a matrix completely mixable if the entries in its columns can be permuted so that all row sums are equal. If it is not completely mixable, we want to determine the smallest maximal and largest minimal row sum attainable. These…

Optimization and Control · Mathematics 2015-01-06 Utz-Uwe Haus

The goal of coreset selection in supervised learning is to produce a weighted subset of data, so that training only on the subset achieves similar performance as training on the entire dataset. Existing methods achieved promising results in…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Renjie Pi , Weizhong Zhang , Yong Lin , Tong Zhang

Linear mixed models (LMMs) are instrumental for regression analysis with structured dependence, such as grouped, clustered, or multilevel data. However, selection among the covariates--while accounting for this structured…

Methodology · Statistics 2022-04-20 Daniel R. Kowal

The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear…

Optimization and Control · Mathematics 2009-05-12 Shiqian Ma , Donald Goldfarb , Lifeng Chen

We study the problem of residual error estimation for matrix and vector norms using a linear sketch. Such estimates can be used, for example, to quickly assess how useful a more expensive low-rank approximation computation will be. The…

Data Structures and Algorithms · Computer Science 2024-08-19 Yi Li , Honghao Lin , David P. Woodruff

Automatic prompt optimization reduces manual prompt engineering, but relies on task performance measured on a small, often randomly sampled evaluation subset as its main source of feedback signal. Despite this, how to select that evaluation…

Computation and Language · Computer Science 2026-01-08 Jinming Nian , Zhiyuan Peng , Hongwei Shang , Dae Hoon Park , Yi Fang

We consider optimal sensor placement for a family of linear Bayesian inverse problems characterized by a deterministic hyper-parameter. The hyper-parameter describes distinct configurations in which measurements can be taken of the observed…

Numerical Analysis · Mathematics 2023-01-31 Nicole Aretz , Peng Chen , Denise Degen , Karen Veroy

We primarily study a special a weighted low-rank approximation of matrices and then apply it to solve the background modeling problem. We propose two algorithms for this purpose: one operates in the batch mode on the entire data and the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Aritra Dutta , Xin Li , Peter Richtarik

This paper addresses the problem of finding the closest generalized essential matrix from a given $6\times 6$ matrix, with respect to the Frobenius norm. To the best of our knowledge, this nonlinear constrained optimization problem has not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pedro Miraldo , Joao R. Cardoso

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is…

Machine Learning · Statistics 2013-09-25 T. Tony Cai , Wen-Xin Zhou

Submodular optimization is a fundamental problem with many applications in machine learning, often involving decision-making over datasets with sensitive attributes such as gender or age. In such settings, it is often desirable to produce a…

Machine Learning · Computer Science 2024-07-09 Wenjing Chen , Shuo Xing , Samson Zhou , Victoria G. Crawford

Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time…

Data Structures and Algorithms · Computer Science 2014-08-22 Michael B. Cohen , Yin Tat Lee , Cameron Musco , Christopher Musco , Richard Peng , Aaron Sidford

In the classical selection problem, the input consists of a collection of elements and the goal is to pick a subset of elements from the collection such that some objective function $f$ is maximized. This problem has been studied…

Data Structures and Algorithms · Computer Science 2021-09-06 Sofia Maria Nikolakaki , Alina Ene , Evimaria Terzi

We consider the problem of selecting a small subset of representative variables from a large dataset. In the computer science literature, this dimensionality reduction problem is typically formalized as Column Subset Selection (CSS).…

Methodology · Statistics 2025-05-20 Anav Sood , Trevor Hastie

This paper deals with unsupervised clustering with feature selection. The problem is to estimate both labels and a sparse projection matrix of weights. To address this combinatorial non-convex problem maintaining a strict control on the…

Machine Learning · Computer Science 2019-05-27 Cyprien Gilet , Marie Deprez , Jean-Baptiste Caillau , Michel Barlaud

Choosing a meaningful subset of features from high-dimensional observations in unsupervised settings can greatly enhance the accuracy of downstream analysis, such as clustering or dimensionality reduction, and provide valuable insights into…

Machine Learning · Computer Science 2024-12-23 Daniel Segal , Ofir Lindenbaum , Ariel Jaffe

Covariance selection seeks to estimate a covariance matrix by maximum likelihood while restricting the number of nonzero inverse covariance matrix coefficients. A single penalty parameter usually controls the tradeoff between log likelihood…

Optimization and Control · Mathematics 2010-10-12 Vijay Krishnamurthy , Alexandre d'Aspremont

A crucial task in system identification problems is the selection of the most appropriate model class, and is classically addressed resorting to cross-validation or using asymptotic arguments. As recently suggested in the literature, this…

Numerical Analysis · Mathematics 2015-06-09 Silvia Bonettini , Alessandro Chiuso , Marco Prato