English
Related papers

Related papers: Greedy Column Subset Selection for Large-scale Dat…

200 papers

Often times, in many design problems, there is a need to select a small set of informative or representative elements from a large ground set of entities in an optimal fashion. Submodular optimization that provides for a formal way to solve…

Machine Learning · Computer Science 2018-10-09 Arun V Sathanur

In this paper, we introduce an efficient algorithm for column subset selection that combines the column-pivoted QR factorization with sparse subspace embeddings. The proposed method, SE-QRSC, is particularly effective for wide matrices with…

Numerical Analysis · Mathematics 2025-09-05 Israa Fakih , Laura Grigori

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

We describe a parallel approximation algorithm for maximizing monotone submodular functions subject to hereditary constraints on distributed memory multiprocessors. Our work is motivated by the need to solve submodular optimization problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Shivaram Gopal , S M Ferdous , Hemanta K. Maji , Alex Pothen

We study the problem of selecting most informative subset of a large observation set to enable accurate estimation of unknown parameters. This problem arises in a variety of settings in machine learning and signal processing including…

Signal Processing · Electrical Eng. & Systems 2019-05-27 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

The problem of selecting a small-size representative summary of a large dataset is a cornerstone of machine learning, optimization and data science. Motivated by applications to recommendation systems and other scenarios with query-limited…

Data Structures and Algorithms · Computer Science 2019-10-15 Dmitrii Avdiukhin , Grigory Yaroslavtsev , Samson Zhou

Subset selection in multiple linear regression aims to choose a subset of candidate explanatory variables that tradeoff fitting error (explanatory power) and model complexity (number of variables selected). We build mathematical programming…

Machine Learning · Statistics 2020-09-04 Young Woong Park , Diego Klabjan

This paper addresses the problem of identifying a very small subset of data points that belong to a significantly larger massive dataset (i.e., Big Data). The small number of selected data points must adequately represent and faithfully…

Computer Vision and Pattern Recognition · Computer Science 2015-03-12 Chinh Dang , Hayder Radha

We study the $k$-Submodular Cover ($kSC$) problem, a natural generalization of the classical Submodular Cover problem that arises in artificial intelligence and combinatorial optimization tasks such as influence maximization, resource…

Data Structures and Algorithms · Computer Science 2025-11-04 Hue T. Nguyen , Tan D. Tran , Nguyen Long Giang , Canh V. Pham

Efficient retrieval of information is of key importance when using Big Data systems. In large scale-out data architectures, data are distributed and replicated across several machines. Queries/tasks to such data architectures, are sent to a…

In the classical selection problem, the input consists of a collection of elements and the goal is to pick a subset of elements from the collection such that some objective function $f$ is maximized. This problem has been studied…

Data Structures and Algorithms · Computer Science 2021-09-06 Sofia Maria Nikolakaki , Alina Ene , Evimaria Terzi

To cope with the high level of ambiguity faced in domains such as Computer Vision or Natural Language processing, robust prediction methods often search for a diverse set of high-quality candidate solutions or proposals. In structured…

Machine Learning · Computer Science 2014-11-10 Adarsh Prasad , Stefanie Jegelka , Dhruv Batra

Coreset selection is powerful in reducing computational costs and accelerating data processing for deep learning algorithms. It strives to identify a small subset from large-scale data, so that training only on the subset practically…

Machine Learning · Computer Science 2024-03-01 Xiaobo Xia , Jiale Liu , Shaokun Zhang , Qingyun Wu , Hongxin Wei , Tongliang Liu

Identifying breakpoints in piecewise regression is critical in enhancing the reliability and interpretability of data fitting. In this paper, we propose novel algorithms based on the greedy algorithm to accurately and efficiently identify…

Machine Learning · Statistics 2026-04-14 Taehyeong Kim , Hyungu Lee , Myungjin Kim , Hayoung Choi

Compressed sensing (CS) shows that a signal having a sparse or compressible representation can be recovered from a small set of linear measurements. In classical CS theory, the sampling matrix and representation matrix are assumed to be…

Information Theory · Computer Science 2015-07-03 Yipeng Liu

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao

Subset selection for matrices is the task of extracting a column sub-matrix from a given matrix $B\in\mathbb{R}^{n\times m}$ with $m>n$ such that the pseudoinverse of the sampled matrix has as small Frobenius or spectral norm as possible.…

Data Structures and Algorithms · Computer Science 2020-03-04 Jiaxin Xie , Zhiqiang Xu

Subset selection, which aims to select a subset from a ground set to maximize some objective function, arises in various applications such as influence maximization and sensor placement. In real-world scenarios, however, one often needs to…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Chao Bian , Yawen Zhou , Chao Qian

This paper examines the problem of locating outlier columns in a large, otherwise low-rank, matrix. We propose a simple two-step adaptive sensing and inference approach and establish theoretical guarantees for its performance; our results…

Information Theory · Computer Science 2015-06-22 Xingguo Li , Jarvis Haupt

Compressed sensing (CS) is an innovative technique allowing to represent signals through a small number of their linear projections. In this paper we address the application of CS to the scenario of progressive acquisition of 2D visual…

Information Theory · Computer Science 2014-03-06 Giulio Coluccia , Enrico Magli