English
Related papers

Related papers: Fair Column Subset Selection

200 papers

We study the following problem: Given a variable of interest, we would like to find a best linear predictor for it by choosing a subset of $k$ relevant variables obeying a matroid constraint. This problem is a natural generalization of…

Data Structures and Algorithms · Computer Science 2023-01-19 Theophile Thiery , Justin Ward

We consider the fundamental problem of selecting $k$ out of $n$ random variables in a way that the expected highest or second-highest value is maximized. This question captures several applications where we have uncertainty about the…

Computer Science and Game Theory · Computer Science 2020-12-16 Aranyak Mehta , Uri Nadav , Alexandros Psomas , Aviad Rubinstein

We study the optimal sample complexity of variable selection in linear regression under general design covariance, and show that subset selection is optimal while under standard complexity assumptions, efficient algorithms for this problem…

Statistics Theory · Mathematics 2025-10-07 Ming Gao , Bryon Aragam

The Column Subset Selection Problem (CSSP) and the Nystr\"om method are among the leading tools for constructing small low-rank approximations of large datasets in machine learning and scientific computing. A fundamental question in this…

Machine Learning · Computer Science 2020-12-22 Michał Dereziński , Rajiv Khanna , Michael W. Mahoney

Column generation is an iterative method used to solve a variety of optimization problems. It decomposes the problem into two parts: a master problem, and one or more pricing problems (PP). The total computing time taken by the method is…

Optimization and Control · Mathematics 2022-01-10 Mouad Morabit , Guy Desaulniers , Andrea Lodi

We study the algorithmic complexity of fair division problems with a focus on minimizing the number of queries needed to find an approximate solution with desired accuracy. We show for several classes of fair division problems that under…

Combinatorics · Mathematics 2023-11-16 Alexandr Grebennikov , Xenia Isaeva , Andrei V. Malyutin , Mikhail Mikhailov , Oleg R. Musin

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila

Dense subgraph extraction is a fundamental problem in graph analysis and data mining, aimed at identifying cohesive and densely connected substructures within a given graph. It plays a crucial role in various domains, including social…

Data Structures and Algorithms · Computer Science 2024-03-01 Chia-Yang Hung , Chih-Ya Shen

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical classification,…

Machine Learning · Statistics 2026-04-13 Thomas Mortier , Alireza Javanmardi , Yusuf Sale , Eyke Hüllermeier , Willem Waegeman

We propose two algorithms for interpretation and boosting of tree-based ensemble methods. Both algorithms make use of mathematical programming models that are constructed with a set of rules extracted from an ensemble of decision trees. The…

Machine Learning · Computer Science 2020-09-22 S. Ilker Birbil , Mert Edali , Birol Yuceoglu

We study the canonical fair clustering problem where each cluster is constrained to have close to population-level representation of each group. Despite significant attention, the salient issue of having incomplete knowledge about the group…

Machine Learning · Computer Science 2024-11-21 Sharmila Duppala , Juan Luque , John P. Dickerson , Seyed A. Esmaeili

Items from a database are often ranked based on a combination of multiple criteria. A user may have the flexibility to accept combinations that weigh these criteria differently, within limits. On the other hand, this choice of weights can…

Databases · Computer Science 2023-04-27 Abolfazl Asudeh , H. V. Jagadish , Julia Stoyanovich , Gautam Das

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

We give the first single-pass streaming algorithm for Column Subset Selection with respect to the entrywise $\ell_p$-norm with $1 \leq p < 2$. We study the $\ell_p$ norm loss since it is often considered more robust to noise than the…

Data Structures and Algorithms · Computer Science 2021-07-19 Shuli Jiang , Dongyu Li , Irene Mengze Li , Arvind V. Mahankali , David P. Woodruff

We present a dynamic programming algorithm for selecting a representative subset of size $k$ from a given set with $n$ points such that the Riesz $s$-energy is near minimized. While NP-hard in general dimensions, the one-dimensional case…

Data Structures and Algorithms · Computer Science 2025-02-11 Michael Emmerich

Consensus clustering, a fundamental task in machine learning and data analysis, aims to aggregate multiple input clusterings of a dataset, potentially based on different non-sensitive attributes, into a single clustering that best…

Machine Learning · Computer Science 2025-06-18 Diptarka Chakraborty , Kushagra Chatterjee , Debarati Das , Tien Long Nguyen , Romina Nobahari

We study the problem of selecting a representative committee of $k$ agents from a collection of $n$ agents in a common metric space. This problem is related to choosing $k$ facilities in facility location and $k$-median problems. However,…

Computer Science and Game Theory · Computer Science 2025-10-27 Christopher Jerrett , Elliot Anshelevich

Symmetric positive semidefinite (SPSD) matrix approximation is an important problem with applications in kernel methods. However, existing SPSD matrix approximation methods such as the Nystr\"om method only have weak error bounds. In this…

Machine Learning · Computer Science 2016-05-23 Shusen Wang , Luo Luo , Zhihua Zhang

The rise of algorithmic decision-making has created an explosion of research around the fairness of those algorithms. While there are many compelling notions of individual fairness, beginning with the work of Dwork et al., these notions…

Data Structures and Algorithms · Computer Science 2022-10-07 Konstantina Bairaktari , Huy Le Nguyen , Jonathan Ullman

Modern pattern recognition tasks use complex algorithms that take advantage of large datasets to make more accurate predictions than traditional algorithms such as decision trees or k-nearest-neighbor better suited to describe simple…

Machine Learning · Statistics 2021-10-14 AGaurav Arwade , Sigurdur Olafsson