English
Related papers

Related papers: Faster Maximum Feasible Subsystem Solutions for De…

200 papers

Embedded Feature Selection (FS) is a classical approach for interpretable machine learning, aiming to identify the most relevant features of a dataset while simultaneously training the model. We consider an approach based on a hard…

Optimization and Control · Mathematics 2025-08-01 Federico D'Onofrio , Yuri Faenza , Laura Palagi

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

The control and sensing of large-scale systems results in combinatorial problems not only for sensor and actuator placement but also for scheduling or observability/controllability. Such combinatorial constraints in system design and…

Optimization and Control · Mathematics 2018-12-07 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

The weighted Maximum Satisfiability problem (weighted MAX-SAT) is a NP-hard problem with numerous applications arising in artificial intelligence. As an efficient tool for heuristic design, the backbone has been applied to heuristics design…

Artificial Intelligence · Computer Science 2017-04-18 He Jiang , Jifeng Xuan , Yan Hu

In this work, we consider the Submodular Maximization under Knapsack (SMK) constraint problem over the ground set of size $n$. The problem recently attracted a lot of attention due to its applications in various domains of combination…

Data Structures and Algorithms · Computer Science 2024-05-22 Canh V. Pham

We consider the compressive sensing of a sparse or compressible signal ${\bf x} \in {\mathbb R}^M$. We explicitly construct a class of measurement matrices, referred to as the low density frames, and develop decoding algorithms that produce…

Information Theory · Computer Science 2009-03-05 Mehmet Akçakaya , Jinsoo Park , Vahid Tarokh

Deciding feasibility of large systems of linear equations and inequalities is one of the most fundamental algorithmic tasks. However, due to data inaccuracies or modeling errors, in practical applications one often faces linear systems that…

Data Structures and Algorithms · Computer Science 2022-09-07 Kristóf Bérczi , Alexander Göke , Lydia Mirabel Mendoza-Cadena , Matthias Mnich

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

This work presents a fast and non-convex algorithm for robust subspace recovery. The data sets considered include inliers drawn around a low-dimensional subspace of a higher dimensional ambient space, and a possibly large portion of…

Machine Learning · Computer Science 2018-11-07 Gilad Lerman , Tyler Maunu

To tackle the exponentiality associated with NP-hard problems, two paradigms have been proposed. First, Branch & Bound, like Dynamic Programming, achieve efficient exact inference but requires extensive information and analysis about the…

Data Structures and Algorithms · Computer Science 2016-09-13 Julien Weissenberg , Hayko Riemenschneider , Ralf Dragon , Luc Van Gool

Matrix factorization (MF) is a widely used collaborative filtering (CF) algorithm for recommendation systems (RSs), due to its high prediction accuracy, great flexibility and high efficiency in big data processing. However, with the…

Information Retrieval · Computer Science 2026-03-26 Yining Wu , Shengyu Duan , Gaole Sai , Chenhong Cao , Guobing Zou

Frequent Subgraph Mining (FSM) is the process of identifying common subgraph patterns that surpass a predefined frequency threshold. While FSM is widely applicable in fields like bioinformatics, chemical analysis, and social network anomaly…

Databases · Computer Science 2024-04-03 Akshit Sharma , Sam Reinher , Dinesh Mehta , Bo Wu

The maximum clique problem is a well known NP-Hard problem with applications in data mining, network analysis, informatics, and many other areas. Although there exist several algorithms with acceptable runtimes for certain classes of…

Data Structures and Algorithms · Computer Science 2012-11-15 Bharath Pattabiraman , Md. Mostofa Ali Patwary , Assefaw H. Gebremedhin , Wei-keng Liao , Alok Choudhary

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

Control synthesis under constraints is at the forefront of research on autonomous systems, in part due to its broad application from low-level control to high-level planning, where computing control inputs is typically cast as a constrained…

Optimization and Control · Mathematics 2026-03-23 Panagiotis Rousseas , Haejoon Lee , Dimos V. Dimarogonas , Dimitra Panagou

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Compressive sensing is a powerful technique for recovering sparse solutions of underdetermined linear systems, which is often encountered in uncertainty quantification analysis of expensive and high-dimensional physical models. We perform…

We present a general class of compressed sensing matrices which are then demonstrated to have associated sublinear-time sparse approximation algorithms. We then develop methods for constructing specialized matrices from this class which are…

Numerical Analysis · Mathematics 2011-06-01 J. Bailey , M. A. Iwen , C. V. Spencer

We study the problem of maximizing a function that is approximately submodular under a cardinality constraint. Approximate submodularity implicitly appears in a wide range of applications as in many cases errors in evaluation of a…

Data Structures and Algorithms · Computer Science 2024-11-19 Thibaut Horel , Yaron Singer