English
Related papers

Related papers: Pursuing the limit of chirp parameter identifiabil…

200 papers

We give an algorithm for source identification of a mixture of $k$ product distributions on $n$ bits. This is a fundamental problem in machine learning with many applications. Our algorithm identifies the source parameters of an…

Machine Learning · Computer Science 2021-01-01 Spencer L. Gordon , Bijan Mazaheri , Yuval Rabani , Leonard J. Schulman

The Restricted Isometry Property (RIP) is a fundamental property of a matrix which enables sparse recovery. Informally, an $m \times n$ matrix satisfies RIP of order $k$ for the $\ell_p$ norm, if $\|Ax\|_p \approx \|x\|_p$ for every vector…

Data Structures and Algorithms · Computer Science 2015-02-24 Zeyuan Allen-Zhu , Rati Gelashvili , Ilya Razenshteyn

Evolutionary algorithms have been applied to a wide range of stochastic problems. Motivated by real-world problems where constraint violations have disruptive effects, this paper considers the chance-constrained knapsack problem (CCKP)…

Neural and Evolutionary Computing · Computer Science 2021-08-02 Yue Xie , Oscar Harper , Hirad Assimi , Aneta Neumann , Frank Neumann

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

We consider the problem of designing optimal $M \times N$ ($M \leq N$) sensing matrices which minimize the maximum condition number of all the submatrices of $K$ columns. Such matrices minimize the worst-case estimation errors when only $K$…

Information Theory · Computer Science 2012-06-04 Hema Kumari Achanta , Soura Dasgupta , Weiyu Xu

Despite a surge of interest in submodular maximization in the data stream model, there remain significant gaps in our knowledge about what can be achieved in this setting, especially when dealing with multiple constraints. In this work, we…

Data Structures and Algorithms · Computer Science 2022-04-12 Moran Feldman , Ashkan Norouzi-Fard , Ola Svensson , Rico Zenklusen

In this work, we study the classic submodular maximization problem under knapsack constraints and beyond. We first present an $(7/16-\varepsilon)$-approximate algorithm for single knapsack constraint, which requires…

Data Structures and Algorithms · Computer Science 2020-12-22 Wenxin Li

The accuracy and complexity of machine learning algorithms based on kernel optimization are limited by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Computer Science 2020-06-16 Brendon K. Colbert , Matthew M. Peet

We study the standard-form ILP problem $\max\{ c^\top x \colon A x = b,\; x \in Z_{\geq 0}^n \}$, where $A\in Z^{k\times n}$ has full row rank. We obtain refined FPT algorithms parameterized by $k$ and $\Delta$, the maximum absolute value…

Data Structures and Algorithms · Computer Science 2026-04-16 Dmitry Gribanov , Tagir Khayaleyev , Mikhail Cherniavskii , Maxim Klimenko , Dmitry Malyshev , Stanislav Moiseev

In this paper, we introduce the Maximum Matrix Contraction problem, where we aim to contract as much as possible a binary matrix in order to maximize its density. We study the complexity and the polynomial approximability of the problem.…

Computational Complexity · Computer Science 2023-06-05 Dimitri Watel , Pierre-Louis Poirion

For constrained, not necessarily monotone submodular maximization, all known approximation algorithms with ratio greater than $1/e$ require continuous ideas, such as queries to the multilinear extension of a submodular function and its…

Data Structures and Algorithms · Computer Science 2025-02-06 Yixin Chen , Ankur Nath , Chunli Peng , Alan Kuhnle

In this paper, we propose a robust optimization-based heuristic algorithm for the chance-constrained binary knapsack problem (CKP). We assume that the weights of items are independent normally distributed. By utilizing the properties of the…

Optimization and Control · Mathematics 2018-11-06 Seulgi Joung , Kyungsik Lee

This paper addresses the challenge of determining optimal cut-offs for a set of n items with m scores to maximize distinguishability. The term distinguishability is defined as the fraction of item pairs assigned to different buckets, where…

Optimization and Control · Mathematics 2025-09-16 Shravan Mohan

This paper investigates two issues on identification of switched linear systems: persistence of excitation and numerical algorithms. The main contribution is a much weaker condition on the regressor to be persistently exciting that…

Systems and Control · Electrical Eng. & Systems 2021-12-07 Biqiang Mu , Tianshi Chen , Changming Cheng , Er-Wei Bai

Biclustering techniques have been widely used to identify homogeneous subgroups within large data matrices, such as subsets of genes similarly expressed across subsets of patients. Mining a max-sum sub-matrix is a related but distinct…

Machine Learning · Statistics 2017-09-26 Vincent Branders , Pierre Schaus , Pierre Dupont

The problem of computing an exact experimental design that is optimal for the least-squares estimation of the parameters of a regression model is considered. We show that this problem can be solved via mixed-integer linear programming…

Computation · Statistics 2024-06-18 Radoslav Harman , Samuel Rosa

We study $k$-clustering problems with lower bounds, including $k$-median and $k$-means clustering with lower bounds. In addition to the point set $P$ and the number of centers $k$, a $k$-clustering problem with (uniform) lower bounds gets a…

Data Structures and Algorithms · Computer Science 2021-08-18 Anna Arutyunova , Melanie Schmidt

We propose a method for finding approximate solutions to multiple-choice knapsack problems. To this aim we transform the multiple-choice knapsack problem into a bi-objective optimization problem whose solution set contains solutions of the…

Optimization and Control · Mathematics 2017-12-20 Ewa M. Bednarczuk , Janusz Miroforidis , Przemysław Pyzel

We consider the class of packing integer programs (PIPs) that are column sparse, i.e. there is a specified upper bound k on the number of constraints that each variable appears in. We give an (ek+o(k))-approximation algorithm for k-column…

Data Structures and Algorithms · Computer Science 2015-05-13 Nikhil Bansal , Nitish Korula , Viswanath Nagarajan , Aravind Srinivasan

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang