English
Related papers

Related papers: Mini-batch Submodular Maximization

200 papers

In this paper we study the extraction of representative elements in the data stream model in the form of submodular maximization. Different from the previous work on streaming submodular maximization, we are interested only in the recent…

Data Structures and Algorithms · Computer Science 2016-11-02 Jiecao Chen , Huy L. Nguyen , Qin Zhang

In this paper, we introduce a novel technique for constrained submodular maximization, inspired by barrier functions in continuous optimization. This connection not only improves the running time for constrained submodular maximization but…

Machine Learning · Computer Science 2020-02-11 Ashwinkumar Badanidiyuru , Amin Karbasi , Ehsan Kazemi , Jan Vondrak

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

Most semi-supervised learning methods over-sample labeled data when constructing training mini-batches. This paper studies whether this common practice improves learning and how. We compare it to an alternative setting where each mini-batch…

Machine Learning · Computer Science 2022-04-11 Miquel Martí i Rabadán , Sebastian Bujwid , Alessandro Pieropan , Hossein Azizpour , Atsuto Maki

Soft extrapolation refers to the problem of recovering a function from its samples, multiplied by a fast-decaying window and perturbed by an additive noise, over an interval which is potentially larger than the essential support of the…

Numerical Analysis · Mathematics 2018-12-26 Dmitry Batenkov , Laurent Demanet , Hrushikesh N. Mhaskar

Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in a first of its kind…

Machine Learning · Statistics 2025-04-03 Yaniv Plan , Matthew S. Scott , Xia Sheng , Ozgur Yilmaz

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle

In this paper, we consider an unconstrained stochastic optimization problem where the objective function exhibits high-order smoothness. Specifically, we propose a new stochastic first-order method (SFOM) with multi-extrapolated momentum,…

Optimization and Control · Mathematics 2025-04-09 Chuan He

For the problem of maximizing a monotone, submodular function with respect to a cardinality constraint $k$ on a ground set of size $n$, we provide an algorithm that achieves the state-of-the-art in both its empirical performance and its…

Data Structures and Algorithms · Computer Science 2024-08-20 Yixin Chen , Tonmoy Dey , Alan Kuhnle

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2020-12-01 Navid Rezazadeh , Solmaz S. Kia

We consider fast algorithms for monotone submodular maximization subject to a matroid constraint. We assume that the matroid is given as input in an explicit form, and the goal is to obtain the best possible running times for important…

Data Structures and Algorithms · Computer Science 2018-11-20 Alina Ene , Huy L. Nguyen

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

We study the online submodular maximization problem with free disposal under a matroid constraint. Elements from some ground set arrive one by one in rounds, and the algorithm maintains a feasible set that is independent in the underlying…

Discrete Mathematics · Computer Science 2016-10-26 T-H. Hubert Chan , Zhiyi Huang , Shaofeng H. -C. Jiang , Ning Kang , Zhihao Gavin Tang

A key tool to carry out inference on the unknown copula when modeling a continuous multivariate distribution is a nonparametric estimator known as the empirical copula. One popular way of approximating its sampling distribution consists of…

Statistics Theory · Mathematics 2023-02-01 Ivan Kojadinovic , Kristina Stemikovskaya

The facility location problem is widely used for summarizing large datasets and has additional applications in sensor placement, image retrieval, and clustering. One difficulty of this problem is that submodular optimization algorithms…

Machine Learning · Statistics 2017-03-09 Erik M. Lindgren , Shanshan Wu , Alexandros G. Dimakis

We study the problem of finding a maximum matching in a graph given by an input stream listing its edges in some arbitrary order, where the quantity to be maximized is given by a monotone submodular function on subsets of edges. This…

Data Structures and Algorithms · Computer Science 2013-11-19 Amit Chakrabarti , Sagar Kale

In this manuscript, we consider a finite nonparametric mixture model with non-independent marginal density functions. Dependence between the marginal densities is modeled using a copula device. Until recently, no deterministic algorithms…

Methodology · Statistics 2025-05-23 Michael Levine

A cut sparsifier is a reweighted subgraph that maintains the weights of the cuts of the original graph up to a multiplicative factor of $(1\pm\epsilon)$. This paper considers computing cut sparsifiers of weighted graphs of size $O(n\log…

Data Structures and Algorithms · Computer Science 2022-04-29 Sebastian Forster , Tijn de Vos

Subsampling is a widely used and effective approach for addressing the computational challenges posed by massive datasets. Substantial progress has been made in developing non-uniform, probability-based subsampling schemes that prioritize…

Methodology · Statistics 2026-05-07 Dingyi Wang , Haiying Wang , Qingpei Hu

Graph sampling theory extends the traditional sampling theory to graphs with topological structures. As a key part of the graph sampling theory, subset selection chooses nodes on graphs as samples to reconstruct the original signal. Due to…

Information Theory · Computer Science 2022-01-03 Zhengpin Li , Zheng Wei , Jian Wang , Yun Lin , Byonghyo Shim