English
Related papers

Related papers: Coresets for Dependency Networks

200 papers

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Coreset selection is among the most effective ways to reduce the training time of CNNs, however, only limited is known on how the resultant models will behave under variations of the coreset size, and choice of datasets and models.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Animesh Gupta , Irtiza Hasan , Dilip K. Prasad , Deepak K. Gupta

We investigate coresets - succinct, small summaries of large data sets - so that solutions found on the summary are provably competitive with solution found on the full data set. We provide an overview over the state-of-the-art in coreset…

Machine Learning · Statistics 2017-06-06 Olivier Bachem , Mario Lucic , Andreas Krause

When faced with a data set too large to be processed all at once, an obvious solution is to retain only part of it. In practice this takes a wide variety of different forms, and among them "coresets" are especially appealing. A coreset is a…

Machine Learning · Statistics 2020-01-07 Nicolas Tremblay , Simon Barthelmé , Pierre-Olivier Amblard

Coreset (or core-set) is a small weighted \emph{subset} $Q$ of an input set $P$ with respect to a given \emph{monotonic} function $f:\mathbb{R}\to\mathbb{R}$ that \emph{provably} approximates its fitting loss $\sum_{p\in P}f(p\cdot x)$ to…

Machine Learning · Computer Science 2021-12-24 Elad Tolochinsky , Ibrahim Jubran , Dan Feldman

This paper introduces the problem of coresets for regression problems to panel data settings. We first define coresets for several variants of regression problems with panel data and then present efficient algorithms to construct coresets…

Machine Learning · Computer Science 2020-11-04 Lingxiao Huang , K. Sudhir , Nisheeth K. Vishnoi

We present an efficient coreset construction algorithm for large-scale Support Vector Machine (SVM) training in Big Data and streaming applications. A coreset is a small, representative subset of the original data points such that a models…

Machine Learning · Computer Science 2020-02-18 Murad Tukan , Cenk Baykal , Dan Feldman , Daniela Rus

Motivation: Networks underlie the generation and interpretation of many biological datasets: gene networks shed light on the regulatory structure of the genome, and cell networks can capture structure of the tumor micro-environment.…

Machine Learning · Statistics 2026-03-18 Bailey Andrew , Erica L. Harris , James A. Poulter , David R. Westhead , Luisa Cutillo

We introduce a principled approach for unsupervised structure learning of deep neural networks. We propose a new interpretation for depth and inter-layer connectivity where conditional independencies in the input distribution are encoded…

Machine Learning · Statistics 2018-10-18 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Guy Koren , Gal Novik

Coresets are small data summaries that are sufficient for model training. They can be maintained online, enabling efficient handling of large data streams under resource constraints. However, existing constructions are limited to simple…

Machine Learning · Computer Science 2020-10-23 Zalán Borsos , Mojmír Mutný , Andreas Krause

Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular…

Machine Learning · Computer Science 2026-05-22 Mridul Gupta , Samyak Jain , Vansh Ramani , Hariprasad Kodamana , Sayan Ranu

A coreset (or core-set) of a dataset is its semantic compression with respect to a set of queries, such that querying the (small) coreset provably yields an approximate answer to querying the original (full) dataset. In the last decade,…

Robotics · Computer Science 2017-12-19 Soliman Nasser , Ibrahim Jubran , Dan Feldman

The analogy between Gaussian processes (GPs) and deep artificial neural networks (ANNs) has received a lot of interest, and has shown promise to unbox the blackbox of deep ANNs. Existing theoretical works put strict assumptions on the ANN…

Machine Learning · Computer Science 2024-01-12 Amir Akbarnejad , Gilbert Bigras , Nilanjan Ray

Bayesian networks are basic graphical models, used widely both in statistics and artificial intelligence. These statistical models of conditional independence structure are described by acyclic directed graphs whose nodes correspond to…

Optimization and Control · Mathematics 2010-12-01 Raymond Hemmecke , Silvia Lindner , Milan Studený

Determinantal point processes (DPPs) are random configurations of points with tunable negative dependence. Because sampling is tractable, DPPs are natural candidates for subsampling tasks, such as minibatch selection or coreset…

Machine Learning · Statistics 2024-11-04 Rémi Bardenet , Subhroshekhar Ghosh , Hugo Simon-Onfroy , Hoang-Son Tran

Gaussian processes (GPs) are an attractive class of machine learning models because of their simplicity and flexibility as building blocks of more complex Bayesian models. Meanwhile, graph neural networks (GNNs) emerged recently as a…

Machine Learning · Computer Science 2023-02-14 Zehao Niu , Mihai Anitescu , Jie Chen

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

Statistics Theory · Mathematics 2016-09-30 Emilie Devijver , Mélina Gallopin

We develop and analyze data subsampling techniques for Poisson regression, the standard model for count data $y\in\mathbb{N}$. In particular, we consider the Poisson generalized linear model with ID- and square root-link functions. We…

Machine Learning · Computer Science 2025-03-20 Han Cheng Lie , Alexander Munteanu

High-dimensional data analysis typically focuses on low-dimensional structure, often to aid interpretation and computational efficiency. Graphical models provide a powerful methodology for learning the conditional independence structure in…

Methodology · Statistics 2024-09-13 Maria De Iorio , Willem van den Boom , Alexandros Beskos , Ajay Jasra , Andrea Cremaschi

Coresets are modern data-reduction tools that are widely used in data analysis to improve efficiency in terms of running time, space and communication complexity. Our main result is a fast algorithm to construct a small coreset for k-Median…

Data Structures and Algorithms · Computer Science 2020-07-16 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu