English
Related papers

Related papers: Data subsampling for Poisson regression with pth-r…

200 papers

The coresets approach, also called subsampling or subset selection, aims to select a subsample as a surrogate for the observed sample and has found extensive applications in large-scale data analysis. Existing coresets methods construct the…

Computation · Statistics 2024-09-17 Mengyu Li , Jun Yu , Tao Li , Cheng Meng

A coreset of a dataset with $n$ examples and $d$ features is a weighted subset of examples that is sufficient for solving downstream data analytic tasks. Nearly optimal constructions of coresets for least squares and $\ell_p$ linear…

Data Structures and Algorithms · Computer Science 2024-06-05 David P. Woodruff , Taisuke Yasuda

We consider the non-parametric Poisson regression problem where the integer valued response $Y$ is the realization of a Poisson random variable with parameter $\lambda(X)$. The aim is to estimate the functional parameter $\lambda$ from…

Statistics Theory · Mathematics 2018-05-14 Martin Kroll

Multivariate count data are commonly encountered through high-throughput sequencing technologies in bioinformatics, text mining, or in sports analytics. Although the Poisson distribution seems a natural fit to these count data, its…

Computation · Statistics 2020-04-16 Sanjeena Subedi , Ryan Browne

Subsampling algorithms are a natural approach to reduce data size before fitting models on massive datasets. In recent years, several works have proposed methods for subsampling rows from a data matrix while maintaining relevant information…

Machine Learning · Computer Science 2023-01-18 Fred Lu , Edward Raff , James Holt

PAC-learning usually aims to compute a small subset ($\varepsilon$-sample/net) from $n$ items, that provably approximates a given loss function for every query (model, classifier, hypothesis) from a given set of queries, up to an additive…

Machine Learning · Computer Science 2020-06-11 Alaa Maalouf , Ibrahim Jubran , Murad Tukan , Dan Feldman

We propose a pivotal method for estimating high-dimensional sparse linear regression models, where the overall number of regressors $p$ is large, possibly much larger than $n$, but only $s$ regressors are significant. The method is a…

Methodology · Statistics 2015-03-17 Alexandre Belloni , Victor Chernozhukov , Lie Wang

We extend the theory of low-rank matrix recovery and completion to the case when Poisson observations for a linear combination or a subset of the entries of a matrix are available, which arises in various applications with count data. We…

Machine Learning · Computer Science 2016-04-20 Yang Cao , Yao Xie

Extraordinary amounts of data are being produced in many branches of science. Proven statistical methods are no longer applicable with extraordinary large data sets due to computational limitations. A critical step in big data analysis is…

Methodology · Statistics 2019-06-27 HaiYing Wang , Min Yang , John Stufken

An $\varepsilon$-coreset for Least-Mean-Squares (LMS) of a matrix $A\in{\mathbb{R}}^{n\times d}$ is a small weighted subset of its rows that approximates the sum of squared distances from its rows to every affine $k$-dimensional subspace of…

Machine Learning · Computer Science 2019-07-03 Alaa Maalouf , Adiel Statman , Dan Feldman

Coresets are one of the central methods to facilitate the analysis of large data sets. We continue a recent line of research applying the theory of coresets to logistic regression. First, we show a negative result, namely, that no strongly…

Data Structures and Algorithms · Computer Science 2021-03-09 Alexander Munteanu , Chris Schwiegelshohn , Christian Sohler , David P. Woodruff

Previous work showed empirically that large neural networks can be significantly reduced in size while preserving their accuracy. Model compression became a central research topic, as it is crucial for deployment of neural networks on…

Machine Learning · Computer Science 2020-01-06 Ben Mussay , Margarita Osadchy , Vladimir Braverman , Samson Zhou , Dan Feldman

Data on count processes arise in a variety of applications, including longitudinal, spatial and imaging studies measuring count responses. The literature on statistical models for dependent count data is dominated by models built from…

Methodology · Statistics 2013-10-08 Antonio Canale , David B. Dunson

The seminal work of Cohen and Peng introduced Lewis weight sampling to the theoretical computer science community, yielding fast row sampling algorithms for approximating $d$-dimensional subspaces of $\ell_p$ up to $(1+\epsilon)$ error.…

Data Structures and Algorithms · Computer Science 2022-12-20 David P. Woodruff , Taisuke Yasuda

Define the scaled empirical point process on an independent and identically distributed sequence $\{Y_i: i\le n\}$ as the random point measure with masses at $a_n^{-1} Y_i$. For suitable $a_n$ we obtain the weak limit of these point…

Probability · Mathematics 2016-08-16 André Dabrowski , Gail Ivanoof , Rafal Kulik

This paper introduces the problem of coresets for regression problems to panel data settings. We first define coresets for several variants of regression problems with panel data and then present efficient algorithms to construct coresets…

Machine Learning · Computer Science 2020-11-04 Lingxiao Huang , K. Sudhir , Nisheeth K. Vishnoi

Multivariate count models are often justified by their ability to capture latent dependence, but researchers receive little guidance on when this added structure improves on simpler penalized marginal Poisson regression. We study this…

Machine Learning · Computer Science 2026-04-07 Daniel Agyapong , Julien Chiquet , Jane Marks , Toby Dylan Hocking

As a powerful tool for longitudinal data analysis, the generalized estimating equations have been widely studied in the academic community. However, in large-scale settings, this approach faces pronounced computational and storage…

Computation · Statistics 2025-08-29 Chunjing Li , Jiahui Zhang , Xiaohui Yuan

In this paper we prove discrete to continuum convergence rates for Poisson Learning, a graph-based semi-supervised learning algorithm that is based on solving the graph Poisson equation with a source term consisting of a linear combination…

Analysis of PDEs · Mathematics 2024-07-10 Leon Bungert , Jeff Calder , Max Mihailescu , Kodjo Houssou , Amber Yuan

An $\varepsilon$-coreset for a given set $D$ of $n$ points, is usually a small weighted set, such that querying the coreset \emph{provably} yields a $(1+\varepsilon)$-factor approximation to the original (full) dataset, for a given family…

Machine Learning · Computer Science 2019-06-13 Dan Feldman , Zahi Kfir , Xuan Wu