English
Related papers

Related papers: Coresets for Regressions with Panel Data

200 papers

We give relative error coresets for training linear classifiers with a broad class of loss functions, including the logistic loss and hinge loss. Our construction achieves $(1\pm \epsilon)$ relative error with $\tilde O(d \cdot…

Machine Learning · Computer Science 2021-06-21 Tung Mai , Anup B. Rao , Cameron Musco

New procedures for detecting a change in the cross-sectional mean of panel data are proposed. The procedures rely on estimating nuisance parameters using certain cross-sectional means across panels using a weighted least squares regression.…

Methodology · Statistics 2026-05-07 Charl Pretorius , Heinrich Roodt

We address a core problem in causal inference: estimating heterogeneous treatment effects using panel data with general treatment patterns. Many existing methods either do not utilize the potential underlying structure in panel data or have…

Machine Learning · Statistics 2024-06-11 Retsef Levi , Elisabeth Paulson , Georgia Perakis , Emily Zhang

Extreme value applications commonly employ regression techniques to capture cross-sectional heterogeneity or time-variation in the data. Estimation of the parameters of an extreme value regression model is notoriously challenging due to the…

Methodology · Statistics 2022-05-12 Debbie J. Dupuis , Sebastian Engelke , Luca Trapin

We present algorithms that create coresets in an online setting for clustering problems according to a wide subset of Bregman divergences. Notably, our coresets have a small additive error, similar in magnitude to the lightweight coresets…

Data Structures and Algorithms · Computer Science 2020-12-14 Rachit Chhaya , Jayesh Choudhari , Anirban Dasgupta , Supratim Shit

This paper proposes a correlated random coefficient linear panel data model, where regressors can be correlated with time-varying and individual-specific random coefficients through both a fixed effect and a time-varying random shock. I…

Econometrics · Economics 2026-02-24 Ming Li

We present an efficient coreset construction algorithm for large-scale Support Vector Machine (SVM) training in Big Data and streaming applications. A coreset is a small, representative subset of the original data points such that a models…

Machine Learning · Computer Science 2020-02-18 Murad Tukan , Cenk Baykal , Dan Feldman , Daniela Rus

A graph neural network transforms features in each vertex's neighborhood into a vector representation of the vertex. Afterward, each vertex's representation is used independently for predicting its label. This standard pipeline implicitly…

Machine Learning · Computer Science 2020-06-18 Junteng Jia , Austin R. Benson

The goal of coreset selection in supervised learning is to produce a weighted subset of data, so that training only on the subset achieves similar performance as training on the entire dataset. Existing methods achieved promising results in…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Renjie Pi , Weizhong Zhang , Yong Lin , Tong Zhang

This paper concerns the estimation of linear panel data models with endogenous regressors and a latent group structure in the coefficients. We consider instrumental variables estimation of the group-specific coefficient vector. We show that…

Econometrics · Economics 2024-05-15 Junho Choi , Ryo Okui

Coresets are small data summaries that are sufficient for model training. They can be maintained online, enabling efficient handling of large data streams under resource constraints. However, existing constructions are limited to simple…

Machine Learning · Computer Science 2020-10-23 Zalán Borsos , Mojmír Mutný , Andreas Krause

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

Machine Learning · Computer Science 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

In optimization or machine learning problems we are given a set of items, usually points in some metric space, and the goal is to minimize or maximize an objective function over some space of candidate solutions. For example, in clustering…

Machine Learning · Computer Science 2020-11-19 Dan Feldman

Heterogeneity is a hallmark of complex diseases. Regression-based heterogeneity analysis, which is directly concerned with outcome-feature relationships, has led to a deeper understanding of disease biology. Such an analysis identifies the…

Methodology · Statistics 2022-11-29 Ziye Luo , Xinyue Yao , Yifan Sun , Xinyan Fan

Distributed machine learning systems have been receiving increasing attentions for their efficiency to process large scale data. Many distributed frameworks have been proposed for different machine learning tasks. In this paper, we study…

Machine Learning · Computer Science 2020-07-01 Hongwei Sun , Qiang Wu

Subsampling algorithms are a natural approach to reduce data size before fitting models on massive datasets. In recent years, several works have proposed methods for subsampling rows from a data matrix while maintaining relevant information…

Machine Learning · Computer Science 2023-01-18 Fred Lu , Edward Raff , James Holt

The size of large, geo-located datasets has reached scales where visualization of all data points is inefficient. Random sampling is a method to reduce the size of a dataset, yet it can introduce unwanted errors. We describe a method for…

Human-Computer Interaction · Computer Science 2017-09-14 Yan Zheng , Yi Ou , Alexander Lex , Jeff M. Phillips

Deep Learning models have transformed various domains, including the healthcare sector, particularly biomedical image classification by learning intricate features and enabling accurate diagnostics pertaining to complex diseases. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Imran Ashraf , Mukhtar Ullah , Muhammad Faisal Nadeem , Muhammad Nouman Noor

A $k$-decision tree $t$ (or $k$-tree) is a recursive partition of a matrix (2D-signal) into $k\geq 1$ block matrices (axis-parallel rectangles, leaves) where each rectangle is assigned a real label. Its regression or classification loss to…

Machine Learning · Computer Science 2021-10-08 Ibrahim Jubran , Ernesto Evgeniy Sanches Shayda , Ilan Newman , Dan Feldman

Subset selection in multiple linear regression aims to choose a subset of candidate explanatory variables that tradeoff fitting error (explanatory power) and model complexity (number of variables selected). We build mathematical programming…

Machine Learning · Statistics 2020-09-04 Young Woong Park , Diego Klabjan