English
Related papers

Related papers: Predictive Coresets

200 papers

We develop a rigorous framework for deterministic coreset construction in empirical risk minimization (ERM). Our central contribution is the Adaptive Deterministic Uniform-Weight Trimming (ADUWT) algorithm, which constructs a coreset by…

Machine Learning · Statistics 2025-08-27 Faruk Alpay , Taylan Alpay

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

In Simulation-based Inference, the goal is to solve the inverse problem when the likelihood is only known implicitly. Neural Posterior Estimation commonly fits a normalized density estimator as a surrogate model for the posterior. This…

Machine Learning · Statistics 2023-10-04 Benjamin Kurt Miller , Marco Federici , Christoph Weniger , Patrick Forré

A coreset is a small set that can approximately preserve the structure of the original input data set. Therefore we can run our algorithm on a coreset so as to reduce the total computational complexity. Conventional coreset techniques…

Machine Learning · Computer Science 2022-10-11 Jiaxiang Chen , Qingyuan Yang , Ruomin Huang , Hu Ding

We develop and analyze a method to reduce the size of a very large set of data points in a high dimensional Euclidean space R d to a small set of weighted points such that the result of a predetermined data analysis task on the reduced set…

Data Structures and Algorithms · Computer Science 2018-07-13 Dan Feldman , Melanie Schmidt , Christian Sohler

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

This paper addresses the task of set prediction using deep feed-forward neural networks. A set is a collection of elements which is invariant under permutation and the size of a set is not fixed in advance. Many real-world problems, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hamid Rezatofighi , Tianyu Zhu , Roman Kaskman , Farbod T. Motlagh , Qinfeng Shi , Anton Milan , Daniel Cremers , Laura Leal-Taixé , Ian Reid

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

Composite likelihood estimation has an important role in the analysis of multivariate data for which the full likelihood function is intractable. An important issue in composite likelihood inference is the choice of the weights associated…

Methodology · Statistics 2015-12-15 Davide Ferrari , Chao Zheng

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

Machine Learning · Computer Science 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted…

Machine Learning · Computer Science 2022-10-31 Brian Lucena

In the era of data-centric AI, the ability to curate high-quality training data is as crucial as model design. Coresets offer a principled approach to data reduction, enabling efficient learning on large datasets through importance…

Machine Learning · Computer Science 2025-07-23 Morad Tukan , Loay Mualem , Eitan Netzer , Liran Sigalat

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

Unbiased assessment of the predictivity of models learnt by supervised machine-learning methods requires knowledge of the learned function over a reserved test set (not used by the learning algorithm). The quality of the assessment depends,…

Statistics Theory · Mathematics 2022-07-11 Elias Fekhari , Bertrand Iooss , Joseph Muré , Luc Pronzato , Maria-João Rendas

Prediction sets provide a theoretically grounded framework for quantifying uncertainty in machine learning models. Adapting them to structured generation tasks, in particular, large language model (LLM) based code generation, remains a…

Software Engineering · Computer Science 2026-05-13 Senrong Xu , Yuhao Tan , Yanke Zhou , Guangyuan Wu , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

Signal processing tasks as fundamental as sampling, reconstruction, minimum mean-square error interpolation and prediction can be viewed under the prism of reproducing kernel Hilbert spaces. Endowing this vantage point with contemporary…

Machine Learning · Computer Science 2013-02-25 Juan Andres Bazerque , Georgios B. Giannakis

Coresets are small, weighted summaries of larger datasets, aiming at providing provable error bounds for machine learning (ML) tasks while significantly reducing the communication and computation costs. To achieve a better trade-off between…

Machine Learning · Computer Science 2022-04-15 Hanlin Lu , Changchang Liu , Shiqiang Wang , Ting He , Vijay Narayanan , Kevin S. Chan , Stephen Pasteris

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…