English
Related papers

Related papers: Discrepancy, Coresets, and Sketches in Machine Lea…

200 papers

Coreset selection, which aims to select a subset of the most informative training samples, is a long-standing learning problem that can benefit many downstream tasks such as data-efficient learning, continual learning, neural architecture…

Machine Learning · Computer Science 2022-06-30 Chengcheng Guo , Bo Zhao , Yanbing Bai

Designing small-sized \emph{coresets}, which approximately preserve the costs of the solutions for large datasets, has been an important research direction for the past decade. We consider coreset construction for a variety of general…

Data Structures and Algorithms · Computer Science 2024-10-11 Lingxiao Huang , Jian Li , Pinyan Lu , Xuan Wu

Kernel regression is an essential and ubiquitous tool for non-parametric data analysis, particularly popular among time series and spatial data. However, the central operation which is performed many times, evaluating a kernel on the data…

Machine Learning · Computer Science 2017-06-01 Yan Zheng , Jeff M. Phillips

High-quality training data is essential for building reliable and efficient machine learning systems. One-shot coreset selection addresses this by pruning the dataset while maintaining or even improving model performance, often relying on…

Machine Learning · Computer Science 2025-08-15 Elisa Tsai , Haizhong Zheng , Atul Prakash

Confusing classes that are ubiquitous in real world often degrade performance for many vision related applications like object detection, classification, and segmentation. The confusion errors are not only caused by similar visual patterns…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qichuan Geng , Xinyu Huang , Zhong Zhou , Ruigang Yang

We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on…

Machine Learning · Statistics 2016-08-19 Anastasia Pentina , Shai Ben-David

Several recent works have shown separation results between deep neural networks, and hypothesis classes with inferior approximation capacity such as shallow networks or kernel classes. On the other hand, the fact that deep networks can…

Machine Learning · Computer Science 2021-07-20 Eran Malach , Gilad Yehudai , Shai Shalev-Shwartz , Ohad Shamir

A dataset is a shred of crucial evidence to describe a task. However, each data point in the dataset does not have the same potential, as some of the data points can be more representative or informative than others. This unequal importance…

Machine Learning · Computer Science 2022-03-21 Jaehong Yoon , Divyam Madaan , Eunho Yang , Sung Ju Hwang

In this paper, we focus on lower bounds and algorithms for some basic geometric problems in the one-pass (insertion only) streaming model. The problems considered are grouped into three categories: (i) Klee's measure (ii) Convex body…

Computational Geometry · Computer Science 2018-03-20 Arijit Bishnu , Arijit Ghosh , Gopinath Mishra , Sandeep Sen

We present a novel coreset construction algorithm for solving classification tasks using Support Vector Machines (SVMs) in a computationally efficient manner. A coreset is a weighted subset of the original data points that provably…

Data Structures and Algorithms · Computer Science 2017-11-13 Cenk Baykal , Lucas Liebenwein , Wilko Schwarting

We initiate the study of coresets for clustering in graph metrics, i.e., the shortest-path metric of edge-weighted graphs. Such clustering problems are essential to data analysis and used for example in road networks and data visualization.…

Data Structures and Algorithms · Computer Science 2022-12-13 Daniel Baker , Vladimir Braverman , Lingxiao Huang , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

As the state-of-the-art machine learning methods in many fields rely on larger datasets, storing datasets and training models on them become significantly more expensive. This paper proposes a training set synthesis technique for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen

Given a training set $P$ of labeled points, the nearest-neighbor rule predicts the class of an unlabeled query point as the label of its closest point in the set. To improve the time and space complexity of classification, a natural…

Computational Geometry · Computer Science 2020-07-24 Alejandro Flores-Velazco , David M. Mount

The increasing availability of massive data sets poses a series of challenges for machine learning. Prominent among these is the need to learn models under hardware or human resource constraints. In such resource-constrained settings, a…

Machine Learning · Computer Science 2021-09-28 Zalán Borsos , Mojmír Mutný , Marco Tagliasacchi , Andreas Krause

As deep learning models continue to scale, the growing computational demands have amplified the need for effective coreset selection techniques. Coreset selection aims to accelerate training by identifying small, representative subsets of…

Machine Learning · Computer Science 2025-11-24 Wei-Kai Chang , Rajiv Khanna

We propose a method for learning from streaming visual data using a compact, constant size representation of all the data that was seen until a given moment. Specifically, we construct a 'coreset' representation of streaming data using a…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Abhimanyu Dubey , Nikhil Naik , Dan Raviv , Rahul Sukthankar , Ramesh Raskar

This research aims to detect the physical characteristics of corn kernels and analyze images using a deep learning model. The data analysis based on the CRISP-DM framework which consists of six steps, business understanding, data…

Computational Engineering, Finance, and Science · Computer Science 2024-05-31 Suwannee Adsavakulchai , Mawin Prommasaeng

We introduce kernel thinning, a new procedure for compressing a distribution $\mathbb{P}$ more effectively than i.i.d. sampling or standard thinning. Given a suitable reproducing kernel $\mathbf{k}_{\star}$ and $O(n^2)$ time, kernel…

Machine Learning · Statistics 2024-05-14 Raaz Dwivedi , Lester Mackey

Low-discrepancy points are designed to efficiently fill the space in a uniform manner. This uniformity is highly advantageous in many problems in science and engineering, including in numerical integration, computer vision, machine…

Machine Learning · Computer Science 2025-10-07 Michael Etienne Van Huffel , Nathan Kirk , Makram Chahine , Daniela Rus , T. Konstantin Rusch

Few-shot segmentation models excel in metal defect detection due to their rapid generalization ability to new classes and pixel-level segmentation, rendering them ideal for addressing data scarcity issues and achieving refined object…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hanze Ding , Zhangkai Wu , Jiyan Zhang , Ming Ping , Yanfang Liu