English
Related papers

Related papers: Chunked Data Shapley: A Scalable Dataset Quality A…

200 papers

Rapid development in deep learning model construction has prompted an increased need for appropriate training data. The popularity of large datasets - sometimes known as "big data" - has diverted attention from assessing their quality.…

Machine Learning · Computer Science 2022-10-25 Jay Bishnu , Andrew Gondoputro

Clustering has become an increasingly important task in analysing huge amounts of data. Traditional applications require that all data has to be located at the site where it is scrutinized. Nowadays, large amounts of heterogeneous, complex…

Databases · Computer Science 2014-09-24 Eshref Januzaj , Hans-Peter Kriegel , Martin Pfeifle

Despite recent advancements in deep neural networks for point cloud recognition, real-world safety-critical applications present challenges due to unavoidable data corruption. Current models often fall short in generalizing to unforeseen…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Zhuoyuan Wu , Jiachen Sun , Chaowei Xiao

Cluster analysis is widely used in the areas of machine learning and data mining. Fuzzy clustering is a particular method that considers that a data point can belong to more than one cluster. Fuzzy clustering helps obtain flexible clusters,…

Machine Learning · Computer Science 2018-06-06 Aybükë Oztürk , Stéphane Lallich , Jérôme Darmont

The effectiveness of machine learning algorithms arises from being able to extract useful features from large amounts of data. As model and dataset sizes increase, dataset distillation methods that compress large datasets into significantly…

Machine Learning · Computer Science 2022-01-19 Timothy Nguyen , Roman Novak , Lechao Xiao , Jaehoon Lee

The presence of artificial intelligence (AI) in our society is increasing, which brings with it the need to understand the behavior of AI mechanisms, including machine learning predictive algorithms fed with tabular data, text or images,…

Machine Learning · Statistics 2025-06-06 Pedro Delicado , Cristian Pachón-García

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Shapley values have been used extensively in machine learning, not only to explain black box machine learning models, but among other tasks, also to conduct model debugging, sensitivity and fairness analyses and to select important features…

Machine Learning · Computer Science 2024-11-22 Iqbal Madakkatel , Elina Hyppönen

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

Real-time CNN-based object detection models for applications like surveillance can achieve high accuracy but are computationally expensive. Recent works have shown 10 to 100x reduction in computation cost for inference by using…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Kentaro Yoshioka , Edward Lee , Simon Wong , Mark Horowitz

Dataset pruning aims to select a subset of a dataset for efficient model training. While data efficiency in natural language processing has primarily focused on within-corpus scenarios during model pre-training, efficient dataset pruning…

Computation and Language · Computer Science 2025-01-07 Binh-Nguyen Nguyen , Yang He

Attribution scores can be applied in data management to quantify the contribution of individual items to conclusions from the data, as part of the explanation of what led to these conclusions. In Artificial Intelligence, Machine Learning,…

Databases · Computer Science 2024-01-15 Leopoldo Bertossi , Benny Kimelfeld , Ester Livshits , Mikaël Monet

Dataset Distillation (DD) seeks to create a condensed dataset that, when used to train a model, enables the model to achieve performance similar to that of a model trained on the entire original dataset. It relieves the model training from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Chuhao Zhou , Chenxi Jiang , Yi Xie , Haozhi Cao , Jianfei Yang

We introduce a new Shapley value approach for global sensitivity analysis and machine learning explainability. The method is based on the first-order partial derivatives of the underlying function. The computational complexity of the method…

Machine Learning · Computer Science 2023-03-28 Hui Duan , Giray Ökten

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values…

Machine Learning · Statistics 2020-02-07 Kjersti Aas , Martin Jullum , Anders Løland

Explainable AI (XAI) has become an increasingly important topic for understanding and attributing the predictions made by complex Time Series Classification (TSC) models. Among attribution methods, SHapley Additive exPlanations (SHAP) is…

Artificial Intelligence · Computer Science 2025-09-05 Davide Italo Serramazza , Nikos Papadeas , Zahraa Abdallah , Georgiana Ifrim

We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities. On the one hand, the detection…

Machine Learning · Statistics 2020-09-23 Jie Guo , Hao Yan , Chen Zhang , Steven Hoi

Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods,…

High quality upsampling of sparse 3D point clouds is critically useful for a wide range of geometric operations such as reconstruction, rendering, meshing, and analysis. In this paper, we propose a data-driven algorithm that enables an…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 Wentai Zhang , Haoliang Jiang , Zhangsihao Yang , Soji Yamakawa , Kenji Shimada , Levent Burak Kara

Dataset distillation and dataset pruning are two prominent techniques for compressing datasets to improve computational and storage efficiency. Despite their overlapping objectives, these approaches are rarely compared directly. Even within…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Lingao Xiao , Songhua Liu , Yang He , Xinchao Wang