中文
相关论文

相关论文: Chunked Data Shapley: A Scalable Dataset Quality A…

200 篇论文

Dimensionality reduction (DR) techniques have been consistently supporting high-dimensional data analysis in various applications. Besides the patterns uncovered by these techniques, the interpretation of DR results based on each feature's…

机器学习 · 计算机科学 2021-03-11 Wilson Estécio Marcílio Júnior , Danilo Medeiros Eler

Dataset distillation aims at synthesizing a dataset by a small number of artificially generated data items, which, when used as training data, reproduce or approximate a machine learning (ML) model as if it were trained on the entire…

机器学习 · 计算机科学 2024-03-27 Radu-Andrei Rosu , Mihaela-Elena Breaban , Henri Luchian

Modern computer vision foundation models are trained on massive amounts of data, incurring large economic and environmental costs. Recent research has suggested that improving data quality can significantly reduce the need for data…

计算机视觉与模式识别 · 计算机科学 2023-11-08 Benjamin Feuer , Chinmay Hegde

Shapley value-based data valuation methods, originating from cooperative game theory, quantify the usefulness of each individual sample by considering its contribution to all possible training subsets. Despite their extensive applications,…

机器学习 · 计算机科学 2024-05-29 Ziao Yang , Han Yue , Jian Chen , Hongfu Liu

Large Language Models (LLMs) are increasingly used in systems that retrieve and summarize content from multiple sources, such as search engines and AI assistants. While these systems enhance user experience through coherent summaries, they…

计算与语言 · 计算机科学 2026-01-08 Zikun Ye , Hema Yoganarasimhan

Shapelets are discriminative time series subsequences that allow generation of interpretable classification models, which provide faster and generally better classification than the nearest neighbor approach. However, the shapelet discovery…

机器学习 · 计算机科学 2017-02-23 Atif Raza , Stefan Kramer

Subsampling from a large data set is useful in many supervised learning contexts to provide a global view of the data based on only a fraction of the observations. Diverse (or space-filling) subsampling is an appealing subsampling approach…

统计方法学 · 统计学 2023-11-27 Boyang Shang , Daniel W. Apley , Sanjay Mehrotra

Modern large-scale datasets are frequently said to be high-dimensional. However, their data point clouds frequently possess structures, significantly decreasing their intrinsic dimensionality (ID) due to the presence of clusters, points…

机器学习 · 计算机科学 2019-01-21 Luca Albergante , Jonathan Bac , Andrei Zinovyev

Feature selection is a classical problem in statistics and machine learning, and it continues to remain an extremely challenging problem especially in the context of unknown non-linear relationships with dependent features. On the other…

机器学习 · 统计学 2026-04-17 Chenghui Zheng , Garvesh Raskutti

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature…

机器学习 · 统计学 2025-10-03 Wangxuan Fan , Siqi Li , Doudou Zhou , Yohei Okada , Chuan Hong , Molei Liu , Nan Liu

The Shapley value is a game-theoretic notion for wealth distribution that is nowadays extensively used to explain complex data-intensive computation, for instance, in network analysis or machine learning. Recent theoretical works show that…

数据库 · 计算机科学 2022-01-04 Daniel Deutch , Nave Frost , Benny Kimelfeld , Mikaël Monet

Data-oriented applications, their users, and even the law require data of high quality. Research has divided the rather vague notion of data quality into various dimensions, such as accuracy, consistency, and reputation. To achieve the goal…

数据库 · 计算机科学 2024-12-09 Sedir Mohammed , Lisa Ehrlinger , Hazar Harmouch , Felix Naumann , Divesh Srivastava

Recent works have shown that machine learning models improve at a predictable rate with the total amount of training data, leading to scaling laws that describe the relationship between error and dataset size. These scaling laws can help…

机器学习 · 计算机科学 2024-06-03 Ian Covert , Wenlong Ji , Tatsunori Hashimoto , James Zou

Assessing the quality and impact of individual data points is critical for improving model performance and mitigating undesirable biases within the training dataset. Several data valuation algorithms have been proposed to quantify data…

机器学习 · 计算机科学 2023-10-16 Kevin Fu Jiang , Weixin Liang , James Zou , Yongchan Kwon

We study the problem of discovering joinable datasets at scale. This is, how to automatically discover pairs of attributes in a massive collection of independent, heterogeneous datasets that can be joined. Exact (e.g., based on distinct…

数据库 · 计算机科学 2020-12-07 Javier Flores , Sergi Nadal , Oscar Romero

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

机器学习 · 计算机科学 2026-03-30 Jörg Martin , Stefan Haufe

Because of their strong theoretical properties, Shapley values have become very popular as a way to explain predictions made by black box models. Unfortuately, most existing techniques to compute Shapley values are computationally very…

机器学习 · 计算机科学 2022-08-29 Arne Gevaert , Yvan Saeys

Exascale computing promises quantities of data too large to efficiently store and transfer across networks in order to be able to analyze and visualize the results. We investigate Compressive Sensing (CS) as a way to reduce the size of the…

信息论 · 计算机科学 2015-08-27 Maher Salloum , Nathan Fabian , David M. Hensinger , Jeremy A. Templeton

We present SHAPNN, a novel deep tabular data modeling architecture designed for supervised learning. Our approach leverages Shapley values, a well-established technique for explaining black-box models. Our neural network is trained using…

机器学习 · 计算机科学 2023-09-19 Qisen Cheng , Shuhui Qu , Janghwan Lee

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

统计方法学 · 统计学 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao