中文
相关论文

相关论文: Chunked Data Shapley: A Scalable Dataset Quality A…

200 篇论文

In this paper, we delve into the critical aspect of dataset quality assessment in machine learning classification tasks. Leveraging a variety of nine distinct datasets, each crafted for classification tasks with varying complexity levels,…

机器学习 · 计算机科学 2023-06-28 Szymon Mazurek , Maciej Wielgosz

Data augmentation via synthetic data generation has been shown to be effective in improving model performance and robustness in the context of scarce or low-quality data. Using the data valuation framework to statistically identify…

机器学习 · 计算机科学 2025-02-11 Tommaso Ferracci , Leonie Tabea Goldmann , Anton Hinel , Francesco Sanna Passino

Measuring the value of individual samples is critical for many data-driven tasks, e.g., the training of a deep learning model. Recent literature witnesses the substantial efforts in developing data valuation methods. The primary data…

机器学习 · 计算机科学 2024-06-06 Ou Wu , Weiyao Zhu , Mengyang Li

In the field of machine learning, model performance is usually assessed by randomly splitting data into training and test sets. Different random splits, however, can yield markedly different performance estimates, so a genuinely good model…

In this paper, we propose a Shapley value based method to evaluate operation contribution (Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) acquires the optimal architectures by optimizing the…

机器学习 · 计算机科学 2022-06-22 Han Xiao , Ziwei Wang , Zheng Zhu , Jie Zhou , Jiwen Lu

Driven by the ``scale-is-everything'' paradigm, modern machine learning increasingly demands ever-larger datasets and models, yielding prohibitive computational and storage requirements. Dataset distillation mitigates this by compressing an…

机器学习 · 计算机科学 2025-07-24 Youneng Bao , Yiping Liu , Zhuo Chen , Yongsheng Liang , Mu Li , Kede Ma

Ensuring consistent product quality in modern manufacturing is crucial, particularly in safety-critical applications. Conventional quality control approaches, reliant on manually defined thresholds and features, lack adaptability to the…

机器学习 · 计算机科学 2026-04-09 Bernd Hofmann , Patrick Bruendl , Huong Giang Nguyen , Joerg Franke

Data valuation aims to quantify the usefulness of individual data sources in training machine learning (ML) models, and is a critical aspect of data-centric ML research. However, data valuation faces significant yet frequently overlooked…

机器学习 · 计算机科学 2023-11-28 Jiachen T. Wang , Yuqing Zhu , Yu-Xiang Wang , Ruoxi Jia , Prateek Mittal

Measuring dataset similarity is fundamental in machine learning, particularly for transfer learning and domain adaptation. In the context of supervised learning, most existing approaches quantify similarity of two data sets based on their…

机器学习 · 统计学 2026-04-22 Shudong Sun , Hao Helen Zhang , Joseph C Watkins

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires…

机器学习 · 计算机科学 2025-11-05 Rodrigo Mendoza-Smith

Industrial Internet of Things environments increasingly rely on advanced Anomaly Detection and explanation techniques to rapidly detect and mitigate cyberincidents, thereby ensuring operational safety. The sequential nature of data…

机器学习 · 计算机科学 2025-06-03 Manuel Franco de la Peña , Ángel Luis Perales Gómez , Lorenzo Fernández Maimó

Maintaining high data quality is crucial for reliable data analysis and machine learning (ML). However, existing data quality management tools often lack automation, interactivity, and integration with ML workflows. This demonstration paper…

数据库 · 计算机科学 2025-01-29 Mohamed Abdelaal , Samuel Lokadjaja , Arne Kreuz , Harald Schöning

High-quality data is crucial for accurate machine learning and actionable analytics, however, mislabeled or noisy data is a common problem in many domains. Distinguishing low- from high-quality data can be challenging, often requiring…

机器学习 · 计算机科学 2024-05-15 Nathaniel J. Evans , Gordon B. Mills , Guanming Wu , Xubo Song , Shannon McWeeney

Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high…

机器学习 · 计算机科学 2023-05-09 Amin Nayebi , Sindhu Tipirneni , Chandan K Reddy , Brandon Foreman , Vignesh Subbian

As data plays an increasingly pivotal role in decision-making, the emergence of data markets underscores the growing importance of data valuation. Within the machine learning landscape, Data Shapley stands out as a widely embraced method…

机器学习 · 统计学 2024-07-30 Mengmeng Wu , Zhihong Liu , Xiang Li , Ruoxi Jia , Xiangyu Chang

Developing modern machine learning (ML) applications is data-centric, of which one fundamental challenge is to understand the influence of data quality to ML training -- "Which training examples are 'guilty' in making the trained ML model…

机器学习 · 计算机科学 2022-04-28 Bojan Karlaš , David Dao , Matteo Interlandi , Bo Li , Sebastian Schelter , Wentao Wu , Ce Zhang

With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in explainable AI. They are used for feature attribution, data attribution, data valuation, and more.…

机器学习 · 计算机科学 2026-01-14 R. Teal Witter , Yurong Liu , Christopher Musco

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

机器学习 · 计算机科学 2023-12-27 Shiye Lei , Dacheng Tao

Data valuation using Shapley value has emerged as a prevalent research domain in machine learning applications. However, it is a challenge to address the role of order in data cooperation as most research lacks such discussion. To tackle…

机器学习 · 计算机科学 2023-05-04 Jie Liu , Peizheng Wang , Chao Wu

Deep learning models often require large amounts of data for training, leading to increased costs. It is particularly challenging in medical imaging, i.e., gathering distributed data for centralized training, and meanwhile, obtaining…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Zhenyu Tang , Shaoting Zhang , Xiaosong Wang