中文
相关论文

相关论文: Chunked Data Shapley: A Scalable Dataset Quality A…

200 篇论文

Data valuation has garnered increasing attention in recent years, given the critical role of high-quality data in various applications. Among diverse data valuation approaches, Shapley value-based methods are predominant due to their strong…

机器学习 · 计算机科学 2025-11-27 Xiaoling Zhou , Ou Wu , Michael K. Ng , Hao Jiang

The reliability of machine learning models can be compromised when trained on low quality data. Many large-scale medical imaging datasets contain low quality labels extracted from sources such as medical reports. Moreover, images within a…

机器学习 · 计算机科学 2021-04-20 Siyi Tang , Amirata Ghorbani , Rikiya Yamashita , Sameer Rehman , Jared A. Dunnmon , James Zou , Daniel L. Rubin

Data Shapley provides a principled approach to data valuation and plays a crucial role in data-centric machine learning (ML) research. Data selection is considered a standard application of Data Shapley. However, its data selection…

机器学习 · 计算机科学 2024-05-08 Jiachen T. Wang , Tianji Yang , James Zou , Yongchan Kwon , Ruoxi Jia

Machine learning has been proven to be effective in various application areas, such as object and speech recognition on mobile systems. Since a critical key to machine learning success is the availability of large training data, many…

机器学习 · 计算机科学 2021-01-06 Hyeongmin Cho , Sangkyun Lee

Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential…

机器学习 · 计算机科学 2024-05-24 Borui Zhang , Baotong Tian , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Dataset complexity assessment aims to predict classification performance on a dataset with complexity calculation before training a classifier, which can also be used for classifier selection and dataset reduction. The training process of…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Data valuation has become an increasingly significant discipline in data science due to the economic value of data. In the context of machine learning (ML), data valuation methods aim to equitably measure the contribution of each data point…

机器学习 · 计算机科学 2023-06-13 Xiang Li , Haocheng Xia , Jinfei Liu

Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML applications such as data valuation and feature attribution, the…

机器学习 · 计算机科学 2025-03-11 Pranoy Panda , Siddharth Tandon , Vineeth N Balasubramanian

Data valuation, especially quantifying data value in algorithmic prediction and decision-making, is a fundamental problem in data trading scenarios. The most widely used method is to define the data Shapley and approximate it by means of…

机器学习 · 统计学 2023-05-23 Mengmeng Wu , Ruoxi Jia , Changle Lin , Wei Huang , Xiangyu Chang

The application of Shapley values to high-dimensional, time-series-like data is computationally challenging - and sometimes impossible. For $N$ inputs the problem is $2^N$ hard. In image processing, clusters of pixels, referred to as…

定量方法 · 定量生物学 2024-09-30 Lauren Elborough , Duncan Taylor , Melissa Humphries

We present an unsupervised method for aggregating anomalies in tabular datasets by identifying the top-k tabular data quality insights. Each insight consists of a set of anomalous attributes and the corresponding subsets of records that…

机器学习 · 计算机科学 2025-01-14 Manisha Padala , Lokesh Nagalapatti , Atharv Tyagi , Ramasuri Narayanam , Shiv Kumar Saini

Quantifying the value of data within a machine learning workflow can play a pivotal role in making more strategic decisions in machine learning initiatives. The existing Shapley value based frameworks for data valuation in machine learning…

机器学习 · 计算机科学 2024-07-10 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Hong Ming Tan , Bowei Chen , Mohan Kankanhalli

"How much is my data worth?" is an increasingly common question posed by organizations and individuals alike. An answer to this question could allow, for instance, fairly distributing profits among multiple data contributors and determining…

机器学习 · 计算机科学 2023-03-07 Ruoxi Jia , David Dao , Boxin Wang , Frances Ann Hubis , Nick Hynes , Nezihe Merve Gurel , Bo Li , Ce Zhang , Dawn Song , Costas Spanos

High-quality data is critical to train performant Machine Learning (ML) models, highlighting the importance of Data Quality Management (DQM). Existing DQM schemes often cannot satisfactorily improve ML performance because, by design, they…

机器学习 · 计算机科学 2021-06-11 Tianhao Wang , Yi Zeng , Ming Jin , Ruoxi Jia

As data emerges as a vital driver of technological and economic advancements, a key challenge is accurately quantifying its value in algorithmic decision-making. The Shapley value, a well-established concept from cooperative game theory,…

计算机科学与博弈论 · 计算机科学 2025-11-20 Xi Zheng , Xiangyu Chang , Ruoxi Jia , Yong Tan

The Shapley value provides a principled framework for fairly distributing rewards among participants according to their individual contributions. While prior work has applied this concept to data valuation in machine learning, existing…

计算机科学与博弈论 · 计算机科学 2026-01-22 Zhuofan Jia , Jian Pei

Besides accuracy, recent studies on machine learning models have been addressing the question on how the obtained results can be interpreted. Indeed, while complex machine learning models are able to provide very good results in terms of…

机器学习 · 计算机科学 2022-11-07 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte , Michel Grabisch

Algorithmic fairness is of utmost societal importance, yet state-of-the-art large-scale machine learning models require training with massive datasets that are frequently biased. In this context, pre-processing methods that focus on…

机器学习 · 计算机科学 2024-06-12 Adrian Arnaiz-Rodriguez , Nuria Oliver

Shapley values are great analytical tools in game theory to measure the importance of a player in a game. Due to their axiomatic and desirable properties such as efficiency, they have become popular for feature importance analysis in data…

机器学习 · 计算机科学 2020-10-26 Ramin Okhrati , Aldo Lipani

Data valuation is an essential task in a data marketplace. It aims at fairly compensating data owners for their contribution. There is increasing recognition in the machine learning community that the Shapley value -- a foundational…

密码学与安全 · 计算机科学 2023-02-20 Zhihua Tian , Jian Liu , Jingyu Li , Xinle Cao , Ruoxi Jia , Jun Kong , Mengdi Liu , Kui Ren