中文
相关论文

相关论文: Data Valuation with Gradient Similarity

200 篇论文

We approach structured output prediction by optimizing a deep value network (DVN) to precisely estimate the task loss on different output configurations for a given input. Once the model is trained, we perform inference by gradient descent…

机器学习 · 计算机科学 2017-08-09 Michael Gygli , Mohammad Norouzi , Anelia Angelova

In this paper, we present a simple yet effective provable method (named ABSGD) for addressing the data imbalance or label noise problem in deep learning. Our method is a simple modification to momentum SGD where we assign an individual…

机器学习 · 计算机科学 2023-06-09 Qi Qi , Yi Xu , Rong Jin , Wotao Yin , Tianbao Yang

Deep learning based salient object detection has recently achieved great success with its performance greatly outperforms any other unsupervised methods. However, annotating per-pixel saliency masks is a tedious and inefficient procedure.…

计算机视觉与模式识别 · 计算机科学 2018-03-20 Guanbin Li , Yuan Xie , Liang Lin

Data valuation, or the valuation of individual datum contributions, has seen growing interest in machine learning due to its demonstrable efficacy for tasks such as noisy label detection. In particular, due to the desirable axiomatic…

机器学习 · 计算机科学 2022-11-15 Stephanie Schoch , Haifeng Xu , Yangfeng Ji

Deep learning models often require large amounts of data for training, leading to increased costs. It is particularly challenging in medical imaging, i.e., gathering distributed data for centralized training, and meanwhile, obtaining…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Zhenyu Tang , Shaoting Zhang , Xiaosong Wang

Quantifying the value of data is a fundamental problem in machine learning. Data valuation has multiple important use cases: (1) building insights about the learning task, (2) domain adaptation, (3) corrupted sample discovery, and (4)…

机器学习 · 计算机科学 2019-09-27 Jinsung Yoon , Sercan O. Arik , Tomas Pfister

DSS serve the management, operations, and planning levels of an organization and help to make decisions, which may be rapidly changing and not easily specified in advance. Data mining has a vital role to extract important information to…

数据库 · 计算机科学 2012-10-12 Pardeep Kumar , Nitin , Vivek Kumar Sehgal , Durg Singh Chauhan

A recurring focus of the deep learning community is towards reducing the labeling effort. Data gathering and annotation using a search engine is a simple alternative to generating a fully human-annotated and human-gathered dataset. Although…

计算机视觉与模式识别 · 计算机科学 2021-10-27 Paul Albert , Diego Ortego , Eric Arazo , Noel O'Connor , Kevin McGuinness

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

机器学习 · 计算机科学 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Training data plays an essential role in modern applications of machine learning. However, gathering labeled training data is time-consuming. Therefore, labeling is often outsourced to less experienced users, or completely automated. This…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Alex Bäuerle , Heiko Neumann , Timo Ropinski

Deep neural networks need large amounts of labeled data to achieve good performance. In real-world applications, labels are usually collected from non-experts such as crowdsourcing to save cost and thus are noisy. In the past few years,…

机器学习 · 计算机科学 2021-06-18 Xian-Jin Gui , Wei Wang , Zhang-Hao Tian

In medical domain, data features often contain missing values. This can create serious bias in the predictive modeling. Typical standard data mining methods often produce poor performance measures. In this paper, we propose a new method to…

机器学习 · 统计学 2015-03-24 Talayeh Razzaghi , Oleg Roderick , Ilya Safro , Nick Marko

Tensors, which give a faithful and effective representation to deliver the intrinsic structure of multi-dimensional data, play a crucial role in an increasing number of signal processing and machine learning problems. However, tensor data…

机器学习 · 统计学 2026-02-17 Tong Wu

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

机器学习 · 计算机科学 2019-09-12 Jonas Mueller , Alex Smola

Distant supervision provides a means to create a large number of weakly labeled data at low cost for relation classification. However, the resulting labeled instances are very noisy, containing data with wrong labels. Many approaches have…

计算与语言 · 计算机科学 2020-10-27 Zhenzhen Li , Jian-Yun Nie , Benyou Wang , Pan Du , Yuhan Zhang , Lixin Zou , Dongsheng Li

Data valuation plays a crucial role in machine learning. Existing data valuation methods, mainly focused on discriminative models, overlook generative models that have gained attention recently. In generative models, data valuation measures…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Jiaxi Yang , Wenglong Deng , Benlin Liu , Yangsibo Huang , James Zou , Xiaoxiao Li

There is an emerging trend to leverage noisy image datasets in many visual recognition tasks. However, the label noise among the datasets severely degenerates the \mbox{performance of deep} learning approaches. Recently, one mainstream is…

计算机视觉与模式识别 · 计算机科学 2017-11-03 Jiangchao Yao , Jiajie Wang , Ivor Tsang , Ya Zhang , Jun Sun , Chengqi Zhang , Rui Zhang

In recent years, data selection has emerged as a core issue for large-scale visual-language model pretraining, especially on noisy web-curated datasets. One widely adopted strategy assigns quality scores such as CLIP similarity for each…

机器学习 · 计算机科学 2024-02-06 Yiping Wang , Yifang Chen , Wendan Yan , Kevin Jamieson , Simon Shaolei Du

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

机器学习 · 计算机科学 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

Labeling datasets for supervised object detection is a dull and time-consuming task. Errors can be easily introduced during annotation and overlooked during review, yielding inaccurate benchmarks and performance degradation of deep neural…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Marius Schubert , Tobias Riedlinger , Karsten Kahl , Daniel Kröll , Sebastian Schoenen , Siniša Šegvić , Matthias Rottmann