中文
相关论文

相关论文: Bayesian Data Cleaning for Web Data

200 篇论文

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

人工智能 · 计算机科学 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Machine Learning models increasingly face data integrity challenges due to the use of large-scale training datasets drawn from the Internet. We study what model developers can do if they detect that some data was manipulated or incorrect.…

机器学习 · 计算机科学 2024-10-18 Shashwat Goel , Ameya Prabhu , Philip Torr , Ponnurangam Kumaraguru , Amartya Sanyal

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

机器学习 · 计算机科学 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

计算机视觉与模式识别 · 计算机科学 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

Data cleaning is often framed as a technical preprocessing step, yet in practice it relies heavily on human judgment. We report results from a controlled survey study in which participants performed error detection, data repair and…

数据库 · 计算机科学 2026-03-26 Hazim AbdElazim , Shadman Islam , Mostafa Milani

Structure learning is essential for Bayesian networks (BNs) as it uncovers causal relationships, and enables knowledge discovery, predictions, inferences, and decision-making under uncertainty. Two novel algorithms, FSBN and SSBN, based on…

机器学习 · 计算机科学 2023-10-16 Minn Sein , Fu Shunkai

The recent success of machine learning models, especially large-scale classifiers and language models, relies heavily on training with massive data. These data are often collected from online sources. This raises serious concerns about the…

人工智能 · 计算机科学 2025-11-12 Ruihan Zhang , Jun Sun , Ee-Peng Lim , Peixin Zhang

Counterfactual explanations (CFEs) are essential for interpreting black-box models, yet they often become invalid when models are slightly changed. Existing methods for generating robust CFEs are often limited to specific types of models,…

机器学习 · 计算机科学 2026-04-21 Marcin Kostrzewa , Maciej Zięba , Jerzy Stefanowski

Data cleaning is naturally framed as probabilistic inference in a generative model of ground-truth data and likely errors, but the diversity of real-world error patterns and the hardness of inference make Bayesian approaches difficult to…

机器学习 · 计算机科学 2022-11-22 Alexander K. Lew , Monica Agrawal , David Sontag , Vikash K. Mansinghka

Real-world datasets are dirty and contain many errors. Examples of these issues are violations of integrity constraints, duplicates, and inconsistencies in representing data values and entities. Learning over dirty databases may result in…

数据库 · 计算机科学 2020-04-07 Jose Picado , John Davis , Arash Termehchy , Ga Young Lee

Conditional diffusion models are powerful generative models that can leverage various types of conditional information, such as class labels, segmentation masks, or text captions. However, in many real-world scenarios, conditional…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Nicolas Dufour , Victor Besnier , Vicky Kalogeiton , David Picard

Safe and reliable disclosure of information from confidential data is a challenging statistical problem. A common approach considers the generation of synthetic data, to be disclosed instead of the original data. Efficient approaches ought…

统计方法学 · 统计学 2024-03-04 Larissa N. A. Martins , Flávio B. Gonçalves , Thais P. Galletti

Effective intervention strategies for epidemics rely on the identification of their origin and on the robustness of the predictions made by network disease models. We introduce a Bayesian uncertainty quantification framework to infer model…

Learning exists in the context of data, yet notions of confidence typically focus on model predictions, not label quality. Confident learning (CL) is an alternative approach which focuses instead on label quality by characterizing and…

机器学习 · 统计学 2022-08-23 Curtis G. Northcutt , Lu Jiang , Isaac L. Chuang

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Federated learning (FL) presents an effective solution for collaborative model training while maintaining data privacy across decentralized client datasets. However, data quality issues such as noisy labels, missing classes, and imbalanced…

机器学习 · 计算机科学 2025-05-16 Alpaslan Gokcen , Ali Boyaci

Data-driven learning is generalized to consider history-dependent multi-fidelity data, while quantifying epistemic uncertainty and disentangling it from data noise (aleatoric uncertainty). This generalization is hierarchical and adapts to…

机器学习 · 计算机科学 2025-07-21 Jiaxiang Yi , Bernardo P. Ferreira , Miguel A. Bessa

A challenge for data imputation is the lack of knowledge. In this paper, we attempt to address this challenge by involving extra knowledge from web. To achieve high-performance web-based imputation, we use the dependency, i.e.FDs and CFDs,…

数据库 · 计算机科学 2016-11-15 Yiwen Tang , Hongzhi Wang , Shiwei Zhang , Huijun Zhang , Ruoxi Shi

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

机器学习 · 计算机科学 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

In this work we consider the problem of learning a classifier from noisy labels when a few clean labeled examples are given. The structure of clean and noisy data is modeled by a graph per class and Graph Convolutional Networks (GCN) are…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Ahmet Iscen , Giorgos Tolias , Yannis Avrithis , Ondrej Chum , Cordelia Schmid