English
Related papers

Related papers: Detecting Data Errors with Statistical Constraints

200 papers

Today, data analysts largely rely on intuition to determine whether missing or withheld rows of a dataset significantly affect their analyses. We propose a framework that can produce automatic contingency analysis, i.e., the range of values…

Databases · Computer Science 2020-04-09 Xi Liang , Zechao Shang , Aaron J. Elmore , Sanjay Krishnan , Michael J. Franklin

While the human visual system employs distinct mechanisms to perceive salient and camouflaged objects, existing models struggle to disentangle these tasks. Specifically, salient object detection (SOD) models frequently misclassify…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhangjun Zhou , Yiping Li , Chunlin Zhong , Jianuo Huang , Jialun Pei , Hua Li , He Tang

Datasets serve as crucial training resources and model performance trackers. However, existing datasets have exposed a plethora of problems, inducing biased models and unreliable evaluation results. In this paper, we propose a…

Computation and Language · Computer Science 2022-12-20 Chengwen Wang , Qingxiu Dong , Xiaochen Wang , Haitao Wang , Zhifang Sui

Stance Detection (StD) aims to detect an author's stance towards a certain topic or claim and has become a key component in applications like fake news detection, claim validation, and argument search. However, while stance is easily…

Computation and Language · Computer Science 2020-01-07 Benjamin Schiller , Johannes Daxenberger , Iryna Gurevych

Integrating heterogeneous datasets across different measurement platforms is a fundamental challenge in many scientific applications. A common example arises in deconvolution problems, such as cell type deconvolution, where one aims to…

Methodology · Statistics 2025-09-30 Dongyue Xie , Lin Gui , Jingshu Wang

Due to the high cost of collection and labeling, there are relatively few datasets for camouflaged object detection (COD). In particular, for certain specialized categories, the available image dataset is insufficiently populated. Synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhihao Luo , Luojun Lin , Zheng Lin

Software logs are messages recorded during the execution of a software system that provide crucial run-time information about events and activities. Although software logs have a critical role in software maintenance and operation tasks,…

Software Engineering · Computer Science 2025-05-22 Roozbeh Aghili , Xingfang Wu , Foutse Khomh , Heng Li

Controlling false positives (Type I errors) through statistical hypothesis testing is a foundation of modern scientific data analysis. Existing causal structure discovery algorithms either do not provide Type I error control or cannot scale…

Methodology · Statistics 2025-12-29 James Leiner , Brian Manzo , Aaditya Ramdas , Wesley Tansey

Protecting sensitive information in diagnostic data such as logs, is a critical concern in the industrial software diagnosis and debugging process. While there are many tools developed to automatically redact the logs for identifying and…

Cryptography and Security · Computer Science 2024-09-27 Lixi Zhou , Lei Yu , Jia Zou , Hong Min

Change detection is of fundamental importance when analyzing data streams. Detecting changes both quickly and accurately enables monitoring and prediction systems to react, e.g., by issuing an alarm or by updating a learning algorithm.…

Machine Learning · Computer Science 2024-01-17 Marco Heyden , Edouard Fouché , Vadim Arzamasov , Tanja Fenn , Florian Kalinke , Klemens Böhm

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional…

Machine Learning · Statistics 2020-10-13 Daniel Chicharro , Michel Besserve , Stefano Panzeri

The complexity of Machine Learning (ML) systems increases each year, with current implementations of large language models or text-to-image generators having billions of parameters and requiring billions of arithmetic operations. As these…

Machine Learning · Computer Science 2024-01-17 Pedro Reviriego , Ziheng Wang , Alvaro Alonso , Zhen Gao , Farzad Niknia , Shanshan Liu , Fabrizio Lombardi

Coreset Selection (CS) aims to identify a subset of the training dataset that achieves model performance comparable to using the entire dataset. Many state-of-the-art CS methods select coresets using scores whose computation requires…

Machine Learning · Computer Science 2025-06-05 Akshay Mehra , Trisha Mittal , Subhadra Gopalakrishnan , Joshua Kimball

Data is of high quality if it is fit for its intended use. The quality of data is influenced by the underlying data model and its quality. One major quality problem is the heterogeneity of data as quality aspects such as understandability…

Machine Learning · Computer Science 2021-11-15 Viola Wenz , Arno Kesper , Gabriele Taentzer

A number of problems in relational Artificial Intelligence can be viewed as Stochastic Constraint Optimization Problems (SCOPs). These are constraint optimization problems that involve objectives or constraints with a stochastic component.…

Artificial Intelligence · Computer Science 2018-07-04 Anna L. D. Latour , Behrouz Babaki , Siegfried Nijssen

Constrained sequential pattern mining aims at identifying frequent patterns on a sequential database of items while observing constraints defined over the item attributes. We introduce novel techniques for constraint-based sequential…

Machine Learning · Computer Science 2019-01-01 Amin Hosseininasab , Willem-Jan van Hoeve , Andre A. Cire

Through purposeful introduction of malicious transactions (tracking transactions) into randomly select nodes of a (database) graph, soiled and clean segments are identified. Soiled and clean measures corresponding those segments are then…

Databases · Computer Science 2008-04-27 Prashanth Alluvada

Artificial intelligence models trained from data can only be as good as the underlying data is. Biases in training data propagating through to the output of a machine learning model are a well-documented and well-understood phenomenon, but…

Machine Learning · Computer Science 2025-04-02 Stefan Rass , Martin Dallinger

We introduce SCDE, a dataset to evaluate the performance of computational models through sentence prediction. SCDE is a human-created sentence cloze dataset, collected from public school English examinations. Our task requires a model to…

Computation and Language · Computer Science 2020-04-28 Xiang Kong , Varun Gangal , Eduard Hovy

Negative control variables are increasingly used to adjust for unmeasured confounding bias in causal inference using observational data. They are typically identified by subject matter knowledge and there is currently a severe lack of…

Methodology · Statistics 2022-10-04 Erich Kummerfeld , Jaewon Lim , Xu Shi