English
Related papers

Related papers: Establishing strong imputation performance of a de…

200 papers

Adopting data-based approaches leads to model improvement in numerous Oil&Gas logging data processing problems. These improvements become even more sound due to new capabilities provided by deep learning. However, usage of deep learning is…

Machine Learning · Computer Science 2022-09-27 Sergey Egorov , Narek Gevorgyan , Alexey Zaytsev

Missing data is a pervasive issue in both scientific and engineering tasks, especially for the modeling of spatiotemporal data. This problem attracts many studies to contribute to data-driven solutions. Existing imputation solutions mainly…

Machine Learning · Computer Science 2024-07-26 Tong Nie , Guoyang Qin , Wei Ma , Yuewen Mei , Jian Sun

Unsupervised learning is of growing interest because it unlocks the potential held in vast amounts of unlabelled data to learn useful representations for inference. Autoencoders, a form of generative model, may be trained by learning to…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Antonia Creswell , Anil Anthony Bharath

Learning to detect fraud in large-scale accounting data is one of the long-standing challenges in financial statement audits or fraud investigations. Nowadays, the majority of applied techniques refer to handcrafted rules derived from known…

Machine Learning · Computer Science 2018-08-02 Marco Schreyer , Timur Sattarov , Damian Borth , Andreas Dengel , Bernd Reimer

We present a representation learning method that learns features at multiple different levels of scale. Working within the unsupervised framework of denoising autoencoders, we observe that when the input is heavily corrupted during…

Machine Learning · Computer Science 2015-04-14 Krzysztof J. Geras , Charles Sutton

Most recent network failure diagnosis systems focused on data center networks where complex measurement systems can be deployed to derive routing information and ensure network coverage in order to achieve accurate and fast fault…

Networking and Internet Architecture · Computer Science 2022-07-06 Yufeng Xin , Shih-Wen Fu , Anirban Mandal , Ryan Tanaka , Mats Rynge , Karan Vahi , Ewa Deelman

Time series imputation is one of the most fundamental tasks for time series. Real-world time series datasets are frequently incomplete (or irregular with missing observations), in which case imputation is strongly required. Many different…

Machine Learning · Computer Science 2024-06-25 Hyowon Wi , Yehjin Shin , Noseong Park

Imputation of missing attribute values in medical datasets for extracting hidden knowledge from medical datasets is an interesting research topic of interest which is very challenging. One cannot eliminate missing values in medical records.…

Databases · Computer Science 2016-03-11 Yelipe UshaRani , P. Sammulal

Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model performance and explores strategies to mitigate these effects…

Machine Learning · Computer Science 2025-05-22 Qi Liu , Wanjing Ma

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events,…

Machine Learning · Computer Science 2020-01-16 Yuhao Wang , Vlado Menkovski , Hao Wang , Xin Du , Mykola Pechenizkiy

Businesses are naturally interested in detecting anomalies in their internal processes, because these can be indicators for fraud and inefficiencies. Within the domain of business intelligence, classic anomaly detection is not very…

Artificial Intelligence · Computer Science 2018-05-01 Timo Nolle , Stefan Luettgen , Alexander Seeliger , Max Mühlhäuser

Missing data imputation (MDI) is a fundamental problem in many scientific disciplines. Popular methods for MDI use global statistics computed from the entire data set (e.g., the feature-wise medians), or build predictive models operating…

Machine Learning · Computer Science 2020-06-25 Indro Spinelli , Simone Scardapane , Aurelio Uncini

Generative processes in biology and other fields often produce data that can be regarded as resulting from a composition of basic features. Here we present an unsupervised method based on autoencoders for inferring these basic features of…

Quantitative Methods · Quantitative Biology 2019-10-04 Matteo Negri , Davide Bergamini , Carlo Baldassi , Riccardo Zecchina , Christoph Feinauer

Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely…

Machine Learning · Computer Science 2019-12-13 Shahin Khobahi , Arindam Bose , Mojtaba Soltanalian

Many datasets suffer from missing values due to various reasons,which not only increases the processing difficulty of related tasks but also reduces the accuracy of classification. To address this problem, the mainstream approach is to use…

Machine Learning · Computer Science 2024-08-14 Cong Guo , Chun Liu , Wei Yang

In the integrative analyses of omics data, it is often of interest to extract data representation from one data type that best reflect its relations with another data type. This task is traditionally fulfilled by linear methods such as…

Applications · Statistics 2021-03-30 Tianwei Yu

This work investigates a practical and novel method for automated unsupervised fault detection in vehicles using a fully convolutional autoencoder. The results demonstrate the algorithm we developed can detect anomalies which correspond to…

Machine Learning · Computer Science 2024-09-10 Anthony Geglio , Eisa Hedayati , Mark Tascillo , Dyche Anderson , Jonathan Barker , Timothy C. Havens

This paper introduces a methodology based on Denoising AutoEncoder (DAE) for missing data imputation. The proposed methodology, called mDAE hereafter, results from a modification of the loss function and a straightforward procedure for…

Machine Learning · Computer Science 2024-11-21 Mariette Dupuy , Marie Chavent , Remi Dubois

Missing data represents a fundamental challenge in machine learning applications, often reducing model performance and reliability. This problem is particularly acute in fields like bioinformatics and clinical machine learning, where…

Machine Learning · Computer Science 2025-09-04 Fatemeh Azad , Zoran Bosnić , Matjaž Kukar

Latent variable models can be used to probabilistically "fill-in" missing data entries. The variational autoencoder architecture (Kingma and Welling, 2014; Rezende et al., 2014) includes a "recognition" or "encoder" network that infers the…

Machine Learning · Computer Science 2019-02-20 Christopher K. I. Williams , Charlie Nash , Alfredo Nazábal