中文
相关论文

相关论文: Machine learning approaches for automatic cleaning…

200 篇论文

Modern data acquisition based on high-throughput technology is often facing the problem of missing data. Algorithms commonly used in the analysis of such large-scale data often depend on a complete set. Missing value imputation offers a…

应用统计 · 统计学 2014-06-03 Daniel J. Stekhoven , Peter Bühlmann

Individual tree detection and crown delineation (ITDD) are critical in forest inventory management and remote sensing based forest surveys are largely carried out through satellite images. However, most of these surveys only use 2D spectral…

计算机视觉与模式识别 · 计算机科学 2021-07-02 Changlin Xiao , Rongjun Qin , Xiao Xie , Xu Huang

Recently, advances in machine learning techniques have attracted the attention of the research community to build intrusion detection systems (IDS) that can detect anomalies in the network traffic. Most of the research works, however, do…

密码学与安全 · 计算机科学 2018-12-14 Tara Salman , Deval Bhamare , Aiman Erbad , Raj Jain , Mohammed Samaka

Isolation Forest (iForest) is an unsupervised anomaly detection algorithm designed to effectively detect anomalies under the assumption that anomalies are ``few and different." Various studies have aimed to enhance iForest, but the…

机器学习 · 计算机科学 2025-03-18 Hun Kang , Kyoungok Kim

Intrusion Detection Systems (IDS) are developed to protect the network by detecting the attack. The current paper proposes an unsupervised feature selection technique for analyzing the network data. The search capability of the…

神经与进化计算 · 计算机科学 2019-05-17 Chanchal Suman , Somanath Tripathy , Sriparna Saha

Data cleaning is the initial stage of any machine learning project and is one of the most critical processes in data analysis. It is a critical step in ensuring that the dataset is devoid of incorrect or erroneous data. It can be done…

数据库 · 计算机科学 2021-09-16 Ga Young Lee , Lubna Alzamil , Bakhtiyar Doskenov , Arash Termehchy

Deep discriminative approaches, such as decision forests and deep neural networks, have recently found applications in many important real-world scenarios. However, deploying these learning algorithms in safety-critical applications raises…

机器学习 · 计算机科学 2025-06-12 Jayanta Dey , Haoyin Xu , Ashwin De Silva , Joshua T. Vogelstein

Matrix decomposition is one of the fundamental tools to discover knowledge from big data generated by modern applications. However, it is still inefficient or infeasible to process very big data using such a method in a single machine.…

机器学习 · 计算机科学 2020-02-11 Chihao Zhang , Yang Yang , Wei Zhang , Shihua Zhang

For many machine learning tasks, the input data lie on a low-dimensional manifold embedded in a high dimensional space and, because of this high-dimensional structure, most algorithms are inefficient. The typical solution is to reduce the…

机器学习 · 计算机科学 2019-03-05 Anna C. Gilbert , Rishi Sonthalia

Data cleansing is a typical approach used to improve the accuracy of machine learning models, which, however, requires extensive domain knowledge to identify the influential instances that affect the models. In this paper, we propose an…

机器学习 · 统计学 2019-06-21 Satoshi Hara , Atsushi Nitanda , Takanori Maehara

Intrusion detection system (IDS) is one of the implemented solutions against harmful attacks. Furthermore, attackers always keep changing their tools and techniques. However, implementing an accepted IDS system is also a challenging task.…

密码学与安全 · 计算机科学 2018-01-09 Mohammad Almseidin , Maen Alzubi , Szilveszter Kovacs , Mouhammd Alkasassbeh

In many biomedical research, multiple views of data (e.g., genomics, proteomics) are available, and a particular interest might be the detection of sample subgroups characterized by specific groups of variables. Biclustering methods are…

统计方法学 · 统计学 2021-11-12 W. Zhang , C. Wendt , R. Bowler , C. P. Hersh , S. E. Safo

The escalation of hazards to safety and hijacking of digital networks are among the strongest perilous difficulties that must be addressed in the present day. Numerous safety procedures were set up to track and recognize any illicit…

密码学与安全 · 计算机科学 2023-10-03 Sudhanshu Sekhar Tripathy , Bichitrananda Behera

Random forest (RF) missing data algorithms are an attractive approach for dealing with missing data. They have the desirable properties of being able to handle mixed types of missing data, they are adaptive to interactions and nonlinearity,…

机器学习 · 统计学 2017-01-23 Fei Tang , Hemant Ishwaran

Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to 'mine' variables of interest…

计量经济学 · 经济学 2020-12-22 Mochen Yang , Edward McFowland , Gordon Burtch , Gediminas Adomavicius

Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses…

机器学习 · 计算机科学 2025-05-20 Chuanxing Geng , Qifei Li , Xinrui Wang , Dong Liang , Songcan Chen , Pong C. Yuen

Data acquisition and recording in the form of databases are routine operations. The process of collecting data, however, may experience irregularities, resulting in databases with missing data. Missing entries might alter analysis…

数据库 · 计算机科学 2021-08-24 Paul Dixneuf , Fausto Errico , Mathias Glaus

One of the most important processing steps in any analysis pipeline is handling missing data. Traditional approaches simply delete any sample or feature with missing elements. Recent imputation methods replace missing data based on assumed…

数据库 · 计算机科学 2024-05-03 Kenneth Smith , Sharlee Climer

This study introduces the Iterative Refinement Process (IRP), a robust anomaly detection methodology designed for high-stakes industrial quality control. The IRP enhances defect detection accuracy through a cyclic data refinement strategy,…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

机器学习 · 计算机科学 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel