English
Related papers

Related papers: Iterative missing value imputation based on featur…

200 papers

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

As the public seeks greater accountability and transparency from machine learning algorithms, the research literature on methods to explain algorithms and their outputs has rapidly expanded. Feature importance methods form a popular class…

Computers and Society · Computer Science 2021-02-01 Leif Hancox-Li , I. Elizabeth Kumar

This chapter addresses important steps during the quality assurance and control of RWD, with particular emphasis on the identification and handling of missing values. A gentle introduction is provided on common statistical and machine…

Methodology · Statistics 2021-11-01 Dawei Liu , Hanne I. Oberman , Johanna Muñoz , Jeroen Hoogland , Thomas P. A. Debray

Objective: The proper handling of missing values is critical to delivering reliable estimates and decisions, especially in high-stakes fields such as clinical research. The increasing diversity and complexity of data have led many…

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

The representational capacity of modern neural network architectures has made them a default choice in various applications with high dimensional feature sets. But these high dimensional and potentially noisy features combined with the…

Machine Learning · Computer Science 2020-10-13 Vinay Varma K

In this paper, we integrate the concepts of feature importance with implicit bias in the context of pattern classification. This is done by means of a three-step methodology that involves (i) building a classifier and tuning its…

Machine Learning · Computer Science 2023-05-18 Isel Grau , Gonzalo Nápoles , Fabian Hoitsma , Lisa Koutsoviti Koumeri , Koen Vanhoof

Data from discovery proteomic and phosphoproteomic experiments typically include missing values that correspond to proteins that have not been identified in the analyzed sample. Replacing the missing values with random numbers, a process…

Quantitative Methods · Quantitative Biology 2019-10-01 Matus Medo , Daniel M. Aebersold , Michaela Medova

Due to the cost or interference of measurement, we need to control measurement system. Assuming that each variable can be measured sequentially, there exists optimal policy choosing next measurement for the former observations. Though…

Machine Learning · Computer Science 2022-04-11 Seongwook Yoon , Jaehyun Kim , Heejeong Lim , Sanghoon Sull

In this paper, we present a new feature selection method that is suitable for both unsupervised and supervised problems. We build upon the recently proposed Infinite Feature Selection (IFS) method where feature subsets of all sizes…

Machine Learning · Computer Science 2017-08-22 Sadegh Eskandari , Emre Akbas

Sensor data streams occur widely in various real-time applications in the context of the Internet of Things (IoT). However, sensor data streams feature missing values due to factors such as sensor failures, communication errors, or depleted…

Databases · Computer Science 2023-11-15 Xiao Li , Huan Li , Hua Lu , Christian S. Jensen , Varun Pandey , Volker Markl

Feature selection is playing an increasingly significant role with respect to many computer vision applications spanning from object recognition to visual object tracking. However, most of the recent solutions in feature selection are not…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Giorgio Roffo , Simone Melzi , Umberto Castellani , Alessandro Vinciarelli

Weather data collected from automated weather stations have become a crucial component for making decisions in agriculture and in forestry. Over time, weather stations may become out-of-order or stopped for maintenance, and therefore,…

Applications · Statistics 2019-10-22 Fadoua Rafii , Tahar Kechadi

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and…

Machine Learning · Computer Science 2025-01-23 Tuan L. Vo , Thu Nguyen , Luis M. Lopez-Ramos , Hugo L. Hammer , Michael A. Riegler , Pal Halvorsen

Although multi-view unsupervised feature selection (MUFS) is an effective technology for reducing dimensionality in machine learning, existing methods cannot directly deal with incomplete multi-view data where some samples are missing in…

Machine Learning · Computer Science 2024-01-22 Yanyong Huang , Zongxin Shen , Tianrui Li , Fengmao Lv

In the last couple of decades, there has been major advancements in the domain of missing data imputation. The techniques in the domain include amongst others: Expectation Maximization, Neural Networks with Evolutionary Algorithms or…

Neural and Evolutionary Computing · Computer Science 2015-12-07 Collins Leke , Tshilidzi Marwala , Satyakama Paul

The matrix completion problem aims to reconstruct a low-rank matrix based on a revealed set of possibly noisy entries. Prior works consider completing the entire matrix with generalization error guarantees. However, the completion accuracy…

Machine Learning · Computer Science 2023-12-19 Elad Hazan , Adam Tauman Kalai , Varun Kanade , Clara Mohri , Y. Jennifer Sun

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Feature-based format is the main data representation format used by machine learning algorithms. When the features do not properly describe the initial data, performance starts to degrade. Some algorithms address this problem by internally…

Artificial Intelligence · Computer Science 2015-12-18 Marian-Andrei Rizoiu , Julien Velcin , Stéphane Lallich

Healthcare time series data is vital for monitoring patient activity but often contains noise and missing values due to various reasons such as sensor errors or data interruptions. Imputation, i.e., filling in the missing values, is a…

Machine Learning · Computer Science 2024-12-17 Lien P. Le , Xuan-Hien Nguyen Thi , Thu Nguyen , Michael A. Riegler , Pål Halvorsen , Binh T. Nguyen