English
Related papers

Related papers: ReMasker: Imputing Tabular Data with Masked Autoen…

200 papers

Tabular data learning has extensive applications in deep learning but its existing embedding techniques are limited in numerical and categorical features such as the inability to capture complex relationships and engineering. This paper…

Machine Learning · Computer Science 2024-09-02 Yuqian Wu , Hengyi Luo , Raymond S. T. Lee

Multimodal incremental learning needs to digest the information from multiple modalities while concurrently learning new knowledge without forgetting the previously learned information. There are numerous challenges for this task, mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yi-Lun Lee , Chen-Yu Lee , Wei-Chen Chiu , Yi-Hsuan Tsai

Often in real-world datasets, especially in high dimensional data, some feature values are missing. Since most data analysis and statistical methods do not handle gracefully missing values, the first step in the analysis requires the…

Machine Learning · Statistics 2016-12-08 Yehezkel S. Resheff , Daphna Weinshall

Available data in machine learning applications is becoming increasingly complex, due to higher dimensionality and difficult classes. There exists a wide variety of approaches to measuring complexity of labeled data, according to class…

Machine Learning · Computer Science 2021-11-12 David Charte , Francisco Charte , Francisco Herrera

Many techniques for handling missing data have been proposed in the literature. Most of these techniques are overly complex. This paper explores an imputation technique based on rough set computations. In this paper, characteristic…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Fulufhelo Vincent Nelwamondo , Tshilidzi Marwala

In causal matching designs, some control subjects are often left unmatched, and some covariates are often left unmodeled. This article introduces "rebar," a method using high-dimensional modeling to incorporate these commonly discarded data…

Methodology · Statistics 2018-02-26 Adam C Sales , Ben B Hansen , Brian Rowan

Missing data is a fundamental challenge in data science, significantly hindering analysis and decision-making across a wide range of disciplines, including healthcare, bioinformatics, social science, e-commerce, and industrial monitoring.…

Machine Learning · Statistics 2026-05-12 Jicong Fan

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

Recent research shows that in-context learning (ICL) can be effective even when demonstrations have missing or incorrect labels. To shed light on this capability, we examine a canonical setting where the demonstrations are drawn according…

Machine Learning · Computer Science 2026-01-27 Yingcong Li , Xiangyu Chang , Muti Kara , Xiaofeng Liu , Amit Roy-Chowdhury , Samet Oymak

Missing values are a major challenge in most data science projects working on real data. To avoid losing valuable information, imputation methods are used to fill in missing values with estimates, allowing the preservation of samples or…

Machine Learning · Computer Science 2024-07-17 Pedro Pons-Suñer , Laura Arnal , J. Ramón Navarro-Cerdán , François Signol

Masked Image Modeling (MIM) has achieved impressive representative performance with the aim of reconstructing randomly masked images. Despite the empirical success, most previous works have neglected the important fact that it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junde Xu , Zikai Lin , Donghao Zhou , Yaodong Yang , Xiangyun Liao , Bian Wu , Guangyong Chen , Pheng-Ann Heng

Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taekyung Kim , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

Traditional econometric analyzes represent observations as vectors despite the inherent complexity of empirical data structures. When data are organized along dual classification dimensions, a matrix representation provides a more natural…

Econometrics · Economics 2026-04-02 Emanuele Lopetuso , Massimiliano Caporin

Various problems in data analysis and statistical genetics call for recovery of a column-sparse, low-rank matrix from noisy observations. We propose ReFACTor, a simple variation of the classical Truncated Singular Value Decomposition (TSVD)…

Machine Learning · Statistics 2017-05-23 Matan Gavish , Regev Schweiger , Elior Rahmani , Eran Halperin

Heterogeneous but complementary sources of data provide an unprecedented opportunity for developing accurate statistical models of systems. Although the existing methods have shown promising results, they are mostly applicable to situations…

Applications · Statistics 2020-08-18 Feng Wang , Mostafa Reisi Gahrooei , Zhen Zhong , Tao Tang , Jianjun Shi

Data augmentation is an effective technique for improving the performance of machine learning models. However, it has not been explored as extensively in natural language processing (NLP) as it has in computer vision. In this paper, we…

Computation and Language · Computer Science 2024-01-04 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

Self-supervision is often used for pre-training to foster performance on a downstream task by constructing meaningful representations of samples. Self-supervised learning (SSL) generally involves generating different views of the same…

Machine Learning · Computer Science 2025-05-06 Hugo Thimonier , José Lucas De Melo Costa , Fabrice Popineau , Arpad Rimmel , Bich-Liên Doan

Graph clustering algorithms with autoencoder structures have recently gained popularity due to their efficient performance and low training cost. However, for existing graph autoencoder clustering algorithms based on GCN or GAT, not only do…

Machine Learning · Computer Science 2024-01-11 Yuanchi Ma , Hui He , Zhongxiang Lei , Zhendong Niu

In many machine learning applications, we are faced with incomplete datasets. In the literature, missing data imputation techniques have been mostly concerned with filling missing values. However, the existence of missing values is…

Machine Learning · Computer Science 2020-09-07 Mohammad Kachuee , Kimmo Karkkainen , Orpaz Goldstein , Sajad Darabi , Majid Sarrafzadeh

Tabular data is a fundamental form of data structure. The evolution of table analysis tools reflects humanity's continuous progress in data acquisition, management, and processing. The dynamic changes in table columns arise from…

Artificial Intelligence · Computer Science 2026-01-28 Xinda Chen , Zhen Xing , Hanyu Zhang , Weimin Tan , Bo Yan