English
Related papers

Related papers: SAITS: Self-Attention-based Imputation for Time Se…

200 papers

Most datasets suffer from partial or complete missing values, which has downstream limitations on the available models on which to test the data and on any statistical inferences that can be made from the data. Several imputation techniques…

Machine Learning · Statistics 2023-02-09 Adrienne Kline , Yuan Luo

Identifying causal interactions in complex dynamical systems is a fundamental challenge across the computational sciences. Existing functional connectivity methods capture correlations but not causation. While addressing directionality,…

Neurons and Cognition · Quantitative Biology 2026-03-10 Rahul Biswas , SuryaNarayana Sripada , Somabha Mukherjee , Reza Abbasi-Asl

This paper considers the problem of learning temporal task specifications, e.g. automata and temporal logic, from expert demonstrations. Task specifications are a class of sparse memory augmented rewards with explicit support for temporal…

Artificial Intelligence · Computer Science 2023-04-25 Marcell Vazquez-Chanlatte , Ameesh Shah , Gil Lederman , Sanjit A. Seshia

We propose an algorithm to impute and forecast a time series by transforming the observed time series into a matrix, utilizing matrix estimation to recover missing values and de-noise observed entries, and performing linear regression to…

Machine Learning · Computer Science 2019-04-29 Anish Agarwal , Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

Multivariate time series data for real-world applications typically contain a significant amount of missing values. The dominant approach for classification with such missing values is to impute them heuristically with specific values…

Machine Learning · Computer Science 2023-08-15 SeungHyun Kim , Hyunsu Kim , EungGu Yun , Hwangrae Lee , Jaehun Lee , Juho Lee

We present a simple yet novel time series imputation technique with the goal of constructing an irregular time series that is uniform across every sample in a data set. Specifically, we fix a grid defined by the midpoints of non-overlapping…

Machine Learning · Computer Science 2022-01-19 Andrew Baumgartner , Sevda Molani , Qi Wei , Jennifer Hadlock

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Dynamical systems governed by ordinary differential equations (ODEs) serve as models for a vast number of natural and social phenomena. In this work, we offer a fresh perspective on the classical problem of imputing missing time series…

Machine Learning · Computer Science 2025-03-17 Patrick Seifner , Kostadin Cvejoski , Antonia Körner , Ramsés J. Sánchez

While the self-attention mechanism has been widely used in a wide variety of tasks, it has the unfortunate property of a quadratic cost with respect to the input length, which makes it difficult to deal with long inputs. In this paper, we…

Computation and Language · Computer Science 2020-09-30 Xiaoya Li , Yuxian Meng , Mingxin Zhou , Qinghong Han , Fei Wu , Jiwei Li

In many application settings, the data have missing entries which make analysis challenging. An abundant literature addresses missing values in an inferential framework: estimating parameters and their variance from incomplete tables. Here,…

Machine Learning · Statistics 2024-03-22 Julie Josse , Jacob M. Chen , Nicolas Prost , Erwan Scornet , Gaël Varoquaux

Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc. Missing values are widely observed in these…

Machine Learning · Computer Science 2024-10-11 Zhixian Wang , Linxiao Yang , Liang Sun , Qingsong Wen , Yi Wang

Handling missing data in time series classification remains a significant challenge in various domains. Traditional methods often rely on imputation, which may introduce bias or fail to capture the underlying temporal dynamics. In this…

Machine Learning · Computer Science 2026-04-03 YongKyung Oh , Dong-Young Lim , Sungil Kim , Alex Bui

Self-supervised learning achieves superior performance in many domains by extracting useful representations from the unlabeled data. However, most of traditional self-supervised methods mainly focus on exploring the inter-sample structure…

Machine Learning · Computer Science 2020-11-30 Haoyi Fan , Fengbin Zhang , Yue Gao

Irregular multivariate time series with missing values present significant challenges for predictive modeling in domains such as healthcare. While deep learning approaches often focus on temporal interpolation or complex architectures to…

Machine Learning · Computer Science 2026-03-16 Dingyi Nie , Yixing Wu , C. -C. Jay Kuo

Multivariate time series (MTS) data, when sampled irregularly and asynchronously, often present extensive missing values. Conventional methodologies for MTS analysis tend to rely on temporal embeddings based on timestamps that necessitate…

Machine Learning · Computer Science 2024-05-28 Chun-Kai Huang , Yi-Hsien Hsieh , Ta-Jung Chien , Li-Cheng Chien , Shao-Hua Sun , Tung-Hung Su , Jia-Horng Kao , Che Lin

Missing data imputation can help improve the performance of prediction models in situations where missing data hide useful information. This paper compares methods for imputing missing categorical data for supervised classification tasks.…

Machine Learning · Statistics 2020-08-11 Jason Poulos , Rafael Valle

The self-attention (SA) mechanism has demonstrated superior performance across various domains, yet it suffers from substantial complexity during both training and inference. The next-generation architecture, aiming at retaining the…

Machine Learning · Computer Science 2025-01-13 Guoxin Feng

Recent Vision Transformer~(ViT) models have demonstrated encouraging results across various computer vision tasks, thanks to their competence in modeling long-range dependencies of image patches or tokens via self-attention. These models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Sucheng Ren , Daquan Zhou , Shengfeng He , Jiashi Feng , Xinchao Wang

Multivariate time series (MTS) classification is widely applied in fields such as industry, healthcare, and finance, aiming to extract key features from complex time series data for accurate decision-making and prediction. However, existing…

Machine Learning · Computer Science 2025-06-19 Mingsen Du , Meng Chen , Yongjian Li , Cun Ji , Shoushui Wei

Missing data is a common concern in health datasets, and its impact on good decision-making processes is well documented. Our study's contribution is a methodology for tackling missing data problems using a combination of synthetic dataset…

Machine Learning · Computer Science 2022-11-08 Gift Khangamwa , Terence L. van Zyl , Clint J. van Alten
‹ Prev 1 3 4 5 6 7 10 Next ›