English
Related papers

Related papers: CINDI: Conditional Imputation and Noisy Data Integ…

200 papers

We introduce the Conditional Self-Attention Imputation (CSAI) model, a novel recurrent neural network architecture designed to address the challenges of complex missing data patterns in multivariate time series derived from hospital…

Machine Learning · Computer Science 2026-01-07 Linglong Qian , Joseph Arul Raj , Hugh Logan Ellis , Ao Zhang , Yuezhou Zhang , Tao Wang , Richard JB Dobson , Zina Ibrahim

Ensuring high-quality data is paramount for maximizing the performance of machine learning models and business intelligence systems. However, challenges in data quality, including noise in data capture, missing records, limited data…

Machine Learning · Computer Science 2024-05-30 Paulo Neves , Joerg K. Wegner , Philippe Schwaller

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

Fluid Dynamics · Physics 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai

Missing data can significantly hamper standard time series analysis, yet they occur frequently in applications. In this paper, we introduce temporal Wasserstein imputation, a novel method for imputing missing data in time series. Unlike…

Methodology · Statistics 2025-08-15 Shuo-Chieh Huang , Tengyuan Liang , Ruey S. Tsay

Physics-Informed Neural Networks (PINNs) are effective methods for solving inverse problems and discovering governing equations from observational data. However, their performance degrades significantly under complex measurement noise and…

Machine Learning · Computer Science 2026-02-04 Hankyeol Kim , Pilsung Kang

Real-world clinical time series data sets exhibit a high prevalence of missing values. Hence, there is an increasing interest in missing data imputation. Traditional statistical approaches impose constraints on the data-generating process…

Machine Learning · Computer Science 2020-01-13 Yang Guo , Zhengyuan Liu , Pavitra Krishnswamy , Savitha Ramasamy

Denoising Diffusion Probabilistic Model (DDPM) is able to make flexible conditional image generation from prior noise to real data, by introducing an independent noise-aware classifier to provide conditional gradient guidance at each time…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Shengming Li , Guangcong Zheng , Hui Wang , Taiping Yao , Yang Chen , Shoudong Ding , Xi Li

Uncertainty quantification in time series prediction is challenging due to the temporal dependence and distribution shift on sequential data. Conformal inference provides a pivotal and flexible instrument for assessing the uncertainty of…

Machine Learning · Statistics 2025-09-09 Junxi Wu , Dongjian Hu , Yajie Bao , Shu-Tao Xia , Changliang Zou

Cyber Threat Intelligence (CTI) sharing is an important activity to reduce information asymmetries between attackers and defenders. However, this activity presents challenges due to the tension between data sharing and confidentiality, that…

Complex systems are typically characterized by intricate internal dynamics that are often hard to elucidate. Ideally, this requires methods that allow to detect and classify in unsupervised way the microscopic dynamical events occurring in…

Data Analysis, Statistics and Probability · Physics 2024-11-26 Matteo Becchi , Federico Fantolino , Giovanni M. Pavan

This paper introduces KZImputer, a novel adaptive imputation method for univariate time series designed for short to medium-sized missed points (gaps) (1-5 points and beyond) with tailored strategies for segments at the start, middle, or…

Methodology · Statistics 2025-07-08 Sergii Kavun

Missingness is ubiquitous in multivariate time series and poses an obstacle to reliable downstream analysis. Although recurrent network imputation achieved the SOTA, existing models do not scale to deep architectures that can potentially…

Machine Learning · Computer Science 2024-01-05 Linglong Qian , Zina Ibrahim , Richard Dobson

We present CANOPI, a novel algorithmic framework, for solving the Contingency-Aware Nodal Power Investments problem, a large-scale nonlinear optimization problem that jointly optimizes investments in generation, storage, and transmission…

Optimization and Control · Mathematics 2026-04-10 Thomas Lee , Andy Sun

This paper introduces a new causal structure learning method for nonstationary time series data, a common data type found in fields such as finance, economics, healthcare, and environmental science. Our work builds upon the constraint-based…

Statistical Finance · Quantitative Finance 2024-06-10 Agathe Sadeghi , Achintya Gopal , Mohammad Fesanghary

Causal inference is a fundamental research topic for discovering the cause-effect relationships in many disciplines. However, not all algorithms are equally well-suited for a given dataset. For instance, some approaches may only be able to…

Machine Learning · Computer Science 2024-03-11 Zhipeng Ma , Marco Kemmerling , Daniel Buschmann , Chrismarie Enslin , Daniel Lütticke , Robert H. Schmitt

Time series data with missing values is common across many domains. Healthcare presents special challenges due to prolonged periods of sensor disconnection. In such cases, having a confidence measure for imputed values is critical. Most…

Machine Learning · Computer Science 2025-07-15 Addison Weatherhead , Anna Goldenberg

Discovering governing equations from observational data remains a fundamental challenge in scientific modeling, particularly when the underlying mathematical structure is unknown. Traditional sparse identification methods like SINDy excel…

Machine Learning · Computer Science 2026-05-12 Mohammad Amin Basiri , Charles Nicholson

Power grids increasingly need real-time situational awareness under the ever-evolving cyberthreat landscape. Advances in snapshot-based system identification approaches have enabled accurately estimating states and topology from a snapshot…

Systems and Control · Electrical Eng. & Systems 2025-10-17 Shimiao Li , Guannan Qu , Bryan Hooi , Vyas Sekar , Soummya Kar , Larry Pileggi

Recently, Hyperspectral Image (HSI) classification has attracted increasing attention in remote sensing. However, HSI data are inherently high-dimensional but low-rank, with discriminative information concentrated on a low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Boxiang Yang , Ning Chen , Xia Yue , Yichang Luo , Yingbo Fan , Haoyuan Zhang , Haoyu Ma , Jun Yue , Shanjun Mao

Incomplete data are common in real-world applications. Sensors fail, records are inconsistent, and datasets collected from different sources often differ in scale, sampling rate, and quality. These differences create missing values that…

Machine Learning · Computer Science 2025-12-08 Zalish Mahmud , Anantaa Kotal , Aritran Piplai