English
Related papers

Related papers: Uncertainty-Aware Deep Attention Recurrent Neural …

200 papers

The self-attention mechanism has emerged as a critical component for improving the performance of various backbone neural networks. However, current mainstream approaches individually incorporate newly designed self-attention modules (SAMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhongzhan Huang , Senwei Liang , Mingfu Liang , Liang Lin

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Analyzing the health status of patients based on Electronic Health Records (EHR) is a fundamental research problem in medical informatics. The presence of extensive missing values in EHR makes it challenging for deep neural networks (DNNs)…

Machine Learning · Computer Science 2025-03-14 Weibin Liao , Yinghao Zhu , Zhongji Zhang , Yuhang Wang , Zixiang Wang , Xu Chu , Yasha Wang , Liantao Ma

Missing values are pervasive in large-scale time-series data, posing challenges for reliable analysis and decision-making. Many neural architectures have been designed to model and impute the complex and heterogeneous missingness patterns…

Machine Learning · Computer Science 2026-02-26 Joseph Arul Raj , Linglong Qian , Zina Ibrahim

Multiple regression has been the go-to method for data analysis for generations of scholars due to its transparency, interpretability, and desirable theoretical properties. However, the method's simplicity precludes the discovery of complex…

Machine Learning · Statistics 2021-02-02 Marc Ratkovic , Dustin Tingley

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach,…

Machine Learning · Statistics 2026-01-09 James Rice

Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc. Missing values are widely observed in these…

Machine Learning · Computer Science 2024-10-11 Zhixian Wang , Linxiao Yang , Liang Sun , Qingsong Wen , Yi Wang

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical…

Machine Learning · Statistics 2020-02-21 Vincent Fortuin , Dmitry Baranchuk , Gunnar Rätsch , Stephan Mandt

Time series imputation remains a significant challenge across many fields due to the potentially significant variability in the type of data being modelled. Whilst traditional imputation methods often impose strong assumptions on the…

Machine Learning · Statistics 2023-07-04 Tom Bamford , Elizabeth Fons , Yousef El-Laham , Svitlana Vyetrenko

To model time series accurately is important within a wide range of fields. As the world is generally too complex to be modelled exactly, it is often meaningful to assess the probability of a dynamical system to be in a specific state. This…

Machine Learning · Computer Science 2023-03-16 Mari Dahl Eggen , Alise Danielle Midtfjord

In long-term deployments of sensor networks, monitoring the quality of gathered data is a critical issue. Over the time of deployment, sensors are exposed to harsh conditions, causing some of them to fail or to deliver less accurate data.…

Neural and Evolutionary Computing · Computer Science 2009-12-05 Oliver Obst

Missing value imputation is a fundamental problem in spatiotemporal modeling, from motion tracking to the dynamics of physical systems. Deep autoregressive models suffer from error propagation which becomes catastrophic for imputing…

Machine Learning · Computer Science 2019-10-30 Yukai Liu , Rose Yu , Stephan Zheng , Eric Zhan , Yisong Yue

Counterfactual prediction is about predicting outcome of the unobserved situation from the data. For example, given patient is on drug A, what would be the outcome if she switch to drug B. Most of existing works focus on modeling…

Machine Learning · Computer Science 2020-10-29 Yanbo Xu , Cao Xiao , Jimeng Sun

The estimation of treatment effects is a pervasive problem in medicine. Existing methods for estimating treatment effects from longitudinal observational data assume that there are no hidden confounders, an assumption that is not testable…

Machine Learning · Computer Science 2020-09-21 Ioana Bica , Ahmed M. Alaa , Mihaela van der Schaar

Healthcare data frequently contain a substantial proportion of missing values, necessitating effective time series imputation to support downstream disease diagnosis tasks. However, existing imputation methods focus on discrete data points…

Machine Learning · Computer Science 2025-05-19 Mengxuan Li , Ke Liu , Jialong Guo , Jiajun Bu , Hongwei Wang , Haishuai Wang

Missing data is a significant problem impacting all domains. State-of-the-art framework for minimizing missing data bias is multiple imputation, for which the choice of an imputation model remains nontrivial. We propose a multiple…

Machine Learning · Computer Science 2018-02-20 Lovedeep Gondara , Ke Wang

Recurrent neural network based solutions are increasingly being used in the analysis of longitudinal Electronic Health Record data. However, most works focus on prediction accuracy and neglect prediction uncertainty. We propose Deep Kernel…

Machine Learning · Computer Science 2021-07-27 Zhiliang Wu , Yinchong Yang , Peter A. Fasching , Volker Tresp

Urban time series, such as mobility flows, energy consumption, and pollution records, encapsulate complex urban dynamics and structures. However, data collection in each city is impeded by technical challenges such as budget limitations and…

Machine Learning · Computer Science 2025-11-26 Tong Nie , Wei Ma , Jian Sun , Yu Yang , Jiannong Cao

Sensitivity analyses reveal the influence of various modeling choices on the outcomes of statistical analyses. While theoretically appealing, they are overwhelmingly inefficient for complex Bayesian models. In this work, we propose…

Missing data in time series is a pervasive problem that puts obstacles in the way of advanced analysis. A popular solution is imputation, where the fundamental challenge is to determine what values should be filled in. This paper proposes…

Machine Learning · Computer Science 2023-07-06 Wenjie Du , David Cote , Yan Liu