English
Related papers

Related papers: Invariant Subspace Decomposition

200 papers

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

Machine Learning · Computer Science 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

A new variational mode decomposition (VMD) based deep learning approach is proposed in this paper for time series forecasting problem. Firstly, VMD is adopted to decompose the original time series into several sub-signals. Then, a…

Machine Learning · Statistics 2020-02-25 Guowei Zhang , Tao Ren , Yifan Yang

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

Spatial processes with nonstationary and anisotropic covariance structure are often used when modelling, analysing and predicting complex environmental phenomena. Such processes may often be expressed as ones that have stationary and…

Methodology · Statistics 2020-04-06 Andrew Zammit-Mangion , Tin Lok James Ng , Quan Vu , Maurizio Filippone

Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the…

Machine Learning · Statistics 2018-09-18 Kean Ming Tan , Zhaoran Wang , Tong Zhang , Han Liu , R. Dennis Cook

The abundance of modern health data provides many opportunities for the use of machine learning techniques to build better statistical models to improve clinical decision making. Predicting time-to-event distributions, also known as…

Machine Learning · Statistics 2020-12-15 Zidi Xiu , Chenyang Tao , Benjamin A. Goldstein , Ricardo Henao

Modelling multivariate spatio-temporal data with complex dependency structures is a challenging task but can be simplified by assuming that the original variables are generated from independent latent components. If these components are…

Methodology · Statistics 2024-11-04 Mika Sipilä , Claudia Cappello , Sandra De Iaco , Klaus Nordhausen , Sara Taskinen

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

Due to effective pattern mining and feature representation, neural forecasting models based on deep learning have achieved great progress. The premise of effective learning is to collect sufficient data. However, in time series forecasting,…

Machine Learning · Computer Science 2023-07-04 Yan Gao , Yan Wang , Qiang Wang

Iterative imputation, in which variables are imputed one at a time each given a model predicting from all the others, is a popular technique that can be convenient and flexible, as it replaces a potentially difficult multivariate modeling…

Statistics Theory · Mathematics 2012-04-04 Jingchen Liu , Andrew Gelman , Jennifer Hill , Yu-Sung Su

One of the fundamental representation learning tasks is unsupervised sequential disentanglement, where latent codes of inputs are decomposed to a single static factor and a sequence of dynamic factors. To extract this latent information,…

Machine Learning · Computer Science 2025-10-09 Nimrod Berman , Ilan Naiman , Idan Arbiv , Gal Fadlon , Omri Azencot

Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, \ie…

Machine Learning · Computer Science 2025-10-21 Mingyuan Xia , Chunxu Zhang , Zijian Zhang , Hao Miao , Qidong Liu , Yuanshao Zhu , Bo Yang

The Stochastic Backscatter Model involves the generation of a set of random variables characterised by prescribed correlations in space and time. These variables are obtained by smoothing an initially uncorrelated random field, which…

Computational Physics · Physics 2025-11-12 Angelo Passariello

Symmetric positive definite~(SPD) matrices have shown important value and applications in statistics and machine learning, such as FMRI analysis and traffic prediction. Previous works on SPD matrices mostly focus on discriminative models,…

Machine Learning · Computer Science 2023-12-14 Yunchen Li , Zhou Yu , Gaoqi He , Yunhang Shen , Ke Li , Xing Sun , Shaohui Lin

In modeling spatial processes, a second-order stationarity assumption is often made. However, for spatial data observed on a vast domain, the covariance function often varies over space, leading to a heterogeneous spatial dependence…

Methodology · Statistics 2021-02-09 Ghulam A. Qadir , Ying Sun , Sebastian Kurtek

Understanding and predicting environmental phenomena often requires the construction of spatio-temporal statistical models, which are typically Gaussian processes. A common assumption made on Gaussian processes is that of covariance…

Methodology · Statistics 2023-03-17 Quan Vu , Andrew Zammit-Mangion , Stephen J. Chuter

The task of distribution generalization concerns making reliable prediction of a response in unseen environments. The structural causal models are shown to be useful to model distribution changes through intervention. Motivated by the…

Methodology · Statistics 2022-06-14 Kang Du , Yu Xiang

This work presents a complete geometrical characterisation of divisible and indivisible time-evolution at the level of probabilities for systems with two configurations, open or closed. Our new geometrical construction in the space of…

Quantum Physics · Physics 2025-05-14 Leandro Silva Pimenta