English
Related papers

Related papers: From Noise to Laws: Regularized Time-Series Foreca…

200 papers

Multivariate time series forecasting has long received significant attention in real-world applications, such as energy consumption and traffic prediction. While recent methods demonstrate good forecasting abilities, they have three…

Machine Learning · Computer Science 2022-11-24 Ming Jin , Yu Zheng , Yuan-Fang Li , Siheng Chen , Bin Yang , Shirui Pan

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

Learning complex physical dynamics purely from data is challenging due to the intrinsic properties of systems to be satisfied. Incorporating physics-informed priors, such as in Hamiltonian Neural Networks (HNNs), achieves high-precision…

Machine Learning · Computer Science 2024-10-10 Zijie Huang , Wanjia Zhao , Jingdong Gao , Ziniu Hu , Xiao Luo , Yadi Cao , Yuanzhou Chen , Yizhou Sun , Wei Wang

Multi-variate time series forecasting is an important problem with a wide range of applications. Recent works model the relations between time-series as graphs and have shown that propagating information over the relation graph can improve…

Machine Learning · Computer Science 2024-07-04 Harshavardhan Kamarthi , Lingkai Kong , Alexander Rodriguez , Chao Zhang , B Aditya Prakash

The proliferation of mobile devices generates a massive volume of time series across various domains, where effective time series forecasting enables a variety of real-world applications. This study focuses on a new problem of source-free…

Machine Learning · Computer Science 2025-11-03 Kangjia Yan , Chenxi Liu , Hao Miao , Xinle Wu , Yan Zhao , Chenjuan Guo , Bin Yang

Scene graphs have emerged as accurate descriptive priors for image generation and manipulation tasks, however, their complexity and diversity of the shapes and relations of objects in data make it challenging to incorporate them into the…

Machine Learning · Computer Science 2023-11-07 Pavel Jahoda , Azade Farshad , Yousef Yeganeh , Ehsan Adeli , Nassir Navab

Spatio-temporal graph neural networks (STGNN) have emerged as the dominant model for spatio-temporal graph (STG) forecasting. Despite their success, they fail to model intrinsic uncertainties within STG data, which cripples their…

Machine Learning · Computer Science 2024-03-12 Haomin Wen , Youfang Lin , Yutong Xia , Huaiyu Wan , Qingsong Wen , Roger Zimmermann , Yuxuan Liang

The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate…

Reversible Instance Normalization (RevIN) is a key technique enabling simple linear models to achieve state-of-the-art performance in time series forecasting. While replacing its non-robust statistics with robust counterparts (termed…

Machine Learning · Computer Science 2025-10-07 Fanzhe Fu , Yang Yang

Accurate, explainable and physically credible forecasting remains a persistent challenge for multivariate time-series whose statistical properties vary across domains. We propose DORIC, a Domain-Universal, ODE-Regularized,…

Machine Learning · Computer Science 2025-12-02 Hongwei Ma , Junbin Gao , Minh-Ngoc Tran

We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system.…

Machine Learning · Computer Science 2019-02-12 Moritz Hardt , Tengyu Ma , Benjamin Recht

Explicit noise-level conditioning is widely regarded as essential for the effective operation of Graph Diffusion Models (GDMs). In this work, we challenge this assumption by investigating whether denoisers can implicitly infer noise levels…

Machine Learning · Computer Science 2025-06-12 Jipeng Li , Yanning Shen

In this paper, we propose a unified framework of denoising score-based models in the context of graduated non-convex energy minimization. We show that for sufficiently large noise variance, the associated negative log density -- the energy…

Machine Learning · Computer Science 2023-02-22 Erich Kobler , Thomas Pock

This study presents PRISM, a probabilistic simplex component analysis approach to identifying the vertices of a data-circumscribing simplex from data. The problem has a rich variety of applications, the most notable being hyperspectral…

Signal Processing · Electrical Eng. & Systems 2022-02-16 Ruiyuan Wu , Wing-Kin Ma , Yuening Li , Anthony Man-Cho So , Nicholas D. Sidiropoulos

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

Denoising diffusion probabilistic models have been recently proposed to generate high-quality samples by estimating the gradient of the data density. The framework defines the prior noise as a standard Gaussian distribution, whereas the…

Machine Learning · Statistics 2022-02-22 Sang-gil Lee , Heeseung Kim , Chaehun Shin , Xu Tan , Chang Liu , Qi Meng , Tao Qin , Wei Chen , Sungroh Yoon , Tie-Yan Liu

We study a blind deconvolution problem on graphs, which arises in the context of localizing a few sources that diffuse over networks. While the observations are bilinear functions of the unknown graph filter coefficients and sparse input…

Signal Processing · Electrical Eng. & Systems 2024-09-19 Chang Ye , Gonzalo Mateos

We analyze gradient descent with randomly weighted data points in a linear regression model, under a generic weighting distribution. This includes various forms of stochastic gradient descent, importance sampling, but also extends to…

Machine Learning · Statistics 2025-12-12 Gabriel Clara , Yazan Mash'al

Time series forecasting models are becoming increasingly prevalent due to their critical role in decision-making across various domains. However, most existing approaches represent the coupled temporal patterns, often neglecting the…

Machine Learning · Computer Science 2025-09-26 Jintao Zhang , Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Daoyu Wang