English
Related papers

Related papers: Autoregressive Score Matching

200 papers

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

Accurate prediction of outcomes is crucial for clinical decision-making and personalized patient care. Supervised machine learning algorithms, which are commonly used for outcome prediction in the medical domain, optimize for predictive…

Machine Learning · Computer Science 2026-02-09 Nithya Bhasker , Fiona R. Kolbinger , Susu Hu , Gitta Kutyniok , Stefanie Speidel

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion…

Machine Learning · Computer Science 2021-07-09 Kashif Rasul , Calvin Seward , Ingmar Schuster , Roland Vollgraf

In Diffusion Probabilistic Models (DPMs), the task of modeling the score evolution via a single time-dependent neural network necessitates extended training periods and may potentially impede modeling flexibility and capacity. To counteract…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

In many practical applications of machine learning, a discrepancy often arises between a source distribution from which labeled training examples are drawn and a target distribution for which only unlabeled data is observed. Traditionally,…

Machine Learning · Statistics 2025-03-05 Paweł Teisseyre , Jan Mielniczuk

Covariate-adaptive randomization (CAR) procedures are frequently used in comparative studies to increase the covariate balance across treatment groups. However, because randomization inevitably uses the covariate information when forming…

Statistics Theory · Mathematics 2022-07-08 Wei Ma , Yichen Qin , Yang Li , Feifang Hu

In this paper, we introduce an algebraic method to construct stable and consistent univariate autoregressive (AR) models of low order for filtering and predicting nonlinear turbulent signals with memory depth. By stable, we refer to the…

Methodology · Statistics 2014-12-19 John Harlim , Hoon Hong , Jacob L. Robbins

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing…

Machine Learning · Computer Science 2025-05-30 Yixin Ren , Chenghou Jin , Yewei Xia , Li Ke , Longtao Huang , Hui Xue , Hao Zhang , Jihong Guan , Shuigeng Zhou

Estimating the score, i.e., the gradient of log density function, from a set of samples generated by an unknown distribution is a fundamental task in inference and learning of probabilistic models that involve flexible yet intractable…

Machine Learning · Statistics 2020-07-01 Yuhao Zhou , Jiaxin Shi , Jun Zhu

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

In this paper, we consider a model called CHARME (Conditional Heteroscedastic Autoregressive Mixture of Experts), a class of generalized mixture of nonlinear nonparametric AR-ARCH time series. Under certain Lipschitz-type conditions on the…

Machine Learning · Statistics 2020-11-18 José G. Gómez García , Jalal Fadili , Christophe Chesneau

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

Score-based generative models (SGMs) are generative models that are in the spotlight these days. Time-series frequently occurs in our daily life, e.g., stock data, climate data, and so on. Especially, time-series forecasting and…

Machine Learning · Computer Science 2023-01-23 Haksoo Lim , Minjung Kim , Sewon Park , Noseong Park

Douglas-Rachford splitting and its equivalent dual formulation ADMM are widely used iterative methods in composite optimization problems arising in control and machine learning applications. The performance of these algorithms depends on…

Optimization and Control · Mathematics 2019-06-28 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

We develop a new classification framework based on the theory of coherent risk measures and systemic risk. The proposed approach is suitable for multi-class problems when the data is noisy, scarce (relative to the dimension of the problem),…

Machine Learning · Statistics 2026-05-29 Darinka Dentcheva , Xiangyu Tian

With the rapid advancements in technology for data collection, the application of the spatial autoregressive (SAR) model has become increasingly prevalent in real-world analysis, particularly when dealing with large datasets. However, the…

Econometrics · Economics 2025-05-05 Xuan Liang , Tao Zou

Recent advances in cross-prompt automated essay scoring (AES) typically train models jointly on all source prompts, often requiring additional access to unlabeled target prompt essays simultaneously. However, using all sources is suboptimal…

Computation and Language · Computer Science 2025-05-27 Sanwoo Lee , Kun Liang , Yunfang Wu

The stochastic reaction network in which chemical species evolve through a set of reactions is widely used to model stochastic processes in physics, chemistry and biology. To characterize the evolving joint probability distribution in the…

Molecular Networks · Quantitative Biology 2023-02-08 Ying Tang , Jiayu Weng , Pan Zhang

Sampling is ubiquitous in machine learning methodologies. Due to the growth of large datasets and model complexity, we want to learn and adapt the sampling process while training a representation. Towards achieving this grand goal, a…

Machine Learning · Computer Science 2022-12-14 Jason Xiaotian Dou , Alvin Qingkai Pan , Runxue Bao , Haiyi Harry Mao , Lei Luo , Zhi-Hong Mao