English
Related papers

Related papers: TACTiS-2: Better, Faster, Simpler Attentional Copu…

200 papers

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

Bi-factor and second-order models based on copulas are proposed for item response data, where the items can be split into non-overlapping groups such that there is a homogeneous dependence within each group. Our general models include the…

Methodology · Statistics 2021-02-23 Sayed H. Kadhem , Aristidis K. Nikoloulopoulos

Predicting the dependencies between observations from multiple time series is critical for applications such as anomaly detection, financial risk management, causal analysis, or demand forecasting. However, the computational and numerical…

Machine Learning · Computer Science 2019-10-28 David Salinas , Michael Bohlke-Schneider , Laurent Callot , Roberto Medico , Jan Gasthaus

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

We propose a new copula model that can be used with replicated spatial data. Unlike the multivariate normal copula, the proposed copula is based on the assumption that a common factor exists and affects the joint dependence of all…

Applications · Statistics 2016-12-08 Pavel Krupskii , Raphael Huser , Marc G. Genton

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

This paper provides a simple, yet reliable, alternative to the (Bayesian) estimation of large multivariate VARs with time variation in the conditional mean equations and/or in the covariance structure. With our new methodology, the original…

Econometrics · Economics 2020-01-01 Mike Tsionas , Marwan Izzeldin , Lorenzo Trapani

Transformers have achieved state-of-the-art results across a range of domains, but their quadratic attention mechanism poses significant challenges for long-sequence modelling. Recent efforts to design linear-time attention mechanisms have…

Computation and Language · Computer Science 2025-12-03 Rares Dolga , Lucas Maystre , Marius Cobzarenco , David Barber

Standard attention mechanisms in transformers employ static token representations that remain unchanged across all pair-wise computations in each layer. This limits their representational alignment with the potentially diverse relational…

Machine Learning · Computer Science 2026-05-26 Hunjae Lee , Corey Clark

Multivariate time series data, collected across various fields such as manufacturing and wearable technology, exhibit states at multiple levels of granularity, from coarse-grained system behaviors to fine-grained, detailed events.…

Machine Learning · Computer Science 2025-08-15 Ching Chang , Ming-Chih Lo , Wen-Chih Peng , Tien-Fu Chen

Temporal action segmentation (TAS) aims to classify and locate actions in the long untrimmed action sequence. With the success of deep learning, many deep models for action segmentation have emerged. However, few-shot TAS is still a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Leiyang Xu , Qiang Wang , Xiaotian Lin , Lin Yuan

Temporal network link prediction is an important task in the field of network science, and has a wide range of applications in practical scenarios. Revealing the evolutionary mechanism of the network is essential for link prediction, and…

Social and Information Networks · Computer Science 2022-06-22 Ruizhi Zhang , Qiaozi Wang , Qiming Yang , Wei Wei

We develop a general variational inference method that preserves dependency among the latent variables. Our method uses copulas to augment the families of distributions used in mean-field and structured approximations. Copulas model the…

Machine Learning · Statistics 2015-11-03 Dustin Tran , David M. Blei , Edoardo M. Airoldi

Multivariate time series analysis is becoming an integral part of data analysis pipelines. Understanding the individual time point connections between covariates as well as how these connections change in time is non-trivial. To this aim,…

Machine Learning · Statistics 2021-02-04 Federico Ciech , Veronica Tozzo

The forecasting of irregular multivariate time series (IMTS) is crucial in key areas such as healthcare, biomechanics, climate science, and astronomy. However, achieving accurate and practical predictions is challenging due to two main…

Machine Learning · Computer Science 2025-11-18 Xvyuan Liu , Xiangfei Qiu , Xingjian Wu , Zhengyu Li , Chenjuan Guo , Jilin Hu , Bin Yang

We assume that we have multiple ordinal time series and we would like to specify their joint distribution. In general it is difficult to create multivariate distribution that can be easily used to jointly model ordinal variables and the…

Methodology · Statistics 2026-02-16 Anna Nalpantidi , Dimitris Karlis

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility…

Machine Learning · Statistics 2021-11-11 Tim Janke , Mohamed Ghanmi , Florian Steinke

A thorough understanding of the interaction between the target agent and surrounding agents is a prerequisite for accurate trajectory prediction. Although many methods have been explored, they assign correlation coefficients to surrounding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiji Huang , Lei Ye , Min Chen , Wenhai Luo , Dihong Wang , Chenqi Xu , Deyuan Liang

Time-series forecasting finds broad applications in real-world scenarios. Due to the dynamic nature of time series data, it is important for time-series forecasting models to handle potential distribution shifts over time. In this paper, we…

Machine Learning · Computer Science 2026-03-26 Zhiyuan Zhao , Haoxin Liu , B. Aditya Prakash