English
Related papers

Related papers: HiPerformer: Hierarchically Permutation-Equivarian…

200 papers

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines…

Machine Learning · Computer Science 2024-05-24 Noam Koren , Kira Radinsky

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at…

Machine Learning · Computer Science 2026-05-22 Kushagra Pandey , Farrin Marouf Sofian , Jan Niklas Groeneveld , Felix Draxler , Stephan Mandt

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

Machine Learning · Computer Science 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

In the transformative landscape of smart cities, the integration of the cutting-edge web technologies into time series forecasting presents a pivotal opportunity to enhance urban planning, sustainability, and economic growth. The…

Machine Learning · Computer Science 2024-05-10 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

For statistical analysis of multiway contingency tables we propose modeling interaction terms in each maximal compact component of a hierarchical model. By this approach we can search for parsimonious models with smaller degrees of freedom…

Statistics Theory · Mathematics 2011-08-23 Hisayuki Hara , Tomonari Sei , Akimichi Takemura

We present group equivariant capsule networks, a framework to introduce guaranteed equivariance and invariance properties to the capsule network idea. Our work can be divided into two contributions. First, we present a generic routing by…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Jan Eric Lenssen , Matthias Fey , Pascal Libuschewski

Time series forecasting plays a crucial role in various applications, particularly in healthcare, where accurate predictions of future health trajectories can significantly impact clinical decision-making. Ensuring transparency and…

Machine Learning · Computer Science 2025-05-22 Jeremy Qin

This paper presents a novel approach to electricity price forecasting (EPF) using a pure Transformer model. As opposed to other alternatives, no other recurrent network is used in combination to the attention mechanism. Hence, showing that…

Machine Learning · Computer Science 2025-09-11 Oscar Llorente , Jose Portela

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

Many studies record replicated time series epochs from different groups with the goal of using frequency domain properties to discriminate between the groups. In many applications, there exists variation in cyclical patterns from time…

Methodology · Statistics 2017-01-19 Robert T. Krafty

Accurate trajectory forecasting is crucial for the performance of various systems, such as advanced driver-assistance systems and self-driving vehicles. These forecasts allow us to anticipate events that lead to collisions and, therefore,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Adrien Lafage , Mathieu Barbier , Gianni Franchi , David Filliat

Demystifying interactions between temporal patterns of different scales is fundamental to precise long-range time series forecasting. However, previous works lack the ability to model high-order interactions. To promote more comprehensive…

Machine Learning · Computer Science 2024-12-24 Zongjiang Shang , Ling Chen , Binqing Wu , Dongliang Cui

Deep learning utilizing transformers has recently achieved a lot of success in many vital areas such as natural language processing, computer vision, anomaly detection, and recommendation systems, among many others. Among several merits of…

Machine Learning · Computer Science 2023-12-05 Lena Sasal , Tanujit Chakraborty , Abdenour Hadid

Multivariate long-term time series forecasting aims to predict future sequences by utilizing historical observations, with a core focus on modeling intra-sequence and cross-channel dependencies. Numerous studies have developed diverse…

Machine Learning · Computer Science 2026-02-03 Gaoxiang Zhao , Chunmao Huang , Li Zhou , Xiaoqiang Wang

In e-commerce system, category prediction is to automatically predict categories of given texts. Different from traditional classification where there are no relations between classes, category prediction is reckoned as a standard…

Information Retrieval · Computer Science 2020-05-15 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

Methodology · Statistics 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Seasonal time series Forecasting remains a challenging problem due to the long-term dependency from seasonality. In this paper, we propose a two-stage framework to forecast univariate seasonal time series. The first stage explicitly learns…

Machine Learning · Computer Science 2021-06-08 Qingyang Xu , Qingsong Wen , Liang Sun

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

Machine Learning · Computer Science 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati