English
Related papers

Related papers: HGTS-Former: Hierarchical HyperGraph Transformer f…

200 papers

The Transformer model has shown strong performance in multivariate time series forecasting by leveraging channel-wise self-attention. However, this approach lacks temporal constraints when computing temporal features and does not utilize…

Machine Learning · Computer Science 2025-05-06 Shiwei Guo , Ziang Chen , Yupeng Ma , Yunfei Han , Yi Wang

Time-varying group interactions constitute the building blocks of many complex systems. The framework of temporal hypergraphs makes it possible to represent them by taking into account the higher-order and temporal nature of the…

Physics and Society · Physics 2025-11-11 Marco Mancastroppa , Giulia Cencetti , Alain Barrat

Astronomical surveys produce time-series data by observing stellar objects across multiple wavelength bands. Foundational transformer-based models, such as Astromer, encode each time-series as a sequence of embeddings of uniform dimensions.…

Instrumentation and Methods for Astrophysics · Physics 2025-06-16 Gabriel Chiong , Ignacio Becker , Pavlos Protopapas

Hypergraphs are a generalized data structure of graphs to model higher-order correlations among entities, which have been successfully adopted into various research domains. Meanwhile, HyperGraph Neural Network (HGNN) is currently the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Jing Huang , Xiaolin Huang , Jie Yang

Deep learning (DL) approaches are being increasingly used for time-series forecasting, with many efforts devoted to designing complex DL models. Recent studies have shown that the DL success is often attributed to effective data…

Human-Computer Interaction · Computer Science 2023-07-28 Jianing Hao , Qing Shi , Yilin Ye , Wei Zeng

It is imperative to discern the relationships between multiple time series for accurate forecasting. In particular, for stock prices, components are often divided into groups with the same characteristics, and a model that extracts…

Machine Learning · Computer Science 2023-05-16 Ryo Umagami , Yu Ono , Yusuke Mukuta , Tatsuya Harada

Although spatio-temporal graph neural networks have achieved great empirical success in handling multiple correlated time series, they may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.…

Signal Processing · Electrical Eng. & Systems 2021-02-10 Chao Pan , Siheng Chen , Antonio Ortega

In this paper, we set up the theoretical foundations for a high-dimensional functional factor model approach in the analysis of large cross-sections (panels) of functional time series (FTS). We first establish a representation result…

Statistics Theory · Mathematics 2021-04-14 Shahin Tavakoli , Gilles Nisol , Marc Hallin

Transformers have achieved superior performances in many tasks in natural language processing and computer vision, which also triggered great interest in the time series community. Among multiple advantages of Transformers, the ability to…

Machine Learning · Computer Science 2023-05-15 Qingsong Wen , Tian Zhou , Chaoli Zhang , Weiqi Chen , Ziqing Ma , Junchi Yan , Liang Sun

Current semantic segmentation models have achieved great success under the independent and identically distributed (i.i.d.) condition. However, in real-world applications, test data might come from a different domain than training data.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jian Ding , Nan Xue , Gui-Song Xia , Bernt Schiele , Dengxin Dai

Multivariate time series (MTS) forecasting is an essential problem in many fields. Accurate forecasting results can effectively help decision-making. To date, many MTS forecasting methods have been proposed and widely applied. However,…

Machine Learning · Computer Science 2021-12-16 Ziheng Duan , Haoyan Xu , Yida Huang , Jie Feng , Yueyang Wang

Predicting metro passenger flow precisely is of great importance for dynamic traffic planning. Deep learning algorithms have been widely applied due to their robust performance in modelling non-linear systems. However, traditional deep…

Machine Learning · Computer Science 2022-11-10 Yuyang Miao , Yao Xu , Danilo Mandic

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Multivariate time series (MTS) anomaly detection commonly encounters in various domains like finance, healthcare, and industrial monitoring. However, existing MTS anomaly detection methods are mostly defined on the static graph structure,…

Machine Learning · Computer Science 2025-09-23 Jia Li , Shiyu Long , Ye Yuan

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Hyperspectral (HS) images are characterized by approximately contiguous spectral information, enabling the fine identification of materials by capturing subtle spectral discrepancies. Owing to their excellent locally contextual modeling…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Danfeng Hong , Zhu Han , Jing Yao , Lianru Gao , Bing Zhang , Antonio Plaza , Jocelyn Chanussot

Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengthening the…

Machine Learning · Computer Science 2026-01-09 Yun Young Choi , Sun Woo Park , Minho Lee , Youngho Woo

This work addresses the problem of analyzing multi-channel time series data %. In this paper, we by proposing an unsupervised fusion framework based on %the recently proposed convolutional transform learning. Each channel is processed by a…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Self-supervised representation learning of Multivariate Time Series (MTS) is a challenging task and attracts increasing research interests in recent years. Many previous works focus on the pretext task of self-supervised learning and…

Machine Learning · Computer Science 2022-03-10 Yijiang Chen , Xiangdong Zhou , Zhen Xing , Zhidan Liu , Minyang Xu

Industrial large-scale recommendation models (LRMs) face the challenge of jointly modeling long-range user behavior sequences and heterogeneous non-sequential features under strict efficiency constraints. However, most existing…

Information Retrieval · Computer Science 2026-01-26 Yunwen Huang , Shiyong Hong , Xijun Xiao , Jinqiu Jin , Xuanyuan Luo , Zhe Wang , Zheng Chai , Shikang Wu , Yuchao Zheng , Jingjian Lin