English
Related papers

Related papers: DyGMamba: Efficiently Modeling Long-Term Temporal …

200 papers

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

State Space Models (SSMs), particularly Mamba, have shown potential in long-term time series forecasting. However, existing Mamba-based architectures often struggle with datasets characterized by non-stationary patterns. A key observation…

Machine Learning · Computer Science 2026-02-11 Ruxuan Chen , Fang Sun

In recent years, Dynamic Graph (DG) representations have been increasingly used for modeling dynamic systems due to their ability to integrate both topological and temporal information in a compact representation. Dynamic graphs allow to…

Machine Learning · Computer Science 2023-04-13 Leshanshui Yang , Sébastien Adam , Clément Chatelain

Generating realistic dyadic human motion from text descriptions presents significant challenges, particularly for extended interactions that exceed typical training sequence lengths. While recent transformer-based approaches have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Julian Tanke , Takashi Shibuya , Kengo Uchida , Koichi Saito , Yuki Mitsufuji

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

Machine Learning · Computer Science 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Temporal graph learning is pivotal for deciphering dynamic systems, where the core challenge lies in explicitly modeling the underlying evolving patterns that govern network transformation. However, prevailing methods are predominantly…

Machine Learning · Computer Science 2026-02-20 Yijun Ma , Zehong Wang , Weixiang Sun , Yanfang Ye

Directed graphs are ubiquitous across numerous domains, where the directionality of edges encodes critical causal dependencies. However, existing GNNs and graph Transformers tailored for directed graphs face two major challenges: (1)…

Machine Learning · Computer Science 2025-09-18 Junzhi She , Xunkai Li , Rong-Hua Li , Guoren Wang

EEG-based emotion recognition struggles with capturing multi-scale spatiotemporal dynamics and ensuring computational efficiency for real-time applications. Existing methods often oversimplify temporal granularity and spatial hierarchies,…

Signal Processing · Electrical Eng. & Systems 2025-07-23 Hanwen Liu , Yifeng Gong , Zuwei Yan , Zeheng Zhuang , Jiaxuan Lu

While dynamic graph neural networks have shown promise in various applications, explaining their predictions on continuous-time dynamic graphs (CTDGs) is difficult. This paper investigates a new research task: self-interpretable GNNs for…

Machine Learning · Computer Science 2024-05-30 Lanting Fang , Yulian Yang , Kai Wang , Shanshan Feng , Kaiyu Feng , Jie Gui , Shuliang Wang , Yew-Soon Ong

The Dynamical Graph Grammar (DGG) formalism can describe complex system dynamics with graphs that are mapped into a master equation. An exact stochastic simulation algorithm may be used, but it is slow for large systems. To overcome this…

Quantitative Methods · Quantitative Biology 2024-07-16 Eric Medwedeff , Eric Mjolsness

Graphs are ubiquitous in real-world applications, ranging from social networks to biological systems, and have inspired the development of Graph Neural Networks (GNNs) for learning expressive representations. While most research has…

Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baijiong Lin , Weisen Jiang , Pengguang Chen , Yu Zhang , Shu Liu , Ying-Cong Chen

Temporal interaction graphs (TIGs), defined by sequences of timestamped interaction events, have become ubiquitous in real-world applications due to their capability to model complex dynamic system behaviors. As a result, temporal…

Machine Learning · Computer Science 2025-12-19 Pengfei Jiao , Hongjiang Chen , Xuan Guo , Zhidong Zhao , Dongxiao He , Di Jin

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It…

Machine Learning · Computer Science 2024-12-20 Yiming Xu , Bin Shi , Teng Ma , Bo Dong , Haoyi Zhou , Qinghua Zheng

Temporal link prediction in dynamic graphs is a fundamental problem in many real-world systems. Existing temporal graph neural networks mainly focus on learning representations of historical interactions. Despite their strong performance,…

Machine Learning · Computer Science 2026-02-02 Nguyen Minh Duc , Viet Cuong Ta

Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement…

Machine Learning · Computer Science 2024-06-04 Sili Huang , Jifeng Hu , Zhejian Yang , Liwei Yang , Tao Luo , Hechang Chen , Lichao Sun , Bo Yang

Temporal graph neural networks have shown promising results in learning inductive representations by automatically extracting temporal patterns. However, previous works often rely on complex memory modules or inefficient random walk methods…

Machine Learning · Computer Science 2024-01-10 Mohammad Ali Alomrani , Mahdi Biparva , Yingxue Zhang , Mark Coates