English
Related papers

Related papers: Dualformer: Time-Frequency Dual Domain Learning fo…

200 papers

Transformer-based architectures have advanced medical image analysis by effectively modeling long-range dependencies, yet they often struggle in 3D settings due to substantial memory overhead and insufficient capture of fine-grained local…

Periodicity, as one of the most important basic characteristics, lays the foundation for facilitating structured knowledge acquisition and systematic cognitive processes within human learning paradigms. However, the potential flaws of…

Computation and Language · Computer Science 2025-10-28 Yihong Dong , Ge Li , Xue Jiang , Yongding Tao , Kechi Zhang , Hao Zhu , Huanyu Liu , Jiazheng Ding , Jia Li , Jinliang Deng , Hong Mei

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Time domain identification is studied in this paper for parameters of a continuous-time multi-input multi-output descriptor system, with these parameters affecting system matrices through a linear fractional transformation. Sampling is…

Multiagent Systems · Computer Science 2025-06-17 Tong Zhou

Learning multiscale Transformer models has been evidenced as a viable approach to augmenting machine translation systems. Prior research has primarily focused on treating subwords as basic units in developing such systems. However, the…

Computation and Language · Computer Science 2023-05-29 Bei Li , Yi Jing , Xu Tan , Zhen Xing , Tong Xiao , Jingbo Zhu

Long-term time series forecasting is a long-standing challenge in various applications. A central issue in time series forecasting is that methods should expressively capture long-term dependency. Furthermore, time series forecasting…

Machine Learning · Computer Science 2024-11-06 Xingyu Zhang , Siyu Zhao , Zeen Song , Huijie Guo , Jianqi Zhang , Changwen Zheng , Wenwen Qiang

Unsupervised/self-supervised time series representation learning is a challenging problem because of its complex dynamics and sparse annotations. Existing works mainly adopt the framework of contrastive learning with the time-based…

Machine Learning · Computer Science 2022-05-31 Ling Yang , Shenda Hong

Predicting time-series is of great importance in various scientific and engineering fields. However, in the context of limited and noisy data, accurately predicting dynamics of all variables in a high-dimensional system is a challenging…

Machine Learning · Computer Science 2025-06-16 Zijian Wang , Peng Tao , Luonan Chen

Multivariate long-term time series forecasting has been suffering from the challenge of capturing both temporal dependencies within variables and spatial correlations across variables simultaneously. Current approaches predominantly…

Machine Learning · Computer Science 2025-09-15 Chenheng Xu , Dan Wu , Yixin Zhu , Ying Nian Wu

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

Time series forecasting is an important problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. In this paper, we propose to tackle such forecasting problem with…

Machine Learning · Computer Science 2020-01-06 Shiyang Li , Xiaoyong Jin , Yao Xuan , Xiyou Zhou , Wenhu Chen , Yu-Xiang Wang , Xifeng Yan

Machine learning models have demonstrated remarkable efficacy and efficiency in a wide range of stock forecasting tasks. However, the inherent challenges of data scarcity, including low signal-to-noise ratio (SNR) and data homogeneity, pose…

Statistical Finance · Quantitative Finance 2024-02-13 Yuan Gao , Haokun Chen , Xiang Wang , Zhicai Wang , Xue Wang , Jinyang Gao , Bolin Ding

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe…

Machine Learning · Computer Science 2022-06-27 Tian Zhou , Jianqing Zhu , Xue Wang , Ziqing Ma , Qingsong Wen , Liang Sun , Rong Jin

Accurate forecasting of passenger flows is critical for maintaining the efficiency and resilience of airport operations. Recent advances in patch-based Transformer models have shown strong potential in various time series forecasting tasks.…

Machine Learning · Computer Science 2025-12-16 Wenbo Du , Lingling Han , Ying Xiong , Ling Zhang , Biyue Li , Yisheng Lv , Tong Guo

Deep learning models for channel estimation in Orthogonal Frequency Division Multiplexing (OFDM) systems often suffer from performance degradation under fast-fading channels and low-SNR scenarios. To address these limitations, we introduce…

Machine Learning · Computer Science 2025-05-15 Berkay Guler , Hamid Jafarkhani

Temporal Action Localization (TAL) remains a fundamental challenge in video understanding, aiming to identify the start time, end time, and category of all action instances within untrimmed videos. While recent single-stage, anchor-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Thisara Rathnayaka , Uthayasanker Thayasivam

Existing generative models for unsupervised anomalous sound detection are limited by their inability to fully capture the complex feature distribution of normal sounds, while the potential of powerful diffusion models in this domain remains…

Sound · Computer Science 2026-02-03 Chengyuan Ma , Peng Jia , Hongyue Guo , Wenming Yang

Time series forecasters are widely used across various domains. Among them, MLP (multi-layer perceptron)-based forecasters have been proven to be more robust to noise compared to Transformer-based forecasters. However, MLP struggles to…

Machine Learning · Computer Science 2026-03-18 Xiang Ao

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this…

Sound · Computer Science 2025-06-27 Maxime Leiber , Yosra Marnissi , Axel Barrau , Sylvain Meignen , Laurent Massoulié

In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting…

Machine Learning · Computer Science 2024-02-06 Mohamed Mejri , Chandramouli Amarnath , Abhijit Chatterjee