English
Related papers

Related papers: DB2-TransF: All You Need Is Learnable Daubechies W…

200 papers

Transformer is the state-of-the-art model for many natural language processing, computer vision, and audio analysis problems. Transformer effectively combines information from the past input and output samples in auto-regressive manner so…

Machine Learning · Computer Science 2025-03-14 Joni-Kristian Kämäräinen

In order to enhance the performance of Transformer models for long-term multivariate forecasting while minimizing computational demands, this paper introduces the Joint Time-Frequency Domain Transformer (JTFT). JTFT combines time and…

Machine Learning · Computer Science 2023-10-31 Yushu Chen , Shengzhuo Liu , Jinzhe Yang , Hao Jing , Wenlai Zhao , Guangwen Yang

The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism.…

Computation and Language · Computer Science 2023-08-03 Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Lukasz Kaiser , Illia Polosukhin

Accurate trajectory prediction is a cornerstone for the safe operation of autonomous driving systems, where understanding the dynamic behavior of surrounding agents is crucial. Transformer-based architectures have demonstrated significant…

Machine Learning · Computer Science 2025-05-07 JianLin Zhu , HongKuo Niu

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep…

Machine Learning · Computer Science 2023-01-30 Menna Nawar , Moustafa Shomer , Samy Faddel , Huangjie Gong

In multivariate time series forecasting (MTSF), accurately modeling the intricate dependencies among multiple variables remains a significant challenge due to the inherent limitations of traditional approaches. Most existing models adopt…

Machine Learning · Computer Science 2025-11-19 Yuchen Luo , Xinyu Li , Liuhua Peng , Mingming Gong

Time-series forecasts are essential for planning and decision-making in many domains. Explainability is key to building user trust and meeting transparency requirements. Shapley Additive Explanations (SHAP) is a popular explainable AI…

Machine Learning · Computer Science 2025-12-24 Matthias Hertel , Sebastian Pütz , Ralf Mikut , Veit Hagenmeyer , Benjamin Schäfer

Deep Neural Networks have spearheaded remarkable advancements in time series forecasting (TSF), one of the major tasks in time series modeling. Nonetheless, the non-stationarity of time series undermines the reliability of pre-trained…

Machine Learning · Computer Science 2025-01-10 HyunGi Kim , Siwon Kim , Jisoo Mok , Sungroh Yoon

Financial prediction is a complex and challenging task of time series analysis and signal processing, expected to model both short-term fluctuations and long-term temporal dependencies. Transformers have remarkable success mostly in natural…

Machine Learning · Computer Science 2025-11-17 Nguyen Kim Hai Bui , Nguyen Duy Chien , Péter Kovács , Gergő Bognár

Despite the success of Transformer-based models in the time-series prediction (TSP) tasks, the existing Transformer architecture still face limitations and the literature lacks comprehensive explorations into alternative architectures. To…

Machine Learning · Computer Science 2025-02-20 Juyuan Zhang , Wei Zhu , Jiechao Gao

Short-term precipitation forecasting remains challenging due to the difficulty in capturing long-term spatiotemporal dependencies. Current deep learning methods fall short in establishing effective dependencies between conditions and…

Machine Learning · Computer Science 2024-10-18 ChaoRong Li , XuDong Ling , YiLan Xue , Wenjie Luo , LiHong Zhu , FengQing Qin , Yaodong Zhou , Yuanyuan Huang

Accurate weather forecasting is crucial in various sectors, impacting decision-making processes and societal events. Data-driven approaches based on machine learning models have recently emerged as a promising alternative to numerical…

Machine Learning · Computer Science 2024-05-14 Zijie Li , Anthony Zhou , Saurabh Patil , Amir Barati Farimani

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

Probabilistic time series forecasting is crucial in many application domains such as retail, ecommerce, finance, or biology. With the increasing availability of large volumes of data, a number of neural architectures have been proposed for…

Machine Learning · Computer Science 2021-12-15 Olivier Sprangers , Sebastian Schelter , Maarten de Rijke

The real-time crash likelihood prediction model is an essential component of the proactive traffic safety management system. Over the years, numerous studies have attempted to construct a crash likelihood prediction model in order to…

Machine Learning · Computer Science 2023-08-30 B M Tazbiul Hassan Anik , Zubayer Islam , Mohamed Abdel-Aty

Wavelets have proven to be highly successful in several signal and image processing applications. Wavelet design has been an active field of research for over two decades, with the problem often being approached from an analytical…

Machine Learning · Computer Science 2021-07-26 Dhruv Jawali , Abhishek Kumar , Chandra Sekhar Seelamantula

Increasingly, homeowners opt for photovoltaic (PV) systems and/or battery storage to minimize their energy bills and maximize renewable energy usage. This has spurred the development of advanced control algorithms that maximally achieve…

Machine Learning · Computer Science 2023-10-31 Gargya Gokhale , Jonas Van Gompel , Bert Claessens , Chris Develder

Efficient time series forecasting is essential for smart energy systems, enabling accurate predictions of energy demand, renewable resource availability, and grid stability. However, the growing volume of high-frequency data from sensors…

Computational Engineering, Finance, and Science · Computer Science 2025-05-06 Mikkel Bue Lykkegaard , Svend Vendelbo Nielsen , Akanksha Upadhyay , Mikkel Bendixen Copeland , Philipp Trénell

Time series forecasting is essential for our daily activities and precise modeling of the complex correlations and shared patterns among multiple time series is essential for improving forecasting performance. Spatial-Temporal Graph Neural…

Machine Learning · Computer Science 2024-06-19 Yue Jiang , Xiucheng Li , Yile Chen , Shuai Liu , Weilong Kong , Antonis F. Lentzakis , Gao Cong
‹ Prev 1 8 9 10 Next ›