English
Related papers

Related papers: PTCT: Patches with 3D-Temporal Convolutional Trans…

200 papers

This study introduces a cutting-edge regional weather forecasting model based on the SwinTransformer 3D architecture. This model is specifically designed to deliver precise hourly weather predictions ranging from 1 hour to 5 days,…

Machine Learning · Computer Science 2025-03-19 Hongli Liang , Yuanting Zhang , Qingye Meng , Shuangshuang He , Xingyuan Yuan

Transformer-based architectures have achieved remarkable success in natural language processing and computer vision. However, their performance in multivariate long-term forecasting often falls short compared to simpler linear baselines.…

Machine Learning · Computer Science 2025-07-09 Dizhen Liang

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Precipitation nowcasting is crucial for mitigating the impacts of severe weather events and supporting daily activities. Conventional models predominantly relying on radar data have limited performance in predicting cases with complex…

Atmospheric and Oceanic Physics · Physics 2024-09-17 Çağlar Küçük , Aitor Atencia , Markus Dabernig

Time series forecasting is an important problem, with many real world applications. Ensembles of deep neural networks have recently achieved impressive forecasting accuracy, but such large ensembles are impractical in many real world…

Machine Learning · Computer Science 2022-08-31 Espen Haugsdal , Erlend Aune , Massimiliano Ruocco

Road traffic forecasting is crucial in real-world intelligent transportation scenarios like traffic dispatching and path planning in city management and personal traveling. Spatio-temporal graph neural networks (STGNNs) stand out as the…

Machine Learning · Computer Science 2025-01-03 Yuchen Fang , Yuxuan Liang , Bo Hui , Zezhi Shao , Liwei Deng , Xu Liu , Xinke Jiang , Kai Zheng

An impact of climate change is the increase in frequency and intensity of extreme precipitation events. However, confidently predicting the likelihood of extreme precipitation at seasonal scales remains an outstanding challenge. Here, we…

Machine Learning · Computer Science 2021-07-15 Daniel Salles Civitarese , Daniela Szwarcman , Bianca Zadrozny , Campbell Watson

Accurately forecasting the weather is an important task, as many real-world processes and decisions depend on future meteorological conditions. The NeurIPS 2022 challenge entitled Weather4cast poses the problem of predicting rainfall events…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yury Belousov , Sergey Polezhaev , Brian Pulfer

The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Transformer(PCT) for point cloud learning. PCT is based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Meng-Hao Guo , Jun-Xiong Cai , Zheng-Ning Liu , Tai-Jiang Mu , Ralph R. Martin , Shi-Min Hu

The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are determined by…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Jun Li , Yongjun Chen , Lei Cai , Ian Davidson , Shuiwang Ji

At Paranal Observatory, the least predictable parameter affecting the short-term scheduling of astronomical observations is the optical turbulence, especially the seeing, coherence time and ground layer fraction. These are critical…

Instrumentation and Methods for Astrophysics · Physics 2019-10-31 J. Milli , R. Gonzalez , P. R. Fluxa , A. Chacon , J. Navarette , M. Sarazin , E. Pena , R. Carrasco-Davis , A. Solarz , J. Smoker , C. Martayan , C. Melo , E. Sedaghati , S. Mieske , O. Hainaut , L. Tacconi-Garman

The prediction capability of recurrent-type neural networks is investigated for real-time short-term prediction (nowcasting) of ship motions in high sea state. Specifically, the performance of recurrent neural networks, long-short term…

Fluid Dynamics · Physics 2021-05-28 Danny D'Agostino , Andrea Serani , Frederick Stern , Matteo Diez

In recent years, Sound AI is being increasingly used to predict machine failures. By attaching a microphone to the machine of interest, one can get real time data on machine behavior from the field. Traditionally, Convolutional Neural Net…

Sound · Computer Science 2026-04-15 Kiran Voderhobli Holla

In multivariate time series forecasting, the Transformer architecture encounters two significant challenges: effectively mining features from historical sequences and avoiding overfitting during the learning of temporal dependencies. To…

Machine Learning · Computer Science 2024-04-30 Han Zhou , Yuntian Chen

Transformer has achieved great success in computer vision, while how to split patches in an image remains a problem. Existing methods usually use a fixed-size patch embedding which might destroy the semantics of objects. To address this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Zhiyang Chen , Yousong Zhu , Chaoyang Zhao , Guosheng Hu , Wei Zeng , Jinqiao Wang , Ming Tang

This paper proposes a competitive and computationally efficient approach to probabilistic rainfall nowcasting. A video projector (V-JEPA Vision Transformer) associated to a lightweight probabilistic head is attached to a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Luciano Araujo Dourado Filho , Almir Moreira da Silva Neto , Anthony Miyaguchi , Rodrigo Pereira David , Rodrigo Tripodi Calumby , Lukáš Picek

The extensive adoption of web technologies in the finance and investment sectors has led to an explosion of financial data, which contributes to the complexity of the forecasting task. Traditional machine learning models exhibit limitations…

Machine Learning · Computer Science 2026-01-21 Renjun Jia , Zian Liu , Peng Zhu , Dawei Cheng , Yuqi Liang

Deep learning-based time series forecasting has dominated the short-term precipitation forecasting field with the help of its ability to estimate motion flow in high-resolution datasets. The growing interest in precipitation nowcasting…

Machine Learning · Computer Science 2024-06-17 Sojung An , Tae-Jin Oh , Eunha Sohn , Donghyun Kim

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

This paper presents a deep learning architecture for nowcasting of precipitation almost globally every 30 min with a 4-hour lead time. The architecture fuses a U-Net and a convolutional long short-term memory (LSTM) neural network and is…

Machine Learning · Computer Science 2024-02-06 Reyhaneh Rahimi , Praveen Ravirathinam , Ardeshir Ebtehaj , Ali Behrangi , Jackson Tan , Vipin Kumar