English
Related papers

Related papers: PACT: Peak-Aware Cross-Attention Graph Transformer…

200 papers

Traffic forecasting is crucial for public safety and resource optimization, yet is very challenging due to three aspects: i) current existing works mostly exploit intricate temporal patterns (e.g., the short-term thunderstorm and long-term…

Machine Learning · Computer Science 2022-01-19 Yuchen Fang , Yanjun Qin , Haiyong Luo , Fang Zhao , Bingbing Xu , Chenxing Wang , Liang Zeng

In recent years, the application of transformer-based models in time-series forecasting has received significant attention. While often demonstrating promising results, the transformer architecture encounters challenges in fully exploiting…

Machine Learning · Computer Science 2025-02-12 Artyom Stitsyuk , Jaesik Choi

Storm surge is a major natural hazard in coastal regions, responsible both for significant property damage and loss of life. Accurate, efficient models of storm surge are needed both to assess long-term risk and to guide emergency…

Computational Engineering, Finance, and Science · Computer Science 2023-04-04 Benjamin Pachev , Prateek Arora , Carlos del-Castillo-Negrete , Eirik Valseth , Clint Dawson

Domain adaptation of visual detectors is a critical challenge, yet existing methods have overlooked pixel appearance transformations, focusing instead on bootstrapping and/or domain confusion losses. We propose a Semantic Pixel-Level…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Eric Tzeng , Kaylee Burns , Kate Saenko , Trevor Darrell

Increasing flood frequency and severity due to climate change threatens infrastructure and demands improved susceptibility mapping techniques. While traditional machine learning (ML) approaches are widely used, they struggle to capture…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Sreenath Vemula , Filippo Gatti , Pierre Jehel

Air pollution and carbon emissions caused by modern transportation are closely related to global climate change. With the help of next-generation information technology such as Internet of Things (IoT) and Artificial Intelligence (AI),…

Machine Learning · Computer Science 2022-10-03 Wei Zhao , Shiqi Zhang , Bing Zhou , Bei Wang

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

Machine Learning · Computer Science 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

The advent of foundation models have revolutionized various fields, enabling unprecedented task accuracy and flexibility in computational linguistics, computer vision and other domains. Attention mechanism has become an essential component…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Mohammadali Shakerdargah , Shan Lu , Chao Gao , Di Niu

Graph Network Simulators (GNSs) have emerged as powerful surrogates for complex physics-based simulation, offering inherent differentiability and orders-of-magnitude speedups over traditional solvers. However, GNSs typically assume access…

Predicting typhoon intensity accurately across space and time is crucial for issuing timely disaster warnings and facilitating emergency response. This has vast potential for minimizing life losses and property damages as well as reducing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Huanxin Chen , Pengshuai Yin , Huichou Huang , Qingyao Wu , Ruirui Liu , Xiatian Zhu

Graph embedding methods represent nodes in a continuous vector space, preserving information from the graph (e.g. by sampling random walks). There are many hyper-parameters to these methods (such as random walk length) which have to be…

Machine Learning · Computer Science 2018-12-27 Sami Abu-El-Haija , Bryan Perozzi , Rami Al-Rfou , Alex Alemi

Understanding point clouds captured from the real-world is challenging due to shifts in data distribution caused by varying object scales, sensor angles, and self-occlusion. Prior works have addressed this issue by combining recent learning…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Joonhyung Park , Hyunjin Seo , Eunho Yang

Solving the alternating current power flow equations in real time is essential for secure grid operation, yet classical Newton-Raphson solvers can be slow under stressed conditions. Existing graph neural networks for power flow are…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Chidozie Ezeakunne , Jose E. Tabarez , Reeju Pokharel , Anup Pandey

Although deep learning models have demonstrated remarkable potential in weather prediction, most of them overlook either the \textbf{physics} of the underlying weather evolution or the \textbf{topology} of the Earth's surface. In light of…

Machine Learning · Computer Science 2025-05-09 Jiaqi Zheng , Qing Ling , Yerong Feng

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various…

Machine Learning · Computer Science 2023-12-27 Alan John Varghese , Aniruddha Bora , Mengjia Xu , George Em Karniadakis

We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as multiple correlated time series. For example, speed sensors are deployed in different…

Machine Learning · Computer Science 2021-03-23 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang

Precipitation nowcasting is crucial across various industries and plays a significant role in mitigating and adapting to climate change. We introduce an efficient deep learning model for precipitation nowcasting, capable of predicting…

This paper presents a novel attention-based algorithm for achieving adaptive computation called DACT, which, unlike existing ones, is end-to-end differentiable. Our method can be used in conjunction with many networks; in particular, we…

Artificial Intelligence · Computer Science 2020-05-25 Cristobal Eyzaguirre , Alvaro Soto

Demand forecasting faces challenges induced by Peak Events (PEs) corresponding to special periods such as promotions and holidays. Peak events create significant spikes in demand followed by demand ramp down periods. Neural networks like…

Precipitation nowcasting is vital for flood warning, agricultural management, and emergency response, yet two bottlenecks persist: the prohibitive cost of modeling million-scale spatiotemporal tokens from multi-variate atmospheric fields,…

Artificial Intelligence · Computer Science 2026-03-17 Xinyu Xiao , Sen Lei , Eryun Liu , Shiming Xiang , Hao Li , Cheng Yuan , Yuan Qi , Qizhao Jin