English
Related papers

Related papers: TempEE: Temporal-Spatial Parallel Transformer for …

200 papers

Speech dereverberation aims to alleviate the negative impact of late reverberant reflections. The weighted prediction error (WPE) method is a well-established technique known for its superior performance in dereverberation. However, in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Ziye Yang , Mengfei Zhang , Jie Chen

Transformer-based models have recently made significant advances in accurate time-series forecasting, but even these architectures struggle to scale efficiently while capturing long-term temporal dynamics. Mixture-of-Experts (MoE) layers…

Machine Learning · Computer Science 2026-03-17 Evandro S. Ortigossa , Eran Segal

Doppler radars are routinely used for the remote sensing of oceanic surface currents and atmospheric wind profiles. Even though they operate at different frequencies and address different media, they follow very similar processing for the…

Atmospheric and Oceanic Physics · Physics 2021-02-02 Baptiste Domps , Julien Marmain , Charles-Antoine Guérin

Accurate short-term prediction of clouds and precipitation is critical for severe weather warnings, aviation safety, and renewable energy operations. Forecasts at this timescale are provided by numerical weather models and extrapolation…

We consider the problem of modeling the effects of perturbations like gene knockouts on measurements such as single-cell RNA counts. Given data for some perturbations, we aim to predict the distribution of measurements for new combinations…

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

Weather forecasting is a crucial task for meteorologic research, with direct social and economic impacts. Recently, data-driven weather forecasting models based on deep learning have shown great potential, achieving superior performance…

Atmospheric and Oceanic Physics · Physics 2024-08-26 Lihao Gan , Xin Man , Chenghong Zhang , Jie Shao

Precipitation nowcasting, predicting future radar echo sequences from current observations, is a critical yet challenging task due to the inherently chaotic and tightly coupled spatio-temporal dynamics of the atmosphere. While recent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Thao Nguyen , Jiaqi Ma , Fahad Shahbaz Khan , Souhaib Ben Taieb , Salman Khan

In this study, we propose a volume-to-point framework for quantitative precipitation estimation (QPE) based on the Quantitative Precipitation Estimation and Segregation Using Multiple Sensor (QPESUMS) Mosaic Radar data set. With a data…

Atmospheric and Oceanic Physics · Physics 2024-02-16 Ting-Shuo Yo , Shih-Hao Su , Jung-Lien Chu , Chiao-Wei Chang , Hung-Chi Kuo

Multiple wireless sensing tasks, e.g., radar detection for driver safety, involve estimating the "channel" or relationship between signal transmitted and received. In this work, we focus on a certain channel model known as the delay-doppler…

Information Theory · Computer Science 2020-11-24 Alisha Zachariah

Despite achieving state-of-the-art generation quality, diffusion models are hindered by the substantial computational burden of their iterative sampling process. While feature caching techniques achieve effective acceleration at higher step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Benlei Cui , Shaoxuan He , Bukun Huang , Zhizeng Ye , Yunyun Sun , Longtao Huang , Hui Xue , Yang Yang , Jingqun Tang , Zhou Zhao , Haiwen Hong

Time series forecasting is a critical and practical problem in many real-world applications, especially for industrial scenarios, where load forecasting underpins the intelligent operation of modern systems like clouds, power grids and…

Machine Learning · Computer Science 2025-06-17 Shaoyuan Huang , Tiancheng Zhang , Zhongtian Zhang , Xiaofei Wang , Lanjun Wang , Xin Wang

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Machine Learning · Computer Science 2026-04-21 Eva van Tegelen , Taniya Kapoor , George A. K. van Voorn , Peter van Heijster , Ioannis N. Athanasiadis

Diffusion probabilistic models (DPMs), while effective in generating high-quality samples, often suffer from high computational costs due to their iterative sampling process. To address this, we propose an enhanced ODE-based sampling method…

Machine Learning · Computer Science 2025-04-03 Jinyoung Choi , Junoh Kang , Bohyung Han

Deep neural networks offer an alternative paradigm for modeling weather conditions. The ability of neural models to make a prediction in less than a second once the data is available and to do so with very high temporal and spatial…

Atmospheric and Oceanic Physics · Physics 2023-07-07 Marcin Andrychowicz , Lasse Espeholt , Di Li , Samier Merchant , Alexander Merose , Fred Zyda , Shreya Agrawal , Nal Kalchbrenner

Accurate temporal extrapolation remains a fundamental challenge for neural operators modeling dynamical systems, where predictions must extend far beyond the training horizon. Conventional DeepONet approaches rely on two limited paradigms:…

Machine Learning · Computer Science 2026-03-17 Dibyajyoti Nayak , Somdatta Goswami

Estimating motion from spatiotemporal geoscientific data is a fundamental component of many environmental modeling and forecasting tasks. In this work, we propose a physics-informed deep learning framework for estimating altitude-wise…

Machine Learning · Computer Science 2026-04-30 Peter Pavlík , Anna Bou Ezzeddine , Viera Rozinajová

Climate models (CM) are used to evaluate the impact of climate change on the risk of floods and strong precipitation events. However, these numerical simulators have difficulties representing precipitation events accurately, mainly due to…

Computational Engineering, Finance, and Science · Computer Science 2021-02-15 Rilwan Adewoyin , Peter Dueben , Peter Watson , Yulan He , Ritabrata Dutta

Automotive perception systems are obligated to meet high requirements. While optical sensors such as Camera and Lidar struggle in adverse weather conditions, Radar provides a more robust perception performance, effectively penetrating fog,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Christof Leitgeb , Thomas Puchleitner , Max Peter Ronecker , Daniel Watzenig

Deploying large language model inference remains challenging due to their high computational overhead. Early exit optimizes model inference by adaptively reducing the number of inference layers. Current methods typically train internal…

Computation and Language · Computer Science 2026-03-05 Lianming Huang , Shangyu Wu , Yufei Cui , Ying Xiong , Haibo Hu , Xue Liu , Tei-Wei Kuo , Nan Guan , Chun Jason Xue