English
Related papers

Related papers: Exploring the design space of deep-learning-based …

200 papers

The objective of this paper is to design novel multi-layer neural network architectures for multiscale simulations of flows taking into account the observed data and physical modeling concepts. Our approaches use deep learning concepts…

Numerical Analysis · Mathematics 2018-06-14 Yating Wang , Siu Wun Cheung , Eric T. Chung , Yalchin Efendiev , Min Wang

Accurate weather prediction is essential for many aspects of life, notably the early warning of extreme weather events such as rainstorms. Short-term predictions of these events rely on forecasts from numerical weather models, in which,…

Machine Learning · Computer Science 2023-04-05 Guoxing Chen , Wei-Chyung Wang

Pre-training is prevalent in nowadays deep learning to improve the learned model's performance. However, in the literature on federated learning (FL), neural networks are mostly initialized with random weights. These attract our interest in…

Machine Learning · Computer Science 2023-03-24 Hong-You Chen , Cheng-Hao Tu , Ziwei Li , Han-Wei Shen , Wei-Lun Chao

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

In machine learning, there is a fundamental trade-off between ease of optimization and expressive power. Neural Networks, in particular, have enormous expressive power and yet are notoriously challenging to train. The nature of that…

Machine Learning · Computer Science 2015-11-24 Diogo Almeida , Nate Sauder

A common approach for modeling the environment of an autonomous vehicle are dynamic occupancy grid maps, in which the surrounding is divided into cells, each containing the occupancy and velocity state of its location. Despite the advantage…

Robotics · Computer Science 2022-05-06 Marcel Schreiber , Vasileios Belagiannis , Claudius Gläser , Klaus Dietmayer

There is a recent surge of interest in designing deep architectures based on the update steps in traditional algorithms, or learning neural networks to improve and replace traditional algorithms. While traditional algorithms have certain…

Machine Learning · Computer Science 2020-06-11 Xinshi Chen , Hanjun Dai , Yu Li , Xin Gao , Le Song

Training large neural networks is possible by training a smaller hypernetwork that predicts parameters for the large ones. A recently released Graph HyperNetwork (GHN) trained this way on one million smaller ImageNet architectures is able…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Boris Knyazev

Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in…

Predicting chaotic dynamical systems is critical in many scientific fields, such as weather forecasting, but challenging due to the characteristic sensitive dependence on initial conditions. Traditional modeling approaches require extensive…

Machine Learning · Computer Science 2025-03-12 Christof Schötz , Alistair White , Maximilian Gelbrecht , Niklas Boers

Recent years have witnessed the outstanding success of deep learning in various fields such as vision and natural language processing. This success is largely indebted to the massive size of deep learning models that is expected to increase…

Machine Learning · Computer Science 2023-06-14 Ali Momeni , Babak Rahmani , Matthieu Mallejac , Philipp Del Hougne , Romain Fleury

Weather nowcasting consists of predicting meteorological components in the short term at high spatial resolutions. Due to its influence in many human activities, accurate nowcasting has recently gained plenty of attention. In this paper, we…

Machine Learning · Computer Science 2021-10-27 Jesus Garcia Fernandez , Siamak Mehrkanoon

Accurate and efficient temperature prediction is critical for optimizing the preheating process of PET preforms in industrial microwave systems prior to blow molding. We propose a novel deep learning framework for generalized temperature…

Machine Learning · Computer Science 2025-10-08 Ahmad Alsheikh , Andreas Fischer

Deep Learning models have achieved state-of-the-art performance in medium-range weather prediction but often fail to maintain physically consistent rollouts beyond 14 days. In contrast, a few atmospheric models demonstrate stability over…

Machine Learning · Computer Science 2025-05-06 Florian Gallusser , Simon Hentschel , Anna Krause , Andreas Hotho

Deep feedforward and recurrent networks have achieved impressive results in many perception and language processing applications. This success is partially attributed to architectural innovations such as convolutional and long short-term…

Machine Learning · Statistics 2015-11-24 Arvind Neelakantan , Luke Vilnis , Quoc V. Le , Ilya Sutskever , Lukasz Kaiser , Karol Kurach , James Martens

Accurate and high precision of the indoor positioning is as important as ensuring reliable navigation in outdoor environments. Using the state-of-the-art deep learning models provides better reliability and accuracy to navigate and monitor…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Muhammad Ammad , Paul Schwarzbach , Michael Schultz , Oliver Michler

Climate models are essential to understand and project climate change, yet long-standing biases and uncertainties in their projections remain. This is largely associated with the representation of subgrid-scale processes, particularly…

The capacity to predict human spatial preferences within built environments is instrumental for developing Cyber-Physical-Social Infrastructure Systems (CPSIS). A significant challenge in this domain is the generalizability of preference…

Computational Engineering, Finance, and Science · Computer Science 2025-10-14 Maral Doctorarastoo , Katherine A. Flanigan , Mario Bergés , Christopher McComb

Deep learning-based time series forecasting has dominated the short-term precipitation forecasting field with the help of its ability to estimate motion flow in high-resolution datasets. The growing interest in precipitation nowcasting…

Machine Learning · Computer Science 2024-06-17 Sojung An , Tae-Jin Oh , Eunha Sohn , Donghyun Kim

Satellite-derived data products and climate model simulations of geophysical variables like precipitation, often exhibit systematic biases compared to in-situ measurements. Bias correction and spatial downscaling are fundamental components…

Machine Learning · Computer Science 2026-02-16 Sumanta Chandra Mishra Sharma , Adway Mitra , Auroop Ratan Ganguly