English
Related papers

Related papers: Multimodal learning-based inversion models for the…

200 papers

Magnetic fields are responsible for a multitude of Solar phenomena, including such destructive events as solar flares and coronal mass ejections, with the number of such events rising as we approach the peak of the 11-year solar cycle, in…

Solar and Stellar Astrophysics · Physics 2022-10-28 Lukia Mistryukova , Andrey Plotnikov , Aleksandr Khizhik , Irina Knyazeva , Mikhail Hushchyn , Denis Derkach

The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Maofan Zhao , Lorenzo Bruzzone

As climate change intensifies, the urgency for accurate global-scale disaster predictions grows. This research presents a novel multimodal disaster prediction framework, combining weather statistics, satellite imagery, and textual insights.…

Machine Learning · Computer Science 2023-10-02 Gengyin Liu , Huaiyang Zhong

Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the…

Geophysics · Physics 2021-10-13 Matteo Ravasi , Claire Emma Birnie

Consistent improvement of image priors over the years has led to the development of better inverse problem solvers. Diffusion models are the newcomers to this arena, posing the strongest known prior to date. Recently, such models operating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ron Raphaeli , Sean Man , Michael Elad

Present image based visual servoing approaches rely on extracting hand crafted visual features from an image. Choosing the right set of features is important as it directly affects the performance of any approach. Motivated by recent…

Robotics · Computer Science 2017-06-13 Aseem Saxena , Harit Pandya , Gourav Kumar , Ayush Gaud , K. Madhava Krishna

Weather radar data synthesis can fill in data for areas where ground observations are missing. Existing methods often employ reconstruction-based approaches with MSE loss to reconstruct radar data from satellite observation. However, such…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Xuming He , Zhiwang Zhou , Wenlong Zhang , Xiangyu Zhao , Hao Chen , Shiqi Chen , Lei Bai

In the growing domain of scientific machine learning, in-context operator learning has shown notable potential in building foundation models, as in this framework the model is trained to learn operators and solve differential equations…

Machine Learning · Computer Science 2024-02-02 Liu Yang , Siting Liu , Stanley J. Osher

Climate projections continue to be marred by large uncertainties, which originate in processes that need to be parameterized, such as clouds, convection, and ecosystems. But rapid progress is now within reach. New computational tools and…

Machine Learning · Statistics 2018-02-14 Tapio Schneider , Shiwei Lan , Andrew Stuart , João Teixeira

Modern Earth Observation systems provide sensing data at different temporal and spatial resolutions. Among optical sensors, today the Sentinel-2 program supplies high-resolution temporal (every 5 days) and high spatial resolution (10m)…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 P. Benedetti , D. Ienco , R. Gaetano , K. Osé , R. Pensa , S. Dupuy

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

Image and Video Processing · Electrical Eng. & Systems 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

Semantic segmentation of satellite imagery is crucial for Earth observation applications, but remains constrained by limited labelled training data. While self-supervised pretraining methods like Masked Autoencoders (MAE) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 John Waithaka , Moise Busogi

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

Clouds classification is a great challenge in meteorological research. The different types of clouds, currently known and present in our skies, can produce radioactive effects that impact on the variation of atmospheric conditions, with the…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Mario Manzo , Simone Pellino

With the current ubiquity of deep learning methods to solve computer vision and remote sensing specific tasks, the need for labelled data is growing constantly. However, in many cases, the annotation process can be long and tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Paul Berg , Minh-Tan Pham , Nicolas Courty

Simulating abundances of stable water isotopologues, i.e. molecules differing in their isotopic composition, within climate models allows for comparisons with proxy data and, thus, for testing hypotheses about past climate and validating…

Atmospheric and Oceanic Physics · Physics 2023-11-28 Jonathan Wider , Jakob Kruse , Nils Weitzel , Janica C. Bühler , Ullrich Köthe , Kira Rehfeld

Satellite-based remote sensing missions have revolutionized our understanding of the Ocean state and dynamics. Among them, space-borne altimetry provides valuable Sea Surface Height (SSH) measurements, used to estimate surface geostrophic…

Machine Learning · Computer Science 2024-05-07 Theo Archambault , Arthur Filoche , Anastase Charantonis , Dominique Bereziat , Sylvie Thiria

Skilful Machine Learned weather forecasts have challenged our approach to numerical weather prediction, demonstrating competitive performance compared to traditional physics-based approaches. Data-driven systems have been trained to…

Inferring the source information of greenhouse gases, such as methane, from spatially sparse sensor observations is an essential element in mitigating climate change. While it is well understood that the complex behavior of the atmospheric…

Machine Learning · Computer Science 2022-11-03 Arka Daw , Kyongmin Yeo , Anuj Karpatne , Levente Klein