English
Related papers

Related papers: FMSIM: A Multimodal Flow Matching Framework for Co…

200 papers

Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized. Geoscience foundation models (GFMs) emerge as a paradigm-shifting…

Artificial Intelligence · Computer Science 2024-11-13 Hao Zhang , Jin-Jian Xu , Hong-Wei Cui , Lin Li , Yaowen Yang , Chao-Sheng Tang , Niklas Boers

We present hidden fluid mechanics (HFM), a physics informed deep learning framework capable of encoding an important class of physical laws governing fluid motions, namely the Navier-Stokes equations. In particular, we seek to leverage the…

Computational Engineering, Finance, and Science · Computer Science 2018-08-20 Maziar Raissi , Alireza Yazdani , George Em Karniadakis

Scalable and generalizable physics-aware deep learning has long been considered a significant challenge with various applications across diverse domains ranging from robotics to molecular dynamics. Central to almost all physical systems are…

Machine Learning · Computer Science 2026-02-04 Pranav Vaidhyanathan , Aristotelis Papatheodorou , Mark T. Mitchison , Natalia Ares , Ioannis Havoutis

Multimodal remote sensing data, acquired from diverse sensors, offer a comprehensive and integrated perspective of the Earth's surface. Leveraging multimodal fusion techniques, semantic segmentation enables detailed and accurate analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xianping Ma , Xiaokang Zhang , Man-On Pun , Bo Huang

Understanding temporal dynamics in medical imaging is crucial for applications such as disease progression modeling, treatment planning and anatomical development tracking. However, most deep learning methods either consider only single…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Nico Albert Disch , Yannick Kirchhoff , Robin Peretzke , Maximilian Rokuss , Saikat Roy , Constantin Ulrich , David Zimmerer , Klaus Maier-Hein

Knowledge graph completion demands effective modeling of multifaceted semantic relationships between entities. Yet, prevailing methods, which rely on static scoring functions over learned embeddings, struggling to simultaneously capture…

Computation and Language · Computer Science 2025-09-03 Siyuan Li , Ruitong Liu , Yan Wen , Te Sun , Andi Zhang , Yanbiao Ma , Xiaoshuai Hao

While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a relatively underexplored and challenging problem. To this…

Machine Learning · Computer Science 2026-05-08 Tyler Ingebrand , Ruihan Zhao , Kushagra Gupta , David Fridovich-Keil , Sandeep P. Chinchali , Ufuk Topcu

Seismic data often face challenges in their utilization due to noise contamination, incomplete acquisition, and limited low-frequency information, which hinder accurate subsurface imaging and interpretation. Traditional processing methods…

Geophysics · Physics 2025-02-04 Shijun Cheng , Randy Harsuko , Tariq Alkhalifah

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

Foundation models have made rapid advances in many domains including Earth observation, where Geospatial Foundation Models (GFMs) can help address global challenges such as climate change, agriculture, and disaster response. Previous work…

Machine Learning · Computer Science 2025-01-23 Mirali Purohit , Gedeon Muhawenayo , Esther Rolf , Hannah Kerner

We propose Functional Flow Matching (FFM), a function-space generative model that generalizes the recently-introduced Flow Matching model to operate in infinite-dimensional spaces. Our approach works by first defining a path of probability…

Machine Learning · Computer Science 2023-12-07 Gavin Kerrigan , Giosue Migliorini , Padhraic Smyth

Time series forecasting is crucial in several sectors, such as meteorology, retail, healthcare, and finance. Accurately forecasting future trends and patterns is crucial for strategic planning and making well-informed decisions. In this…

Machine Learning · Computer Science 2024-11-19 Nitin Sagar Boyeena , Begari Susheel Kumar

Robotic manipulation in high-precision tasks is essential for numerous industrial and real-world applications where accuracy and speed are required. Yet current diffusion-based policy learning methods generally suffer from low computational…

Robotics · Computer Science 2025-06-23 Sen Wang , Le Wang , Sanping Zhou , Jingyi Tian , Jiayi Li , Haowen Sun , Wei Tang

Hyperspectral imaging (HSI) provides rich spatial-spectral information but remains costly to acquire due to hardware limitations and the difficulty of reconstructing three-dimensional data from compressed measurements. Although compressive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Yi Ai , Yuanhao Cai , Yulun Zhang , Xiaokang Yang

To track rapid changes within our water sector, Global Water Models (GWMs) need to realistically represent hydrologic systems' response patterns - such as baseflow fraction - but are hindered by their limited ability to learn from data.…

We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. However, geoscience faces…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Zhixiang Guo , Xinming Wu , Luming Liang , Hanlin Sheng , Nuo Chen , Zhengfa Bi

Seismic interpretation is vital for understanding subsurface structures but remains labor-intensive, subjective, and computationally demanding. While deep learning (DL) offers promise, its success hinges on large, high-quality datasets,…

Diffusion model (DM)-based channel estimation, which generates channel samples via a posteriori sampling stepwise with denoising process, has shown potential in high-precision channel state information (CSI) acquisition. However, slow…

Machine Learning · Computer Science 2025-11-17 Wenkai Liu , Nan Ma , Jianqiao Chen , Xiaoxuan Qi , Yuhang Ma

Recently, large models, or foundation models, have exhibited remarkable performance, profoundly impacting research paradigms in diverse domains. Foundation models, trained on extensive and diverse datasets, provide exceptional…

Geophysics · Physics 2024-12-30 Qi Liu , Jianwei Ma

The goal of system identification is to learn about underlying physics dynamics behind the time-series data. To model the probabilistic and nonparametric dynamics model, Gaussian process (GP) have been widely used; GP can estimate the…

Machine Learning · Statistics 2018-11-22 Young-Jin Park , Han-Lim Choi