English
Related papers

Related papers: JointFM-0.1: A Foundation Model for Multi-Target J…

200 papers

Time Series Foundation Models (TSFMs) have shown promising zero-shot generalization across diverse forecasting tasks. However, their robustness to continual adaptation remains underexplored. In this work, we investigate the extent to which…

Machine Learning · Computer Science 2025-10-03 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets to enable versatile downstream applications through finetuning, separating them from task-specific weather…

We present PDE-FM, a modular foundation model for physics-informed machine learning that unifies spatial, spectral, and temporal reasoning across heterogeneous partial differential equation (PDE) systems. PDE-FM combines spatial-spectral…

Machine Learning · Computer Science 2025-12-01 Eduardo Soares , Emilio Vital Brazil , Victor Shirasuna , Breno W. S. R. de Carvalho , Cristiano Malossi

Time series foundation models (TSFMs) have recently achieved strong zero-shot forecasting performance through large-scale pretraining and retrieval-augmented prediction. However, our empirical analysis reveals a non-trivial limitation of…

Machine Learning · Computer Science 2026-05-26 Jinjin Chi , Lei Feng , Lulu Zhang , Yongcheng Jing , Yiming Wang , Ximing Li , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

Ordinary differential equations (ODEs) describe dynamical systems evolving deterministically in continuous time. Accurate data-driven modeling of systems as ODEs, a central problem across the natural sciences, remains challenging,…

Machine Learning · Computer Science 2025-10-15 Maximilian Mauel , Manuel Hinz , Patrick Seifner , David Berghaus , Ramses J. Sanchez

Foundation Models (FMs) are large-scale, pre-trained artificial intelligence (AI) systems that have revolutionized natural language processing and computer vision, and are now advancing geospatial analysis and Earth Observation (EO). They…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pedram Ghamisi , Weikang Yu , Xiaokang Zhang , Aldino Rizaldy , Jian Wang , Chufeng Zhou , Richard Gloaguen , Gustau Camps-Valls

Stochastic discriminative EM (sdEM) is an online-EM-type algorithm for discriminative training of probabilistic generative models belonging to the exponential family. In this work, we introduce and justify this algorithm as a stochastic…

Machine Learning · Computer Science 2017-04-05 Andres R. Masegosa

Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-06 Jiaxin Yuan , Haizhao Yang , Maria Cameron

Stochastic differential equations (SDEs) are increasingly used in longitudinal data analysis, compartmental models, growth modelling, and other applications in a number of disciplines. Parameter estimation, however, currently requires…

Methodology · Statistics 2018-09-12 Oscar García

Stochastic differential equations (SDEs) have been widely used to model real world random phenomena. Existing works mainly focus on the case where the time series is modeled by a single SDE, which might be restrictive for modeling time…

Machine Learning · Computer Science 2024-01-23 Zhongchang Sun , Yousef El-Laham , Svitlana Vyetrenko

Time Series Forecasting (TSF) is key functionality in numerous fields, such as financial investment, weather services, and energy management. Although increasingly capable TSF methods occur, many of them require domain-specific data…

Machine Learning · Computer Science 2025-06-13 Zhe Li , Xiangfei Qiu , Peng Chen , Yihang Wang , Hanyin Cheng , Yang Shu , Jilin Hu , Chenjuan Guo , Aoying Zhou , Christian S. Jensen , Bin Yang

High-fidelity Monte Carlo simulations and complex inverse problems, such as mapping smeared experimental observations to ground-truth states, are computationally intensive yet essential for robust data analysis. Conditional Flow Matching…

Machine Learning · Computer Science 2026-04-03 Zeyu Xia , Tyler Kim , Trevor Reed , Judy Fox , Geoffrey Fox , Adam Szczepaniak

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Stochastic differential equations (SDEs) are well suited to modelling noisy and irregularly sampled time series found in finance, physics, and machine learning. Traditional approaches require costly numerical solvers to sample between…

Machine Learning · Computer Science 2025-10-30 Naoki Kiyohara , Edward Johns , Yingzhen Li

Probabilistic forecasts of renewable energy production provide users with valuable information about the uncertainty associated with the expected generation. Current state-of-the-art forecasts for solar irradiance have focused on producing…

Applications · Statistics 2013-10-28 Emil B. Iversen , Juan M. Morales , Jan K. Møller , Henrik Madsen

Conditional density estimation (CDE) is a fundamental task in machine learning that aims to model the full conditional law $\mathbb{P}(\mathbf{y} \mid \mathbf{x})$, beyond mere point prediction (e.g., mean, mode). A core challenge is…

Machine Learning · Computer Science 2026-03-27 Chenglong Song , Mazharul Islam , Lin Wang , Bing Chen , Bo Yang

We present DeepFDM, a differentiable finite-difference framework for learning spatially varying coefficients in time-dependent partial differential equations (PDEs). By embedding a classical forward-Euler discretization into a convolutional…

Numerical Analysis · Mathematics 2025-07-30 Patrick Chatain , Michael Rizvi-Martel , Guillaume Rabusseau , Adam Oberman

This study introduces a training-free conditional diffusion model for learning unknown stochastic differential equations (SDEs) using data. The proposed approach addresses key challenges in computational efficiency and accuracy for modeling…

Machine Learning · Computer Science 2024-10-07 Yanfang Liu , Yuan Chen , Dongbin Xiu , Guannan Zhang

Stochastic differential equations provide a rich class of flexible generative models, capable of describing a wide range of spatio-temporal processes. A host of recent work looks to learn data-representing SDEs, using neural networks and…

Machine Learning · Statistics 2021-10-12 Scott Cameron , Tyron Cameron , Arnu Pretorius , Stephen Roberts