English
Related papers

Related papers: Towards Universal Large-Scale Foundational Model f…

200 papers

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

In the shipping industry, fuel consumption and emissions are critical factors due to their significant impact on economic efficiency and environmental sustainability. Accurate prediction of ship fuel consumption is essential for further…

Machine Learning · Computer Science 2025-10-10 Justus Viga , Penelope Mueck , Alexander Löser , Torben Weis

Accurately estimating aircraft fuel flow is essential for evaluating new procedures, designing next-generation aircraft, and monitoring the environmental impact of current aviation practices. This paper investigates the generalization…

Machine Learning · Computer Science 2025-07-25 Gabriel Jarry , Ramon Dalmau , Philippe Very , Junzi Sun

Time series forecasting is essential across domains from finance to supply chain management. This paper introduces ForecastGAN, a novel decomposition based adversarial framework addressing limitations in existing approaches for…

Machine Learning · Computer Science 2025-11-07 Syeda Sitara Wishal Fatima , Afshin Rahimi

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

Machine Learning · Computer Science 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

Weather forecasting is an essential task to tackle global climate change. Weather forecasting requires the analysis of multivariate data generated by heterogeneous meteorological sensors. These sensors comprise of ground-based sensors,…

Machine Learning · Computer Science 2023-02-16 Gaganpreet Singh , Surya Durbha , Shreelakshmi C R

Data scaling has revolutionized research fields like natural language processing, computer vision, and robotics control, providing foundation models with remarkable multi-task and generalization capabilities. In this paper, we investigate…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Shaohuai Liu , Lin Dong , Chao Tian , Le Xie

Foundation models are premised on the idea that sequence prediction can uncover deeper domain understanding, much like how Kepler's predictions of planetary motion later led to the discovery of Newtonian mechanics. However, evaluating…

Machine Learning · Computer Science 2025-12-30 Keyon Vafa , Peter G. Chang , Ashesh Rambachan , Sendhil Mullainathan

Short-term (0-24 hours) precipitation forecasting is highly valuable to socioeconomic activities and public safety. However, the highly complex evolution patterns of precipitation events, the extreme imbalance between precipitation and…

Machine Learning · Computer Science 2026-03-30 Shuangliang Li , Siwei Li , Li Li , Weijie Zou , Jie Yang , Maolin Zhang

There are relatively few systematic comparisons of the ex ante counterfactual predictions from structural models to what occurs ex post. This paper uses a large-scale policy change in Boston in 2014 to investigate the performance of…

Applications · Statistics 2015-01-15 Parag A. Pathak , Peng Shi

Long-term planning of a robust power system requires the understanding of changing demand patterns. Electricity demand is highly weather sensitive. Thus, the supply side variation from introducing intermittent renewable sources, juxtaposed…

Machine Learning · Computer Science 2022-09-13 Reshmi Ghosh , Michael Craig , H. Scott Matthews , Constantine Samaras , Laure Berti-Equille

Continuous-time dynamics models, such as neural ordinary differential equations, have enabled the modeling of underlying dynamics in time-series data and accurate forecasting. However, parameterization of dynamics using a neural network…

Machine Learning · Computer Science 2022-10-14 Fan Wu , Sanghyun Hong , Donsub Rim , Noseong Park , Kookjin Lee

Load-forecasting problems have already been widely addressed with different approaches, granularities and objectives. Recent studies focus not only on deep learning methods but also on forecasting loads on single building level. This study…

Systems and Control · Electrical Eng. & Systems 2020-07-15 Thomas Steens , Jan-Simon Telle , Benedikt Hanke , Karsten von Maydell , Carsten Agert , Gian-Luca di Modica , Bernd Engel , Matthias Grottke

Forecasting the behaviour of complex dynamical systems such as interconnected sensor networks characterized by high-dimensional multivariate time series(MTS) is of paramount importance for making informed decisions and planning for the…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Shivam Gupta , Krishna Sai Sudhir Aripirala , Venkataramana Runkana

Decision-making is a dynamic process requiring perception, memory, and reasoning to make choices and find optimal policies. Traditional approaches to decision-making suffer from sample efficiency and generalization, while large-scale…

Machine Learning · Computer Science 2024-01-08 Xiaoqian Liu , Jianbin Jiao , Junge Zhang

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

Simulations using machine learning (ML) models and mechanistic models are often run to inform decision-making processes. Uncertainty estimates of simulation results are critical to the decision-making process because simulation results of…

Machine Learning · Computer Science 2023-08-08 Babajide Kolade

Recent advances in remote sensing have led to an increase in the number of available foundation models; each trained on different modalities, datasets, and objectives, yet capturing only part of the vast geospatial knowledge landscape.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Joelle Hanna , Damian Falk , Stella X. Yu , Damian Borth

Electricity demand forecasting is a well established research field. Usually this task is performed considering historical loads, weather forecasts, calendar information and known major events. Recently attention has been given on the…

Machine Learning · Computer Science 2023-09-14 Yun Bai , Simon Camal , Andrea Michiorri