English
Related papers

Related papers: Don't Waste Data: Transfer Learning to Leverage Al…

200 papers

Machine learning has been increasingly applied in climate modeling on system emulation acceleration, data-driven parameter inference, forecasting, and knowledge discovery, addressing challenges such as physical consistency, multi-scale…

As global climate change intensifies, accurate weather forecasting has become increasingly important, affecting agriculture, energy management, environmental protection, and daily life. This study introduces a hybrid model combining…

Machine Learning · Computer Science 2024-10-22 Yuhao Gong , Yuchen Zhang , Fei Wang , Chi-Han Lee

In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their…

Constructing first principles models is a challenging task for nonlinear and complex systems such as a wastewater treatment unit. In recent years, data-driven models are widely used to overcome the complexity. However, they often suffer…

Machine Learning · Computer Science 2024-01-23 Ece S. Koksal , Erdal Aydin

The recent abundance of data on electricity consumption at different scales opens new challenges and highlights the need for new techniques to leverage information present at finer scales in order to improve forecasts at wider scales. In…

Applications · Statistics 2022-11-23 Anestis Antoniadis , Solenne Gaucher , Yannig Goude

Short-term forecasting models typically assume the availability of input data (features) when they are deployed and in use. However, equipment failures, disruptions, cyberattacks, may lead to missing features when such models are used…

Machine Learning · Statistics 2025-06-30 Akylas Stratigakos , Panagiotis Andrianesis

In this paper, we consider the problem of learning a linear regression model on a data domain of interest (target) given few samples. To aid learning, we are provided with a set of pre-trained regression models that are trained on…

Machine Learning · Computer Science 2023-06-27 Navjot Singh , Suhas Diggavi

Solar forecasting from ground-based sky images has shown great promise in reducing the uncertainty in solar power generation. With more and more sky image datasets open sourced in recent years, the development of accurate and reliable deep…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yuhao Nie , Quentin Paletta , Andea Scott , Luis Martin Pomares , Guillaume Arbod , Sgouris Sgouridis , Joan Lasenby , Adam Brandt

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels…

Machine Learning · Computer Science 2025-02-17 Alexander Capstick , Francesca Palermo , Tianyu Cui , Payam Barnaghi

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy…

Machine Learning · Computer Science 2016-12-16 Travis Dick , Mu Li , Venkata Krishna Pillutla , Colin White , Maria Florina Balcan , Alex Smola

Training diffusion models requires large datasets. However, acquiring large volumes of high-quality data can be challenging, for example, collecting large numbers of high-resolution images and long videos. On the other hand, there are many…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xudong Ma

Increasingly, homeowners opt for photovoltaic (PV) systems and/or battery storage to minimize their energy bills and maximize renewable energy usage. This has spurred the development of advanced control algorithms that maximally achieve…

Machine Learning · Computer Science 2023-10-31 Gargya Gokhale , Jonas Van Gompel , Bert Claessens , Chris Develder

High-dimensional tensor models are notoriously computationally expensive to train. We present a meta-learning algorithm, MMT, that can significantly speed up the process for spatial tensor models. MMT leverages the property that spatial…

Machine Learning · Computer Science 2018-03-01 Stephan Zheng , Rose Yu , Yisong Yue

We address the essential role of information retrieval in enhancing climate downscaling, focusing on the need for high-resolution datasets and the application of deep learning models. We explore the requirements for acquiring detailed…

Atmospheric and Oceanic Physics · Physics 2024-06-03 Declan Curran , Hira Saleem , Flora Salim

This paper proposes the use of iterative transfer learning applied to deep learning models for side-channel attacks. Currently, most of the side-channel attack methods train a model for each individual byte, without considering the…

Machine Learning · Computer Science 2024-12-31 Tun-Chieh Lou , Chung-Che Wang , Jyh-Shing Roger Jang , Henian Li , Lang Lin , Norman Chang

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Deep learning models have gained popularity in climate science, following their success in computer vision and other domains. For instance, researchers are increasingly employing deep learning techniques for downscaling climate data,…

Machine Learning · Computer Science 2023-06-21 Xingying Huang

Transferring a deep neural network trained on one problem to another requires only a small amount of data and little additional computation time. The same behaviour holds for ensembles of deep learning models typically superior to a single…

Machine Learning · Computer Science 2022-06-28 Ilya Shashkov , Nikita Balabin , Evgeny Burnaev , Alexey Zaytsev

The impressive performance of deep learning architectures is associated with a massive increase in model complexity. Millions of parameters need to be tuned, with training and inference time scaling accordingly, together with energy…

Machine Learning · Computer Science 2023-11-10 Paolo Didier Alfano , Vito Paolo Pastore , Lorenzo Rosasco , Francesca Odone