English
Related papers

Related papers: Transfer Learning in Deep Learning Models for Buil…

200 papers

With the widespread deployment of deep learning models, they influence their environment in various ways. The induced distribution shifts can lead to unexpected performance degradation in deployed models. Existing methods to anticipate…

In power grids, short-term load forecasting (STLF) is crucial as it contributes to the optimization of their reliability, emissions, and costs, while it enables the participation of energy companies in the energy market. STLF is a…

Topology optimization enables the design of highly efficient and complex structures, but conventional iterative methods, such as SIMP-based approaches, often suffer from high computational costs and sensitivity to initial conditions.…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Aaron Lutheran , Srijan Das , Alireza Tabarraei

The rising integration of variable renewable energy sources (RES), like solar and wind power, introduces considerable uncertainty in grid operations and energy management. Effective forecasting models are essential for grid operators to…

Systems and Control · Electrical Eng. & Systems 2024-08-02 Jesus Silva-Rodriguez , Elias Raffoul , Xingpeng Li

Deep neural networks have excelled on a wide range of problems, from vision to language and game playing. Neural networks very gradually incorporate information into weights as they process data, requiring very low learning rates. If the…

Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. Along with the…

Machine Learning · Computer Science 2023-07-06 Zhuangdi Zhu , Kaixiang Lin , Anil K. Jain , Jiayu Zhou

Transfer learning is an important approach for addressing the challenges posed by limited data availability in various applications. It accomplishes this by transferring knowledge from well-established source domains to a less familiar…

Machine Learning · Statistics 2025-03-03 Yeheng Ge , Xueyu Zhou , Jian Huang

This work aims at unveiling the potential of Transfer Learning (TL) for developing a traffic flow forecasting model in scenarios of absent data. Knowledge transfer from high-quality predictive models becomes feasible under the TL paradigm,…

Machine Learning · Computer Science 2020-05-12 Eric L. Manibardo , Ibai Laña , Javier Del Ser

Accurate forecasting of battery health indicators, including remaining capacity and lifetime, is of paramount importance for ensuring the reliability, safety, and operational efficiency of applications such as electric vehicles and large…

Signal Processing · Electrical Eng. & Systems 2026-05-29 Athanasios Koukosias , Vasileios Tzanidakis , Sotiris Athanasiou , Kostas Kolomvatsos

Machine learning enables powerful cosmological inference but typically requires many high-fidelity simulations covering many cosmological models. Transfer learning offers a way to reduce the simulation cost by reusing knowledge across…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-23 Veena Krishnaraj , Adrian E. Bayer , Christian Kragh Jespersen , Peter Melchior

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

With the recent developments in the field of Natural Language Processing, there has been a rise in the use of different architectures for Neural Machine Translation. Transformer architectures are used to achieve state-of-the-art accuracy,…

Computation and Language · Computer Science 2021-11-30 Aditya Mandke , Onkar Litake , Dipali Kadam

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

The design of building heating, ventilation, and air conditioning (HVAC) system is critically important, as it accounts for around half of building energy consumption and directly affects occupant comfort, productivity, and health.…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Shichao Xu , Yixuan Wang , Yanzhi Wang , Zheng O'Neill , Qi Zhu

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Unpredictability of renewable energy sources coupled with the complexity of those methods used for various purposes in this area calls for the development of robust methods such as DL models within the renewable energy domain. Given the…

Machine Learning · Computer Science 2025-05-07 Lutfu Sua , Haibo Wang , Jun Huang

This study introduces simple yet effective continuous- and discrete-variable quantum neural network (QNN) models as a transfer-learning approach for forecasting tasks. The CV-QNN features a single quantum layer with two qubits to establish…

Machine Learning · Computer Science 2025-03-26 Ismael Abdulrahman

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muhammad Adeel Hafeez , Michael G. Madden , Ganesh Sistu , Ihsan Ullah