English
Related papers

Related papers: Compute, Time and Energy Characterization of Encod…

200 papers

As deep learning methodologies have developed, it has been generally agreed that increasing neural network size improves model quality. However, this is at the expense of memory and compute requirements, which also need to be increased.…

Machine Learning · Computer Science 2024-08-07 Mitchelle Rasquinha , Gil Tabak

In this paper, we are interested in building a domain knowledge based deep learning framework to solve the chiller plants energy optimization problems. Compared to the hotspot applications of deep learning (e.g. image classification and…

Signal Processing · Electrical Eng. & Systems 2021-06-14 Fanhe Ma , Faen Zhang , Shenglan Ben , Shuxin Qin , Pengcheng Zhou , Changsheng Zhou , Fengyi Xu

End-to-end data-driven machine learning methods often have exuberant requirements in terms of quality and quantity of training data which are often impractical to fulfill in real-world applications. This is specifically true in time series…

Machine Learning · Computer Science 2022-02-17 Muhammad Ali Chattha , Ludger van Elst , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

Deep learning uses neural networks which are parameterised by their weights. The neural networks are usually trained by tuning the weights to directly minimise a given loss function. In this paper we propose to re-parameterise the weights…

Neural and Evolutionary Computing · Computer Science 2022-03-14 Michael Fairbank , Spyridon Samothrakis , Luca Citi

Small neural networks with a constrained number of trainable parameters, can be suitable resource-efficient candidates for many simple tasks, where now excessively large models are used. However, such models face several problems during the…

Machine Learning · Computer Science 2021-09-21 Alexander Kovalenko , Pavel Kordík , Magda Friedjungová

The smart metering infrastructure has changed how electricity is measured in both residential and industrial application. The large amount of data collected by smart meter per day provides a huge potential for analytics to support the…

Machine Learning · Computer Science 2019-05-31 Nameer Al Khafaf , Mahdi Jalili , Peter Sokolowski

The width of a neural network matters since increasing the width will necessarily increase the model capacity. However, the performance of a network does not improve linearly with the width and soon gets saturated. In this case, we argue…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Shuai Zhao , Liguang Zhou , Wenxiao Wang , Deng Cai , Tin Lun Lam , Yangsheng Xu

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

To reduce negative environmental impacts, power stations and energy grids need to optimize the resources required for power production. Thus, predicting the energy consumption of clients is becoming an important part of every energy…

Machine Learning · Computer Science 2022-10-31 Ye Lin Tun , Kyi Thar , Chu Myaet Thwal , Choong Seon Hong

Exploring the climate impacts of various anthropogenic emissions scenarios is key to making informed decisions for climate change mitigation and adaptation. State-of-the-art Earth system models can provide detailed insight into these…

Atmospheric and Oceanic Physics · Physics 2024-01-23 William Yik , Sam J. Silva , Andrew Geiss , Duncan Watson-Parris

Recent advances on deep learning models come at the price of formidable training cost. The increasing model size is one of the root causes, but another less-emphasized fact is that data scale is actually increasing at a similar speed as…

Machine Learning · Computer Science 2024-01-17 Conglong Li , Zhewei Yao , Xiaoxia Wu , Minjia Zhang , Connor Holmes , Cheng Li , Yuxiong He

Data is required to develop forecasting models for use in Model Predictive Control (MPC) schemes in building energy systems. However, data is costly to both collect and exploit. Determining cost optimal data usage strategies requires…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Max Langtry , Vijja Wichitwechkarn , Rebecca Ward , Chaoqun Zhuang , Monika J. Kreitmair , Nikolas Makasis , Zack Xuereb Conti , Ruchi Choudhary

To make machine learning (ML) sustainable and apt to run on the diverse devices where relevant data is, it is essential to compress ML models as needed, while still meeting the required learning quality and time performance. However, how…

Machine Learning · Computer Science 2022-12-06 Francesco Malandrino , Giuseppe Di Giacomo , Armin Karamzade , Marco Levorato , Carla Fabiana Chiasserini

We train a deep convolutional neural network to predict hydrodynamic results for flow coefficients, average transverse momenta and charged particle multiplicities in ultrarelativistic heavy-ion collisions from the initial energy density…

High Energy Physics - Phenomenology · Physics 2023-03-09 H. Hirvonen , K. J. Eskola , H. Niemi

The quest for performant networks has been a significant force that drives the advancements of deep learning in recent years. While rewarding, improving network design has never been an easy journey. The large design space combined with the…

Machine Learning · Computer Science 2017-12-12 Boyang Deng , Junjie Yan , Dahua Lin

We propose a neural network approach to produce probabilistic weather forecasts from a deterministic numerical weather prediction. Our approach is applied to operational surface temperature outputs from the Global Deterministic Prediction…

Atmospheric and Oceanic Physics · Physics 2025-04-07 David Landry , Anastase Charantonis , Claire Monteleoni

Unpredictability of renewable energy sources coupled with the complexity of those methods used for various purposes in this area calls for the development of robust methods such as DL models within the renewable energy domain. Given the…

Machine Learning · Computer Science 2025-05-07 Lutfu Sua , Haibo Wang , Jun Huang

We explore the potential of feed-forward deep neural networks (DNNs) for emulating cloud superparameterization in realistic geography, using offline fits to data from the Super Parameterized Community Atmospheric Model. To identify the…

Atmospheric and Oceanic Physics · Physics 2021-06-09 Griffin Mooers , Mike Pritchard , Tom Beucler , Jordan Ott , Galen Yacalis , Pierre Baldi , Pierre Gentine

Middle-term horizon (months to a year) power consumption prediction is a main challenge in the energy sector, in particular when probabilistic forecasting is considered. We propose a new modelling approach that incorporates trend,…

Methodology · Statistics 2022-01-04 Michele Azzone , Roberto Baviera

With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years, in fact, as much as 90% of current data were created in the last couple of years,a trend that will…

Machine Learning · Computer Science 2015-03-19 O. Y. Al-Jarrah , P. D. Yoo , S Muhaidat , G. K. Karagiannidis , K. Taha