English
Related papers

Related papers: Differential Evolution Algorithm based Hyper-Param…

200 papers

Reinforcement learning (RL) applications, where an agent can simply learn optimal behaviors by interacting with the environment, are quickly gaining tremendous success in a wide variety of applications from controlling simple pendulums to…

Machine Learning · Computer Science 2022-01-28 Mariam Kiran , Melis Ozyildirim

In the context of increasing demands for long-term multi-energy load forecasting in real-world applications, this paper introduces Patchformer, a novel model that integrates patch embedding with encoder-decoder Transformer-based…

Machine Learning · Computer Science 2024-04-17 Qiuyi Hong , Fanlin Meng , Felipe Maldonado

A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes…

Accurate prediction of wind power is essential for the grid integration of this intermittent renewable source and aiding grid planners in forecasting available wind capacity. Spatial differences lead to discrepancies in climatological data…

Machine Learning · Computer Science 2024-05-21 Md Saiful Islam Sajol , Md Shazid Islam , A S M Jahid Hasan , Md Saydur Rahman , Jubair Yusuf

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

Neural and Evolutionary Computing · Computer Science 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

We present a non-convex optimization algorithm metaheuristic, based on the training of a deep generative network, which enables effective searching within continuous, ultra-high dimensional landscapes. During network training, populations…

Machine Learning · Computer Science 2023-07-11 Jiaqi Jiang , Jonathan A. Fan

Mixture models arise in many regression problems, but most methods have seen limited adoption partly due to these algorithms' highly-tailored and model-specific nature. On the other hand, transformers are flexible, neural sequence models…

Machine Learning · Computer Science 2023-11-15 Reese Pathak , Rajat Sen , Weihao Kong , Abhimanyu Das

Deep Learning (DL) has advanced various fields by extracting complex patterns from large datasets. However, the computational demands of DL models pose environmental and resource challenges. Deep shift neural networks (DSNNs) offer a…

Machine Learning · Computer Science 2024-04-05 Leona Hennig , Tanja Tornede , Marius Lindauer

There has been a significant recent surge in deep neural network (DNN) techniques. Most of the existing DNN techniques have restricted model formats/assumptions. To overcome their limitations, we propose the nonparametric transformation…

Methodology · Statistics 2024-10-28 Tong Wang , Shunqin Zhang , Sanguo Zhang , Jian Huang , Shuangge Ma

Deep generative models (DGMs) are data-eager because learning a complex model on limited data suffers from a large variance and easily overfits. Inspired by the classical perspective of the bias-variance tradeoff, we propose regularized…

Machine Learning · Computer Science 2023-04-11 Yong Zhong , Hongtao Liu , Xiaodong Liu , Fan Bao , Weiran Shen , Chongxuan Li

Time series forecasting is a critical and practical problem in many real-world applications, especially for industrial scenarios, where load forecasting underpins the intelligent operation of modern systems like clouds, power grids and…

Machine Learning · Computer Science 2025-06-17 Shaoyuan Huang , Tiancheng Zhang , Zhongtian Zhang , Xiaofei Wang , Lanjun Wang , Xin Wang

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

Machine Learning · Computer Science 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Consumer energy forecasting is essential for managing energy consumption and planning, directly influencing operational efficiency, cost reduction, personalized energy management, and sustainability efforts. In recent years, deep learning…

Machine Learning · Computer Science 2025-02-10 Muhammad Umair Danish , Katarina Grolinger

With the emergence of new application areas such as cyber-physical systems and human-in-the-loop applications ensuring a specific level of end-to-end network latency with high reliability (e.g., 99.9%) is becoming increasingly critical. To…

Networking and Internet Architecture · Computer Science 2025-03-20 Samie Mostafavi , Gourav Prateek Sharma , Ahmad Traboulsi , James Gross

This research provides an in-depth evaluation of various machine learning models for energy forecasting, focusing on the unique challenges of seasonal variations in student residential settings. The study assesses the performance of…

Machine Learning · Computer Science 2025-07-01 Muhammad Umair Danish , Mathumitha Sureshkumar , Tehara Fonseka , Umeshika Uthayakumar , Vinura Galwaduge

Deep learning models, particularly Transformers, have achieved impressive results in various domains, including time series forecasting. While existing time series literature primarily focuses on model architecture modifications and data…

Machine Learning · Computer Science 2023-12-01 Valentino Assandri , Sam Heshmati , Burhaneddin Yaman , Anton Iakovlev , Ariel Emiliano Repetur

Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural…

Machine Learning · Computer Science 2024-08-06 Yang Zhao , Jiaxi Yang , Wenbo Wang , Helin Yang , Dusit Niyato

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

Machine Learning · Computer Science 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir

It has been shown that deep learning models can under certain circumstances outperform traditional statistical methods at forecasting. Furthermore, various techniques have been developed for quantifying the forecast uncertainty (prediction…

Machine Learning · Computer Science 2021-10-08 Thabang Mathonsi , Terence L. van Zyl