English
Related papers

Related papers: KENN: Enhancing Deep Neural Networks by Leveraging…

200 papers

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

Machine Learning · Computer Science 2022-05-26 Andrea Gesmundo , Jeff Dean

A hybrid approach, incorporating concepts of nonlinear dynamics in artificial neural networks (ANN), is proposed to model time series generated by complex dynamic systems. We introduce well known features used in the study of dynamic…

comp-gas · Physics 2008-02-03 D. R. Kulkarni , A. S. Pandya , J. C. Parikh

Modeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its…

Machine Learning · Computer Science 2020-05-26 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Xiaojun Chang , Chengqi Zhang

Data preprocessing is a crucial part of any machine learning pipeline, and it can have a significant impact on both performance and training efficiency. This is especially evident when using deep neural networks for time series prediction…

Machine Learning · Computer Science 2025-03-26 Marcus A. K. September , Francesco Sanna Passino , Leonie Goldmann , Anton Hinel

Neural network pruning has become increasingly crucial due to the complexity of these models and their widespread use in various fields. Existing pruning algorithms often suffer from limitations such as architecture specificity, excessive…

Machine Learning · Computer Science 2024-06-11 Michele Mastromattei , Fabio Massimo Zanzotto

Recently, a hybrid Deep Neural Network (DNN) algorithm, TreNet was proposed for predicting trends in time series data. While TreNet was shown to have superior performance for trend prediction to other DNN and traditional ML approaches, the…

Machine Learning · Computer Science 2020-12-08 Kouame Hermann Kouassi , Deshendran Moodley

Dynamic interactions between entities are prevalent in domains like social platforms, financial systems, healthcare, and e-commerce. These interactions can be effectively represented as time-evolving graphs, where predicting future…

Machine Learning · Computer Science 2026-01-21 Sidharth Agarwal , Tanishq Dubey , Shubham Gupta , Srikanta Bedathur

Deep Learning and transfer learning models are being used to generate time series forecasts; however, there is scarce evidence about their performance prediction that it is more evident for monthly time series. The purpose of this paper is…

Machine Learning · Computer Science 2023-10-12 Martín Solís , Luis-Alexander Calvo-Valverde

This paper presents a novel framework for pattern prediction and system prognostics centered on Spatiotemporal Permutation Entropy analysis integrated with Boosted Enhanced Quantile Regression Neural Networks (BEQRNNs). We address the…

Signal Processing · Electrical Eng. & Systems 2026-04-03 David J Poland

In many real-world application, e.g., speech recognition or sleep stage classification, data are captured over the course of time, constituting a Time-Series. Time-Series often contain temporal dependencies that cause two otherwise…

Machine Learning · Computer Science 2017-01-10 John Cristian Borges Gamboa

The goal of representation learning of knowledge graph is to encode both entities and relations into a low-dimensional embedding spaces. Many recent works have demonstrated the benefits of knowledge graph embedding on knowledge graph…

Artificial Intelligence · Computer Science 2019-10-11 Wenqiang Liu , Hongyun Cai , Xu Cheng , Sifa Xie , Yipeng Yu , Hanyu Zhang

The problem of automatic and accurate forecasting of time-series data has always been an interesting challenge for the machine learning and forecasting community. A majority of the real-world time-series problems have non-stationary…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Rohit Kaushik , Shikhar Jain , Siddhant Jain , Tirtharaj Dash

In the early observation period of a time series, there might be only a few historic observations available to learn a model. However, in cases where an existing prior set of datasets is available, Meta learning methods can be applicable.…

Machine Learning · Computer Science 2023-07-20 Shayan Jawed , Kiran Madhusudhanan , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

A common problem when forecasting rare events, such as recessions, is limited data availability. Recent advancements in deep learning and generative adversarial networks (GANs) make it possible to produce high-fidelity synthetic data in…

Machine Learning · Computer Science 2023-02-22 Sam Dannels

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

Time series forecasting is an extensively studied subject in statistics, economics, and computer science. Exploration of the correlation and causation among the variables in a multivariate time series shows promise in enhancing the…

Machine Learning · Computer Science 2021-04-22 Chao Shang , Jie Chen , Jinbo Bi

Machine learning is gaining growing momentum in various recent models for the dynamic analysis of information flows in data communications networks. These preliminary models often rely on off-the-shelf learning models to predict from…

Machine Learning · Computer Science 2023-04-04 Xiangle Cheng , James He , Shihan Xiao , Yingxue Zhang , Zhitang Chen , Pascal Poupart , Fenglin Li

Accurate demand forecasting is crucial for optimizing supply chain management. Traditional methods often fail to capture complex patterns from seasonal variability and special events. Despite advancements in deep learning, interpretable…

Machine Learning · Computer Science 2025-03-04 Md Abrar Jahin , Asef Shahriar , Md Al Amin

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs…

Machine Learning · Computer Science 2025-05-02 Jongseon Kim , Hyungjoon Kim , HyunGi Kim , Dongjun Lee , Sungroh Yoon

Ensemble learning is a technique where multiple component learners are combined through a protocol. We propose an Ensemble Neural Network (ENN) that uses the combined latent-feature space of multiple neural network classifiers to improve…

High Energy Physics - Phenomenology · Physics 2021-05-06 Jack Y. Araz , Michael Spannowsky