English
Related papers

Related papers: Hybrid Neural Network Architecture for On-Line Lea…

200 papers

Most datasets used for supervised machine learning consist of a single label per data point. However, in cases where more information than just the class label is available, would it be possible to train models more efficiently? We…

Machine Learning · Computer Science 2024-08-15 Tobias A. Opsahl , Vegard Antun

Training machine learning models in an incremental fashion is not only important but also an efficient way to achieve artificial general intelligence. The ability that humans possess of continuous or lifelong learning helps them to not…

Machine Learning · Computer Science 2023-05-18 Sanyam Jain

Current network training paradigms primarily focus on either centralized or decentralized data regimes. However, in practice, data availability often exhibits a hybrid nature, where both regimes coexist. This hybrid setting presents new…

Machine Learning · Computer Science 2025-12-01 Junyi Zhu , Ruicong Yao , Taha Ceritli , Savas Ozkan , Matthew B. Blaschko , Eunchung Noh , Jeongwon Min , Cho Jung Min , Mete Ozay

Highway deep neural network (HDNN) is a type of depth-gated feedforward neural network, which has shown to be easier to train with more hidden layers and also generalise better compared to conventional plain deep neural networks (DNNs).…

Computation and Language · Computer Science 2017-03-23 Liang Lu

Autonomous and learning systems based on Deep Reinforcement Learning have firmly established themselves as a foundation for approaches to creating resilient and efficient Cyber-Physical Energy Systems. However, most current approaches…

Artificial Intelligence · Computer Science 2024-04-03 Eric MSP Veith , Torben Logemann , Aleksandr Berezin , Arlena Wellßow , Stephan Balduin

Deep learning models have been efficient lately on image parsing tasks. However, deep learning models are not fully capable of exploiting visual and contextual information simultaneously. The proposed three-layer context-based deep…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma

A well-trained deep neural network is shown to gain capability of simultaneously restoring two kinds of images, which are completely destroyed by two distinct scattering medias respectively. The network, based on the U-net architecture, can…

Image and Video Processing · Electrical Eng. & Systems 2019-02-21 Mu Yang , Zheng-Hao Liu , Ze-Di Cheng , Jin-Shi Xu , Chuan-Feng Li , Guang-Can Guo

Hybrid Quantum-Classical Machine Learning (ML) is an emerging field, amalgamating the strengths of both classical neural networks and quantum variational circuits on the current noisy intermediate-scale quantum devices. This paper performs…

Hybrid Quantum Neural Networks (HQNNs) have gained attention for their potential to enhance computational performance by incorporating quantum layers into classical neural network (NN) architectures. However, a key question remains: Do…

Quantum Physics · Physics 2025-02-24 Muhammad Kashif , Alberto Marchisio , Muhammad Shafique

With the wide and deep adoption of deep learning models in real applications, there is an increasing need to model and learn the representations of the neural networks themselves. These models can be used to estimate attributes of different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yun Yi , Haokui Zhang , Wenze Hu , Nannan Wang , Xiaoyu Wang

End-to-end Network has become increasingly important in multi-tasking. One prominent example of this is the growing significance of a driving perception system in autonomous driving. This paper systematically studies an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Dat Vu , Bao Ngo , Hung Phan

Stochastic Gradient Descent is used for large datasets to train models to reduce the training time. On top of that data parallelism is widely used as a method to efficiently train neural networks using multiple worker nodes in parallel.…

Machine Learning · Computer Science 2024-07-02 Aakash Sudhirbhai Vora , Dhrumil Chetankumar Joshi , Aksh Kantibhai Patel

Full-duplex (FD) systems have been introduced to provide high data rates for beyond fifth-generation wireless networks through simultaneous transmission of information over the same frequency resources. However, the operation of FD systems…

Signal Processing · Electrical Eng. & Systems 2021-10-20 Mohamed Elsayed , Ahmad A. Aziz El-Banna , Octavia A. Dobre , Wanyi Shiu , Peiwei Wang

In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classification is found to be easily misled by increasingly complex image…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-12 Xingyao Zhang , Shuaiwen Leon Song , Chenhao Xie , Jing Wang , Weigong Zhang , Xin Fu

In the field of pattern recognition research, the method of using deep neural networks based on improved computing hardware recently attracted attention because of their superior accuracy compared to conventional methods. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Kyongsik Yun , Alexander Huyen , Thomas Lu

This work investigates online learning techniques for a cognitive radar network utilizing feedback from a central coordinator. The available spectrum is divided into channels, and each radar node must transmit in one channel per time step.…

Systems and Control · Electrical Eng. & Systems 2023-04-25 William W. Howard , R. Michael Buehrer

Deep learning techniques have recently shown promise in the field of anomaly detection, providing a flexible and effective method of modelling systems in comparison to traditional statistical modelling and signal processing-based methods.…

Machine Learning · Computer Science 2024-10-28 Ayman Elhalwagy , Tatiana Kalganova

The growing capacity of neural networks has strongly contributed to their success at complex machine learning tasks and the computational demand of such large models has, in turn, stimulated a significant improvement in the hardware…

Machine Learning · Computer Science 2021-04-27 Mohammed Amer , Tomás Maul , Iman Yi Liao

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Combining neural networks with continuous logic and multicriteria decision making tools can reduce the black box nature of neural models. In this study, we show that nilpotent logical systems offer an appropriate mathematical framework for…

Artificial Intelligence · Computer Science 2020-05-01 Orsolya Csiszár , Gábor Csiszár , József Dombi