English
Related papers

Related papers: Towards a universal mechanism for successful deep …

200 papers

In human learning, an effective learning methodology is small-group learning: a small group of students work together towards the same learning objective, where they express their understanding of a topic to their peers, compare their…

Machine Learning · Computer Science 2021-03-12 Xuefeng Du , Pengtao Xie

This letter proposes a novel deep learning framework (DLF) that addresses two major hurdles in the adoption of deep learning techniques for solving physics-based problems: 1) requirement of the large dataset for training the DL model, 2)…

Applied Physics · Physics 2021-10-25 Shivanshu Mishra , Bipin Gaikwad , Nidhi Chaturvedi

This paper introduces a successive affine learning (SAL) model for constructing deep neural networks (DNNs). Traditionally, a DNN is built by solving a non-convex optimization problem. It is often challenging to solve such a problem…

Machine Learning · Computer Science 2023-07-12 Yuesheng Xu

Training large and highly accurate deep learning (DL) models is computationally costly. This cost is in great part due to the excessive number of trained parameters, which are well-known to be redundant and compressible for the execution…

Machine Learning · Computer Science 2019-04-11 Mojan Javaheripi , Bita Darvish Rouhani , Farinaz Koushanfar

Label distribution learning (LDL) requires the learner to predict the degree of correlation between each sample and each label. To achieve this, a crucial task during learning is to leverage the correlation among labels. Deep Forest (DF) is…

Machine Learning · Computer Science 2026-02-09 Jia-Le Xu , Shen-Huan Lyu , Yu-Nian Wang , Ning Chen , Zhihao Qu , Bin Tang , Baoliu Ye

Deep learning (DL) has emerged as a crucial tool in network anomaly detection (NAD) for cybersecurity. While DL models for anomaly detection excel at extracting features and learning patterns from data, they are vulnerable to data…

The Low frequency analysis and recording (LOFAR) spectrum is one of the key features of the under water target, which can be used for underwater target recognition. However, the underwater environment noise is complicated and the…

Signal Processing · Electrical Eng. & Systems 2021-04-27 Jie Chen , Jie Liu , Chang Liu , Jian Zhang , Bing Han

In this paper, we present a new approach for robust reading of identification and sensor data from chipless RFID sensor tags. For the first time, Machine Learning (ML) and Deep Learning (DL) regression modelling techniques are applied to a…

Signal Processing · Electrical Eng. & Systems 2023-08-29 Nadeem Rather , Roy B. V. B. Simorangkir , John L. Buckley , Brendan O'Flynn , Salvatore Tedesco

The recent success of deep neural networks is powered in part by large-scale well-labeled training data. However, it is a daunting task to laboriously annotate an ImageNet-like dateset. On the contrary, it is fairly convenient, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yifan Ding , Liqiang Wang , Deliang Fan , Boqing Gong

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

Accurate diagnosis of power transformer faults is essential for ensuring the stability and safety of electrical power systems. This study presents a comparative analysis of conventional machine learning (ML) algorithms and deep learning…

Machine Learning · Computer Science 2025-05-13 Bhuvan Saravanan , Pasanth Kumar M D , Aarnesh Vengateson

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

Deep learning methods have predominantly been applied to large artificial neural networks. Despite their state-of-the-art performance, these large networks typically do not generalize well to datasets with limited sample sizes. In this…

Machine Learning · Statistics 2016-11-17 Eric Strobl , Shyam Visweswaran

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Deep neural networks are susceptible to label noise. Existing methods to improve robustness, such as meta-learning and regularization, usually require significant change to the network architecture or careful tuning of the optimization…

Machine Learning · Computer Science 2022-05-31 Li Chen , Ningyuan Huang , Cong Mu , Hayden S. Helm , Kate Lytvynets , Weiwei Yang , Carey E. Priebe

Context: Automated software defect prediction (SDP) methods are increasingly applied, often with the use of machine learning (ML) techniques. Yet, the existing ML-based approaches require manually extracted features, which are cumbersome,…

Software Engineering · Computer Science 2022-10-06 Görkem Giray , Kwabena Ebo Bennin , Ömer Köksal , Önder Babur , Bedir Tekinerdogan

We propose Deep Companion Learning (DCL), a novel training method for Deep Neural Networks (DNNs) that enhances generalization by penalizing inconsistent model predictions compared to its historical performance. To achieve this, we train a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Ruizhao Zhu , Venkatesh Saligrama

Personalized Federated Learning (PFL) aims to learn multiple task-specific models rather than a single global model across heterogeneous data distributions. Existing PFL approaches typically rely on iterative optimization-such as model…

Machine Learning · Computer Science 2026-04-22 Abdulmoneam Ali , Ahmed Arafa