English
Related papers

Related papers: STCL:Curriculum learning Strategies for deep learn…

200 papers

Curriculum learning is a training strategy that sorts the training examples by some measure of their difficulty and gradually exposes them to the learner to improve the network performance. Motivated by our insights from implicit curriculum…

Machine Learning · Computer Science 2021-07-28 Vinu Sankar Sadasivan , Anirban Dasgupta

Self-paced curriculum learning (SCL) has demonstrated its great potential in computer vision, natural language processing, etc. During training, it implements easy-to-hard sampling based on online estimation of data difficulty. Most SCL…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Han Li , Hu Han , S. Kevin Zhou

Starting with small and simple concepts, and gradually introducing complex and difficult concepts is the natural process of human learning. Spiking Neural Networks (SNNs) aim to mimic the way humans process information, but current SNNs…

Machine Learning · Computer Science 2023-09-27 Lingling Tang , Jiangtao Hu , Hua Yu , Surui Liu , Jielei Chu

Despite the significant advances in recent years, Generative Adversarial Networks (GANs) are still notoriously hard to train. In this paper, we propose three novel curriculum learning strategies for training GANs. All strategies are first…

Machine Learning · Computer Science 2019-10-24 Petru Soviany , Claudiu Ardei , Radu Tudor Ionescu , Marius Leordeanu

In recent years, deep learning models have revolutionized medical image interpretation, offering substantial improvements in diagnostic accuracy. However, these models often struggle with challenging images where critical features are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Pradeep Singh , Kishore Babu Nampalle , Uppala Vivek Narayan , Balasubramanian Raman

Deep neural network-based medical image classifications often use "hard" labels for training, where the probability of the correct category is 1 and those of others are 0. However, these hard targets can drive the networks over-confident…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Dong Wei , Shilei Cao , Kai Ma , Yefeng Zheng

Curriculum learning (CL) is a training strategy that trains a machine learning model from easier data to harder data, which imitates the meaningful learning order in human curricula. As an easy-to-use plug-in, the CL strategy has…

Machine Learning · Computer Science 2021-03-26 Xin Wang , Yudong Chen , Wenwu Zhu

We explore different curriculum learning methods for training convolutional neural networks on the task of deformable pairwise 3D medical image registration. To the best of our knowledge, we are the first to attempt to improve performance…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Mihail Burduja , Radu Tudor Ionescu

Steganography algorithms facilitate communication between a source and a destination in a secret manner. This is done by embedding messages/text/data into images without impacting the appearance of the resultant images/videos. Steganalysis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Farid Ghareh Mohammadi , Farzan Shenavarmasouleh , M. Hadi Amini , Hamid R. Arabnia

With the widespread applications of the deep neural network (DNN), how to covertly transmit the DNN models in public channels brings us the attention, especially for those trained for secret-learning tasks. In this paper, we propose deep…

Cryptography and Security · Computer Science 2023-07-10 Guobiao Li , Sheng Li , Meiling Li , Zhenxing Qian , Xinpeng Zhang

Continual learning (CL) is one of the most promising trends in recent machine learning research. Its goal is to go beyond classical assumptions in machine learning and develop models and learning strategies that present high robustness in…

Machine Learning · Computer Science 2023-03-21 Kamil Faber , Dominik Zurek , Marcin Pietron , Nathalie Japkowicz , Antonio Vergari , Roberto Corizzo

Since the BOSS competition, in 2010, most steganalysis approaches use a learning methodology involving two steps: feature extraction, such as the Rich Models (RM), for the image representation, and use of the Ensemble Classifier (EC) for…

Multimedia · Computer Science 2018-01-15 Lionel Pibre , Pasquet Jérôme , Dino Ienco , Marc Chaumont

Machine learning and deep learning models are potential vectors for various attack scenarios. For example, previous research has shown that malware can be hidden in deep learning models. Hiding information in a learning model can be viewed…

Machine Learning · Computer Science 2023-08-31 Rishit Agrawal , Kelvin Jou , Tanush Obili , Daksh Parikh , Samarth Prajapati , Yash Seth , Charan Sridhar , Nathan Zhang , Mark Stamp

The performance of deep segmentation models often degrades due to distribution shifts in image intensities between the training and test data sets. This is particularly pronounced in multi-centre studies involving data acquired using…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Zhendong Liu , Van Manh , Xin Yang , Xiaoqiong Huang , Karim Lekadir , Víctor Campello , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a…

Computation and Language · Computer Science 2025-06-19 Xuemei Tang , Jun Wang , Qi Su , Chu-ren Huang , Jinghang Gu

Signed graphs are powerful models for representing complex relations with both positive and negative connections. Recently, Signed Graph Neural Networks (SGNNs) have emerged as potent tools for analyzing such graphs. To our knowledge, no…

Machine Learning · Computer Science 2024-11-28 Zeyu Zhang , Lu Li , Xingyu Ji , Kaiqi Zhao , Xiaofeng Zhu , Philip S. Yu , Jiawei Li , Maojun Wang

Curriculum learning strategies have been proven to be effective in various applications and have gained significant interest in the field of machine learning. It has the ability to improve the final model's performance and accelerate the…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Asmaa Abbas , Mohamed Gaber , Mohammed M. Abdelsamea

One of the well-known challenges in computer vision tasks is the visual diversity of images, which could result in an agreement or disagreement between the learned knowledge and the visual content exhibited by the current observation. In…

Machine Learning · Computer Science 2020-01-03 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

The purpose of image steganalysis is to determine whether the carrier image contains hidden information or not. Since JEPG is the most commonly used image format over social networks, steganalysis in JPEG images is also the most urgently…

Multimedia · Computer Science 2023-06-14 Qiyun Liu , Zhiguang Yang , Hanzhou Wu

Adoption of deep learning in image steganalysis is still in its initial stage. In this paper we propose a generic hybrid deep-learning framework for JPEG steganalysis incorporating the domain knowledge behind rich steganalytic models. Our…

Multimedia · Computer Science 2018-01-24 Jishen Zeng , Shunquan Tan , Bin Li , Jiwu Huang