English
Related papers

Related papers: Towards evolution of Deep Neural Networks through …

200 papers

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel

Whilst computer vision models built using self-supervised approaches are now commonplace, some important questions remain. Do self-supervised models learn highly redundant channel features? What if a self-supervised network could…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Tarun Krishna , Ayush K. Rai , Yasser A. D. Djilali , Alan F. Smeaton , Kevin McGuinness , Noel E. O'Connor

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Over the past decade, Deep Convolutional Neural Networks (DCNNs) have shown remarkable performance in most computer vision tasks. These tasks traditionally use a fixed dataset, and the model, once trained, is deployed as is. Adding new…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Deboleena Roy , Priyadarshini Panda , Kaushik Roy

Previous studies dominantly target at self-supervised learning on real-valued networks and have achieved many promising results. However, on the more challenging binary neural networks (BNNs), this task has not yet been fully explored in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiqiang Shen , Zechun Liu , Jie Qin , Lei Huang , Kwang-Ting Cheng , Marios Savvides

Deep neural networks achieve remarkable performances on a wide range of tasks with the aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor-exhaustive to obtain on realistic tasks. To mitigate the requirement…

Machine Learning · Computer Science 2022-11-10 Baixu Chen , Junguang Jiang , Ximei Wang , Pengfei Wan , Jianmin Wang , Mingsheng Long

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

While Semi-supervised learning has gained much attention in computer vision on image data, yet limited research exists on its applicability in the time series domain. In this work, we investigate the transferability of state-of-the-art deep…

Machine Learning · Computer Science 2022-02-17 Jann Goschenhofer , Rasmus Hvingelby , David Rügamer , Janek Thomas , Moritz Wagner , Bernd Bischl

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks: carefully constructed perturbations to an image can seriously impair classification accuracy, while being imperceptible to humans. While there has been a significant amount…

Machine Learning · Computer Science 2020-12-23 Can Bakiskan , Metehan Cekic , Ahmet Dundar Sezer , Upamanyu Madhow

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

Machine Learning · Computer Science 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

Deep convolutional neural network (DCNN) based supervised learning is a widely practiced approach for large-scale image classification. However, retraining these large networks to accommodate new, previously unseen data demands high…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Syed Shakib Sarwar , Aayush Ankit , Kaushik Roy

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

Predicting phenotypes from gene expression data is a crucial task in biomedical research, enabling insights into disease mechanisms, drug responses, and personalized medicine. Traditional machine learning and deep learning rely on…

Machine Learning · Computer Science 2025-09-18 Kevin Dradjat , Massinissa Hamidi , Pierre Bartet , Blaise Hanczar