English
Related papers

Related papers: QBDC: Query by dropout committee for training deep…

200 papers

Deep learning applications have achieved great success in numerous real-world applications. Deep learning models, especially Convolution Neural Networks (CNN) are often prototyped using FPGA because it offers high power efficiency and…

Machine Learning · Computer Science 2022-02-22 Adewale Adeyemo , Travis Sandefur , Tolulope A. Odetola , Syed Rafay Hasan

The training phases of Deep neural network~(DNN) consumes enormous processing time and energy. Compression techniques utilizing the sparsity of DNNs can effectively accelerate the inference phase of DNNs. However, it is hardly used in the…

Machine Learning · Computer Science 2022-03-14 Zhuoran Song , Yihong Xu , Han Li , Naifeng Jing , Xiaoyao Liang , Li Jiang

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Recently, dropout has seen increasing use in deep learning. For deep convolutional neural networks, dropout is known to work well in fully-connected layers. However, its effect in convolutional and pooling layers is still not clear. This…

Machine Learning · Computer Science 2015-12-02 Haibing Wu , Xiaodong Gu

At present, designing convolutional neural network (CNN) architectures requires both human expertise and labor. New architectures are handcrafted by careful experimentation or modified from a handful of existing networks. We introduce…

Machine Learning · Computer Science 2017-03-24 Bowen Baker , Otkrist Gupta , Nikhil Naik , Ramesh Raskar

This paper introduces a new methodology for extreme spatial dependence structure selection. It is based on deep learning techniques, specifically Convolutional Neural Networks -CNNs. Two schemes are considered: in the first scheme, the…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Manaf Ahmed , Véronique Maume-Deschamps , Pierre Ribereau

Whole brain segmentation using deep learning (DL) is a very challenging task since the number of anatomical labels is very high compared to the number of available training images. To address this problem, previous DL methods proposed to…

Image and Video Processing · Electrical Eng. & Systems 2019-06-06 Pierrick Coupé , Boris Mansencal , Michaël Clément , Rémi Giraud , Baudouin Denis de Senneville , Vinh-Thong Ta , Vincent Lepetit , José V. Manjon

Deep neural networks often work well when they are over-parameterized and trained with a massive amount of noise and regularization, such as weight decay and dropout. Although dropout is widely used as a regularization technique for fully…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Golnaz Ghiasi , Tsung-Yi Lin , Quoc V. Le

Active learning has been utilized as an efficient tool in building anomaly detection models by leveraging expert feedback. In an active learning framework, a model queries samples to be labeled by experts and re-trains the model with the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

Deep convolutional neural networks (CNNs) have been shown to be very successful in a wide range of image processing applications. However, due to their increasing number of model parameters and an increasing availability of large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Axel Klawonn , Martin Lanser , Janine Weber

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

This research addresses the challenge of characterizing the complexity and unpredictability of basins within various dynamical systems. The main focus is on demonstrating the efficiency of convolutional neural networks (CNNs) in this field.…

Machine Learning · Computer Science 2024-06-18 David Valle , Alexandre Wagemakers , Miguel A. F. Sanjuán

Deep convolutional neural networks (CNNs) have demonstrated remarkable success in computer vision by supervisedly learning strong visual feature representations. However, training CNNs relies heavily on the availability of exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Jiabo Huang , Qi Dong , Shaogang Gong , Xiatian Zhu

Most of the approaches for discovering visual attributes in images demand significant supervision, which is cumbersome to obtain. In this paper, we aim to discover visual attributes in a weakly supervised setting that is commonly…

Computer Vision and Pattern Recognition · Computer Science 2015-04-21 Sukrit Shankar , Vikas K. Garg , Roberto Cipolla

Whole brain segmentation using deep learning (DL) is a very challenging task since the number of anatomical labels is very high compared to the number of available training images. To address this problem, previous DL methods proposed to…

Image and Video Processing · Electrical Eng. & Systems 2019-11-22 Pierrick Coupé , Boris Mansencal , Michaël Clément , Rémi Giraud , Baudouin Denis de Senneville , Vinh-Thong Ta , Vincent Lepetit , José V. Manjon

Gradient based meta-learning methods are prone to overfit on the meta-training set, and this behaviour is more prominent with large and complex networks. Moreover, large networks restrict the application of meta-learning models on low-power…

Machine Learning · Computer Science 2022-06-06 Arnav Chavan , Rishabh Tiwari , Udbhav Bamba , Deepak K. Gupta

There is an increasing interest in applying deep learning to 3D mesh segmentation. We observe that 1) existing feature-based techniques are often slow or sensitive to feature resizing, 2) there are minimal comparative studies and 3)…

Graphics · Computer Science 2018-02-09 David George , Xianghua Xie , Gary KL Tam

We propose a novel deep convolutional neural network (CNN) based multi-task learning approach for open-set visual recognition. We combine a classifier network and a decoder network with a shared feature extractor network within a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Poojan Oza , Vishal M. Patel

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke