English
Related papers

Related papers: Model Rubik's Cube: Twisting Resolution, Depth and…

200 papers

Despite the promise of recent deep neural networks in the iris recognition setting, there are vital properties of the classic IrisCode which are almost unable to be achieved with current deep iris networks: the compactness of model and the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Kien Nguyen , Clinton Fookes , Sridha Sridharan

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

Deep neural networks have gained tremendous popularity in last few years. They have been applied for the task of classification in almost every domain. Despite the success, deep networks can be incredibly slow to train for even moderate…

Machine Learning · Computer Science 2018-10-11 Gaurav Singh , John Shawe-Taylor

Convolutional neural networks (CNNs) depend on deep network architectures to extract accurate information for image super-resolution. However, obtained information of these CNNs cannot completely express predicted high-quality images for…

Image and Video Processing · Electrical Eng. & Systems 2024-03-25 Chunwei Tian , Xuanyu Zhang , Qi Zhang , Mingming Yang , Zhaojie Ju

Very deep convolutional neural networks offer excellent recognition results, yet their computational expense limits their impact for many real-world applications. We introduce BlockDrop, an approach that learns to dynamically choose which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Zuxuan Wu , Tushar Nagarajan , Abhishek Kumar , Steven Rennie , Larry S. Davis , Kristen Grauman , Rogerio Feris

Significant progress has been made in boundary detection with the help of convolutional neural networks. Recent boundary detection models not only focus on real object boundary detection but also "crisp" boundaries (precisely localized…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Yi-Jun Cao , Chuan Lin , Yong-Jie Li

Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems. Also, conventional networks fix the architecture before training starts; as a result, training cannot improve the…

Neural and Evolutionary Computing · Computer Science 2015-11-03 Song Han , Jeff Pool , John Tran , William J. Dally

Despite the success of deep neural networks (DNNs), state-of-the-art models are too large to deploy on low-resource devices or common server configurations in which multiple models are held in memory. Model compression methods address this…

Deep neural networks are powerful learning models that achieve state-of-the-art performance on many computer vision, speech, and language processing tasks. In this paper, we study a fundamental question that arises when designing deep…

Machine Learning · Statistics 2017-10-24 Shiva Prasad Kasiviswanathan , Nina Narodytska , Hongxia Jin

Network pruning is an effective method to reduce the computational expense of over-parameterized neural networks for deployment on low-resource systems. Recent state-of-the-art techniques for retraining pruned networks such as weight…

Machine Learning · Computer Science 2021-05-10 Duong H. Le , Binh-Son Hua

The success of neural networks has driven a shift in focus from feature engineering to architecture engineering. However, successful networks today are constructed using a small and manually defined set of building blocks. Even in methods…

Machine Learning · Computer Science 2019-11-19 Mitchell Wortsman , Ali Farhadi , Mohammad Rastegari

As the complexity and computational demands of deep learning models rise, the need for effective optimization methods for neural network designs becomes paramount. This work introduces an innovative search mechanism for automatically…

Machine Learning · Computer Science 2024-08-12 Seyedarmin Azizi , Mahdi Nazemi , Arash Fayyazi , Massoud Pedram

The resource requirements of deep neural networks (DNNs) pose significant challenges to their deployment on edge devices. Common approaches to address this issue are pruning and mixed-precision quantization, which lead to latency and memory…

Neural network algorithms simulated on standard computing platforms typically make use of high resolution weights, with floating-point notation. However, for dedicated hardware implementations of such algorithms, fixed-point synaptic…

Neural and Evolutionary Computing · Computer Science 2015-04-23 Lorenz K. Muller , Giacomo Indiveri

Deep learning stands as the modern paradigm for solving cognitive tasks. However, as the problem complexity increases, models grow deeper and computationally prohibitive, hindering advancements in real-world and resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Gustavo Henrique do Nascimento , Ian Pons , Anna Helena Reali Costa , Artur Jordao

Deep learning has achieved state-of-the-art accuracies on several computer vision tasks. However, the computational and energy requirements associated with training such deep neural networks can be quite high. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Aosong Feng , Priyadarshini Panda

We present a hardware-efficient architecture of convolutional neural network, which has a repvgg-like architecture. Flops or parameters are traditional metrics to evaluate the efficiency of networks which are not sensitive to hardware…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Kaiheng Weng , Xiangxiang Chu , Xiaoming Xu , Junshi Huang , Xiaoming Wei

Complicated and deep neural network models can achieve high accuracy for image recognition. However, they require a huge amount of computations and model parameters, which are not suitable for mobile and embedded devices. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Hong-Yen Chen , Chung-Yen Su

We propose methodologies to train highly accurate and efficient deep convolutional neural networks (CNNs) for image super resolution (SR). A cascade training approach to deep learning is proposed to improve the accuracy of the neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

The expanding scale of large neural network models introduces significant challenges, driving efforts to reduce memory usage and enhance computational efficiency. Such measures are crucial to ensure the practical implementation and…

Machine Learning · Computer Science 2025-02-14 Eduardo Lobo Lustosa Cabral , Larissa Driemeier