English
Related papers

Related papers: Adaptative Inference Cost With Convolutional Neura…

200 papers

Ensemble techniques are frequently encountered in machine learning and engineering problems since the method combines different models and produces an optimal predictive solution. The ensemble concept can be adapted to deep learning models…

Automatic modulation classification (AMC) is of crucial importance for realizing wireless intelligence communications. Many deep learning based models especially convolution neural networks (CNNs) have been proposed for AMC. However, the…

Signal Processing · Electrical Eng. & Systems 2021-08-24 Hao Zhang , Lu Yuan , Guangyu Wu , Fuhui Zhou , Qihui Wu

The high computation, memory, and power budgets of inferring convolutional neural networks (CNNs) are major bottlenecks of model deployment to edge computing platforms, e.g., mobile devices and IoT. Moreover, training CNNs is time and…

Machine Learning · Computer Science 2021-07-09 Mostafa Elhoushi , Zihao Chen , Farhan Shafiq , Ye Henry Tian , Joey Yiwei Li

Structured pruning is a popular method to reduce the cost of convolutional neural networks, that are the state of the art in many computer vision tasks. However, depending on the architecture, pruning introduces dimensional discrepancies…

Neural and Evolutionary Computing · Computer Science 2022-12-13 Hugo Tessier , Vincent Gripon , Mathieu Léonardon , Matthieu Arzel , David Bertrand , Thomas Hannagan

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xin Li , Changsong Liu

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Training Convolutional Neural Networks (CNN) is a resource intensive task that requires specialized hardware for efficient computation. One of the most limiting bottleneck of CNN training is the memory cost associated with storing the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Tristan Hascoet , Quentin Febvre , Yasuo Ariki , Tetsuya Takiguchi

Convolutional neural networks (CNNs) have shown exceptional performance for a range of medical imaging tasks. However, conventional CNNs are not able to explain their reasoning process, therefore limiting their adoption in clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Linde S. Hesse , Ana I. L. Namburete

State-of-the-art convolutional neural networks (CNNs) used in vision applications have large models with numerous weights. Training these models is very compute- and memory-resource intensive. Much research has been done on pruning or…

Machine Learning · Computer Science 2019-12-10 Sangkug Lym , Esha Choukse , Siavash Zangeneh , Wei Wen , Sujay Sanghavi , Mattan Erez

Convolutional Neural Networks (CNNs) are extremely computationally demanding, presenting a large barrier to their deployment on resource-constrained devices. Since such systems are where some of their most useful applications lie (e.g.…

Machine Learning · Statistics 2018-09-20 Jack Turner , José Cano , Valentin Radu , Elliot J. Crowley , Michael O'Boyle , Amos Storkey

Deep convolutional neural networks have achieved great success in various applications. However, training an effective DNN model for a specific task is rather challenging because it requires a prior knowledge or experience to design the…

Machine Learning · Computer Science 2018-06-06 Sheng-Jun Huang , Jia-Wei Zhao , Zhao-Yang Liu

In this paper, we explore a novel image matting task aimed at achieving efficient inference under various computational cost constraints, specifically FLOP limitations, using a single matting network. Existing matting methods which have not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Qinglin Liu , Zonglin Li , Xiaoqian Lv , Xin Sun , Ru Li , Shengping Zhang

In the large-scale image retrieval task, the two most important requirements are the discriminability of image representations and the efficiency in computation and storage of representations. Regarding the former requirement, Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Huu Le , Tam V. Nguyen , Ngai-Man Cheung

The kernel embedding algorithm is an important component for adapting kernel methods to large datasets. Since the algorithm consumes a major computation cost in the testing phase, we propose a novel teacher-learner framework of learning…

Machine Learning · Statistics 2017-12-08 Jianqiao Wangni , Jingwei Zhuo , Jun Zhu

In recent years, there have been many popular Convolutional Neural Networks (CNNs), such as Google's Inception-V4, that have performed very well for various image classification problems. These commonly used CNN models usually use the same…

Neural and Evolutionary Computing · Computer Science 2019-07-01 Luna M. Zhang

The recent ground-breaking advances in deep learning networks ( DNNs ) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-limited embedded devices. Offloading the…

Performance · Computer Science 2018-05-14 Ben Taylor , Vicent Sanz Marco , Willy Wolff , Yehia Elkhatib , Zheng Wang

Although deep convolutional neural networks (CNNs) have achieved great success in computer vision tasks, its real-world application is still impeded by its voracious demand of computational resources. Current works mostly seek to compress…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Chen Zhao , Bernard Ghanem

Convolutional neural networks (CNNs) have obtained astounding successes for important pattern recognition tasks, but they suffer from high computational complexity and the lack of interpretability. The recent Tsetlin Machine (TM) attempts…

Machine Learning · Computer Science 2019-12-30 Ole-Christoffer Granmo , Sondre Glimsdal , Lei Jiao , Morten Goodwin , Christian W. Omlin , Geir Thore Berge

The capabilities and adoption of deep neural networks (DNNs) grow at an exhilarating pace: Vision models accurately classify human actions in videos and identify cancerous tissue in medical scans as precisely than human experts; large…

Machine Learning · Computer Science 2023-06-26 Lukas Hedegaard

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez