English
Related papers

Related papers: PlainUSR: Chasing Faster ConvNet for Efficient Sup…

200 papers

The success of CNN-based architecture on image classification in learning and extracting features made them so popular these days, but the task of image classification becomes more challenging when we apply state of art models to classify…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ashkan Ganj , Mohsen Ebadpour , Mahdi Darvish , Hamid Bahador

Recent progress in single-image super-resolution (SISR) has achieved remarkable performance, yet the computational costs of these methods remain a challenge for deployment on resource-constrained devices. In particular, transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Gang Wu , Junjun Jiang , Junpeng Jiang , Xianming Liu

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

The success of convolutional neural networks (CNNs) in computer vision applications has been accompanied by a significant increase of computation and memory costs, which prohibits its usage on resource-limited environments such as mobile or…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Yuchao Li , Cheng Deng , Xuelong Li

Convolutional Neural Networks (ConvNets) are commonly developed at a fixed resource budget, and then scaled up for better accuracy if more resources are available. In this paper, we systematically study model scaling and identify that…

Machine Learning · Computer Science 2020-09-14 Mingxing Tan , Quoc V. Le

Convolutional Neural Networks (CNNs) have achieved impressive results across many super-resolution (SR) and image restoration tasks. While many such networks can upscale low-resolution (LR) images using just the raw pixel-level information,…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Matthew Aquilina , Christian Galea , John Abela , Kenneth P. Camilleri , Reuben A. Farrugia

Pre-trained language models like BERT and its variants have recently achieved impressive performance in various natural language understanding tasks. However, BERT heavily relies on the global self-attention block and thus suffers large…

Computation and Language · Computer Science 2021-02-03 Zihang Jiang , Weihao Yu , Daquan Zhou , Yunpeng Chen , Jiashi Feng , Shuicheng Yan

Increasingly, convolution neural network (CNN) based super resolution models have been proposed for better reconstruction results, but their large model size and complicated structure inhibit their real-time hardware implementation. Current…

Hardware Architecture · Computer Science 2022-05-03 Dun-Hao Yang , Tian-Sheuan Chang

Convolutional neural networks (CNNs) have demonstrated superior performance in super-resolution (SR). However, most CNN-based SR methods neglect the different importance among feature channels or fail to take full advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Yue Lu , Yun Zhou , Zhuqing Jiang , Xiaoqiang Guo , Zixuan Yang

Convolutional Neural Networks (CNNs) are important for many machine learning tasks. They are built with different types of layers: convolutional layers that detect features, dropout layers that help to avoid over-reliance on any single…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Rinor Cakaj , Jens Mehnert , Bin Yang

The attention mechanism plays a pivotal role in designing advanced super-resolution (SR) networks. In this work, we design an efficient SR network by improving the attention mechanism. We start from a simple pixel attention module and…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Lin Zhou , Haoming Cai , Jinjin Gu , Zheyuan Li , Yingqi Liu , Xiangyu Chen , Yu Qiao , Chao Dong

Although remarkable progress has been made on single image super-resolution due to the revival of deep convolutional neural networks, deep learning methods are confronted with the challenges of computation and memory consumption in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Dehua Song , Chang Xu , Xu Jia , Yiyi Chen , Chunjing Xu , Yunhe Wang

Early-stage 3D brain tumor segmentation from magnetic resonance imaging (MRI) scans is crucial for prompt and effective treatment. However, this process faces the challenge of precise delineation due to the tumors' complex heterogeneity.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Ebtihal J. Alwadee , Xianfang Sun , Yipeng Qin , Frank C. Langbein

Deep convolutional neural networks (DCNNs) have recently demonstrated high-quality results in single-image super-resolution (SR). DCNNs often suffer from over-parametrization and large amounts of redundancy, which results in inefficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Yinglan Ma , Hongyu Xiong , Zhe Hu , Lizhuang Ma

The focus of this paper is speeding up the evaluation of convolutional neural networks. While delivering impressive results across a range of computer vision and machine learning tasks, these networks are computationally demanding, limiting…

Computer Vision and Pattern Recognition · Computer Science 2014-05-16 Max Jaderberg , Andrea Vedaldi , Andrew Zisserman

Recently, vision transformers started to show impressive results which outperform large convolution based models significantly. However, in the area of small models for mobile or resource constrained devices, ConvNet still has its own…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Haokui Zhang , Wenze Hu , Xiaoyu Wang

Convolutional neural networks have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Among recent advances in SISR, attention mechanisms are crucial for high-performance SR models. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoyu Chen , Jinjin Gu , Zhi Zhang

Deep learning-based super-resolution (SR) techniques have generally achieved excellent performance in the computer vision field. Recently, it has been proven that three-dimensional (3D) SR for medical volumetric data delivers better visual…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Yinhao Li , Yutaro Iwamoto , Lanfen Lin , Rui Xu , Yen-Wei Chen

Major winning Convolutional Neural Networks (CNNs), such as AlexNet, VGGNet, ResNet, GoogleNet, include tens to hundreds of millions of parameters, which impose considerable computation and memory overhead. This limits their practical use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Seyyed Hossein Hasanpour , Mohammad Rouhani , Mohsen Fayyaz , Mohammad Sabokrou

Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge…

Image and Video Processing · Electrical Eng. & Systems 2020-11-02 Francesco Salvetti , Vittorio Mazzia , Aleem Khaliq , Marcello Chiaberge