English
Related papers

Related papers: Accelerating Deep Neural Networks with Spatial Bot…

200 papers

Convolutional neural networks are the way to solve arbitrary image segmentation tasks. However, when images are large, memory demands often exceed the available resources, in particular on a common GPU. Especially in biomedical imaging,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Marco Reisert , Maximilian Russe , Samer Elsheikh , Elias Kellner , Henrik Skibbe

Most current semantic segmentation approaches fall back on deep convolutional neural networks (CNNs). However, their use of convolution operations with local receptive fields causes failures in modeling contextual spatial relations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Early diagnosis is essential for the successful treatment of bowel cancers including colorectal cancer (CRC) and capsule endoscopic imaging with robotic actuation can be a valuable diagnostic tool when combined with automated image…

In this paper, we present a new approach for model acceleration by exploiting spatial sparsity in visual data. We observe that the final prediction in vision Transformers is only based on a subset of the most informative tokens, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yongming Rao , Zuyan Liu , Wenliang Zhao , Jie Zhou , Jiwen Lu

This paper aims to accelerate the test-time computation of convolutional neural networks (CNNs), especially very deep CNNs that have substantially impacted the computer vision community. Unlike previous methods that are designed for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Xiangyu Zhang , Jianhua Zou , Kaiming He , Jian Sun

While scale-invariant modeling has substantially boosted the performance of visual recognition tasks, it remains largely under-explored in deep networks based image restoration. Naively applying those scale-invariant techniques (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Yuchen Fan , Jiahui Yu , Ding Liu , Thomas S. Huang

Over the past decade, deep learning research has been accelerated by increasingly powerful hardware, which facilitated rapid growth in the model complexity and the amount of data ingested. This is becoming unsustainable and therefore…

Machine Learning · Computer Science 2024-02-08 Damian Owerko , Charilaos I. Kanatsoulis , Alejandro Ribeiro

Training the deep convolutional neural network for computer vision problems is slow and inefficient, especially when it is large and distributed across multiple devices. The inefficiency is caused by the backpropagation algorithm's forward…

Machine Learning · Computer Science 2022-01-20 An Xu , Zhouyuan Huo , Heng Huang

Photonic technologies have shown a promising way to build high-speed and high-energy-efficiency neural network accelerators. In previously presented photonic neural networks, architectures are mainly designed for fully-connected layers.…

Signal Processing · Electrical Eng. & Systems 2020-03-02 Shaofu Xu , Jing Wang , Weiwen Zou

Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of…

Machine Learning · Statistics 2025-11-18 Biyi Fang , Truong Vo , Jean Utke , Diego Klabjan

Recent advances in data-generating techniques led to an explosive growth of geo-spatiotemporal data. In domains such as hydrology, ecology, and transportation, interpreting the complex underlying patterns of spatiotemporal interactions with…

Machine Learning · Computer Science 2023-01-30 Aishwarya Sarkar , Chaoqun Lu , Ali Jannesari

An ability to generalize unconstrained conditions such as severe occlusions and large pose variations remains a challenging goal to achieve in face alignment. In this paper, a multistage model based on deep neural networks is proposed which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Huabin Wang , Rui Cheng , Jian Zhou , Liang Tao , Hon Keung Kwan

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

Given the success of the deep convolutional neural networks (DCNNs) in applications of visual recognition and classification, it would be tantalizing to test if DCNNs can also learn spatial concepts, such as straightness, convexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Xi Zhang , Xiaolin Wu , Jun Du

In this paper, we propose a multi-scale deep feature learning method for high-resolution satellite image classification. Specifically, we firstly warp the original satellite image into multiple different scales. The images in each scale are…

Computer Vision and Pattern Recognition · Computer Science 2016-11-14 Qingshan Liu , Renlong Hang , Huihui Song , Zhi Li

In this paper, we propose and study a technique to reduce the number of parameters and computation time in convolutional neural networks. We use Kronecker product to exploit the local structures within convolution and fully-connected…

Computer Vision and Pattern Recognition · Computer Science 2016-02-05 Shuchang Zhou , Jia-Nan Wu , Yuxin Wu , Xinyu Zhou

Deep neural networks are playing an important role in state-of-the-art visual recognition. To represent high-level visual concepts, modern networks are equipped with large convolutional layers, which use a large number of filters and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Yan Wang , Lingxi Xie , Ya Zhang , Wenjun Zhang , Alan Yuille

Successful training of convolutional neural networks is often associated with sufficiently deep architectures composed of high amounts of features. These networks typically rely on a variety of regularization and pruning techniques to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Martin Mundt , Tobias Weis , Kishore Konda , Visvanathan Ramesh

Deep neural networks face several challenges in hyperspectral image classification, including insufficient utilization of joint spatial-spectral information, gradient vanishing with increasing depth, and overfitting. To enhance feature…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guandong Li , Mengxia Ye

Convolutional neural networks have achieved great success in various vision tasks; however, they incur heavy resource costs. By using deeper and wider networks, network accuracy can be improved rapidly. However, in an environment with…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Yunho Jeon , Junmo Kim