English
Related papers

Related papers: Rethinking the Role of Spatial Mixing

200 papers

Following the traditional paradigm of convolutional neural networks (CNNs), modern CNNs manage to keep pace with more recent, for example transformer-based, models by not only increasing model depth and width but also the kernel size. This…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Paul Gavrikov , Janis Keuper

Classification of EEG signals using shallow Convolutional Neural Networks (CNNs) is a prevalent and successful approach across a variety of fields. Most of these models use independent one-dimensional (1D) convolutional layers along the…

Machine Learning · Computer Science 2026-05-06 Laurits Dixen , Stefan Heinrich , Paolo Burelli

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

This paper introduces versatile filters to construct efficient convolutional neural networks that are widely used in various visual recognition tasks. Considering the demands of efficient deep learning techniques running on cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Kai Han , Yunhe Wang , Chang Xu , Chunjing Xu , Enhua Wu , Dacheng Tao

We integrate two powerful ideas, geometry and deep visual representation learning, into recurrent network architectures for mobile visual scene understanding. The proposed networks learn to "lift" and integrate 2D visual features over time…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Hsiao-Yu Fish Tung , Ricson Cheng , Katerina Fragkiadaki

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

We cast shape matching as metric learning with convolutional networks. We break the end-to-end process of image representation into two parts. Firstly, well established efficient methods are chosen to turn the images into edge maps.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Filip Radenović , Giorgos Tolias , Ondřej Chum

Convolutional Neural Networks define an exceptionally powerful class of models, but are still limited by the lack of ability to be spatially invariant to the input data in a computationally and parameter efficient manner. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2016-02-05 Max Jaderberg , Karen Simonyan , Andrew Zisserman , Koray Kavukcuoglu

Very recently, Window-based Transformers, which computed self-attention within non-overlapping local windows, demonstrated promising results on image classification, semantic segmentation, and object detection. However, less study has been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Zilong Huang , Youcheng Ben , Guozhong Luo , Pei Cheng , Gang Yu , Bin Fu

Despite the tremendous success in computer vision, deep convolutional networks suffer from serious computation costs and redundancies. Although previous works address this issue by enhancing diversities of filters, they have not considered…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yang Hu , Guihua Wen , Mingnan Luo , Dan Dai , Wenming Cao , Zhiwen Yu , Wendy Hall

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

While scale-invariant modeling has substantially boosted the performance of visual recognition tasks, it remains largely under-explored in deep networks based image restoration. Naively applying those scale-invariant techniques (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Yuchen Fan , Jiahui Yu , Ding Liu , Thomas S. Huang

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for image recognition problems. Nevertheless, it is not trivial when utilizing a CNN for learning spatio-temporal video representation. A few studies have…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Zhaofan Qiu , Ting Yao , Tao Mei

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Convolutional Neural Networks (CNN) have been pivotal to the success of many state-of-the-art classification problems, in a wide variety of domains (for e.g. vision, speech, graphs and medical imaging). A commonality within those domains is…

Machine Learning · Computer Science 2019-12-02 Rohan Ghosh , Anupam K. Gupta , Mehul Motani

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

Modern artificial neural networks, including convolutional neural networks and vision transformers, have mastered several computer vision tasks, including object recognition. However, there are many significant differences between the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Tiago Oliveira , Tiago Marques , Arlindo L. Oliveira

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Shuang Xu , Zixiang Zhao , Yicheng Wang , Chunxia Zhang , Junmin Liu , Jiangshe Zhang

Classical image filters, such as those for averaging or differencing, are carefully normalized to ensure consistency, interpretability, and to avoid artifacts like intensity shifts, halos, or ringing. In contrast, convolutional filters…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Gustavo Perez , Stella X. Yu

Traditional computer graphics rendering pipeline is designed for procedurally generating 2D quality images from 3D shapes with high performance. The non-differentiability due to discrete operations such as visibility computation makes it…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Thu Nguyen-Phuoc , Chuan Li , Stephen Balaban , Yong-Liang Yang