English
Related papers

Related papers: UniRepLKNet: A Universal Perception Large-Kernel C…

200 papers

By contextualizing the kernel as global as possible, Modern ConvNets have shown great potential in computer vision tasks. However, recent progress on multi-order game-theoretic interaction within deep neural networks (DNNs) reveals the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Siyuan Li , Zedong Wang , Zicheng Liu , Cheng Tan , Haitao Lin , Di Wu , Zhiyuan Chen , Jiangbin Zheng , Stan Z. Li

The U-shaped architecture has emerged as a crucial paradigm in the design of medical image segmentation networks. However, due to the inherent local limitations of convolution, a fully convolutional segmentation network with U-shaped…

Image and Video Processing · Electrical Eng. & Systems 2023-08-04 Fenghe Tang , Jianrui Ding , Lingtao Wang , Chunping Ning , S. Kevin Zhou

Although deep convolutional neural networks (CNNs) have achieved great success in computer vision tasks, its real-world application is still impeded by its voracious demand of computational resources. Current works mostly seek to compress…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Chen Zhao , Bernard Ghanem

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Images play a vital role in understanding data through visual representation. It gives a clear representation of the object in context. But if this image is not clear it might not be of much use. Thus, the topic of Image Super Resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Umashankar Kumaravelan , Nivedita M

In recent years, significant advancements have been made in deep learning for medical image segmentation, particularly with convolutional neural networks (CNNs) and transformer models. However, CNNs face limitations in capturing long-range…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Juntao Jiang , Jiangning Zhang , Weixuan Liu , Muxuan Gao , Xiaobin Hu , Zhucun Xue , Yong Liu , Shuicheng Yan

Many problems in science and engineering can be formulated in terms of geometric patterns in high-dimensional spaces. We present high-dimensional convolutional networks (ConvNets) for pattern recognition problems that arise in the context…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Christopher Choy , Junha Lee , Rene Ranftl , Jaesik Park , Vladlen Koltun

As a representative of a new generation of biometrics, vein identification technology offers a high level of security and convenience.Convolutional neural networks (CNNs), a prominent class of deep learning architectures, have been…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xin Jin , Hongyu Zhu , Mounîm A. El Yacoubi , Haiyang Li , Hongchao Liao , Huafeng Qin , Yun Jiang

Accurate image segmentation plays a crucial role in medical image analysis, yet it faces great challenges of various shapes, diverse sizes, and blurry boundaries. To address these difficulties, square kernel-based encoder-decoder…

Image and Video Processing · Electrical Eng. & Systems 2022-01-02 Qian Yu , Lei Qi , Luping Zhou , Lei Wang , Yilong Yin , Yinghuan Shi , Wuzhang Wang , Yang Gao

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision transformer into…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 René Ranftl , Alexey Bochkovskiy , Vladlen Koltun

In recent years, deep neural networks have played a major role solving various challenges in two dimensional image processing.Fully Convolutional Networks (FCN) such as U-net have been shown to be highly successful at segmentation tasks for…

Signal Processing · Electrical Eng. & Systems 2020-04-22 Noam Katz

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

This document will review the most prominent proposals using multilayer convolutional architectures. Importantly, the various components of a typical convolutional network will be discussed through a review of different approaches that base…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Isma Hadji , Richard P. Wildes

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Traditional computer graphics rendering pipeline is designed for procedurally generating 2D quality images from 3D shapes with high performance. The non-differentiability due to discrete operations such as visibility computation makes it…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Thu Nguyen-Phuoc , Chuan Li , Stephen Balaban , Yong-Liang Yang

Depthwise convolution is becoming increasingly popular in modern efficient ConvNets, but its kernel size is often overlooked. In this paper, we systematically study the impact of different kernel sizes, and observe that combining the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Mingxing Tan , Quoc V. Le

In recent years Deep Learning has brought about a breakthrough in Medical Image Segmentation. U-Net is the most prominent deep network in this regard, which has been the most popular architecture in the medical imaging community. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Nabil Ibtehaz , M. Sohel Rahman

U-Nets are among the most widely used architectures in computer vision, renowned for their exceptional performance in applications such as image segmentation, denoising, and diffusion modeling. However, a theoretical explanation of the…

Machine Learning · Computer Science 2024-05-02 Song Mei

The Transformer architecture has achieved significant success in natural language processing, motivating its adaptation to computer vision tasks. Unlike convolutional neural networks, vision transformers inherently capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zherui Zhang , Rongtao Xu , Jie Zhou , Changwei Wang , Xingtian Pei , Wenhao Xu , Jiguang Zhang , Li Guo , Longxiang Gao , Wenbo Xu , Shibiao Xu

High-resolution representations are essential for position-sensitive vision problems, such as human pose estimation, semantic segmentation, and object detection. Existing state-of-the-art frameworks first encode the input image as a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Jingdong Wang , Ke Sun , Tianheng Cheng , Borui Jiang , Chaorui Deng , Yang Zhao , Dong Liu , Yadong Mu , Mingkui Tan , Xinggang Wang , Wenyu Liu , Bin Xiao