English
Related papers

Related papers: Fusing Global and Local: Transformer-CNN Synergy f…

200 papers

Recently, learned image compression methods have outperformed traditional hand-crafted ones including BPG. One of the keys to this success is learned entropy models that estimate the probability distribution of the quantized latent…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Jun-Hyuk Kim , Byeongho Heo , Jong-Seok Lee

An intelligent observer looks at the world and sees not only what is, but what is moving and what can be moved. In other words, the observer sees how the present state of the world can transform in the future. We propose a model that…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Andrew Jaegle , Oleh Rybkin , Konstantinos G. Derpanis , Kostas Daniilidis

The global and local contexts significantly contribute to the integrity of predictions in Salient Object Detection (SOD). Unfortunately, existing methods still struggle to generate complete predictions with fine details. There are two major…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yi Ke Yun , Weisi Lin

Transition prediction is an important aspect of aerodynamic design because of its impact on skin friction and potential coupling with flow separation characteristics. Traditionally, the modeling of transition has relied on correlation-based…

The rapid development of Wi-Fi technologies in recent years has caused a significant increase in the traffic usage. Hence, knowledge obtained from Wi-Fi network measurements can be helpful for a more efficient network management. In this…

Networking and Internet Architecture · Computer Science 2024-08-20 Seyedeh Soheila Shaabanzadeh , Juan Sánchez-González

The segmentation of medical images is important for the improvement and creation of healthcare systems, particularly for early disease detection and treatment planning. In recent years, the use of convolutional neural networks (CNNs) and…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Siddharth Tiwari

Smart power grids are one of the most complex cyber-physical systems, delivering electricity from power generation stations to consumers. It is critically important to know exactly the current state of the system as well as its state…

Systems and Control · Electrical Eng. & Systems 2021-02-12 Shahrzad Hadayeghparast , Amir Namavar Jahromi , Hadis Karimipour

Sensor fusion is critical to perception systems for task domains such as autonomous driving and robotics. Recently, the Transformer integrated with CNN has demonstrated high performance in sensor fusion for various perception tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Quoc-Vinh Lai-Dang , Jihui Lee , Bumgeun Park , Dongsoo Har

In this paper, we point out that the essential differences between CNN-based and Transformer-based detectors, which cause the worse performance of small objects in Transformer-based methods, are the gap between local information and global…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Dong Chen , Duoqian Miao , Xuerong Zhao

Recently, Convolutional Neural Network (CNN) or Transformer architecture based models have been proposed to overcome the limitations of Recurrent Neural Network (RNN) based models in spatiotemporal prediction. These models prevent the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hyeonseok Jin

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Convolutional neural networks (CNNs) and transformer architectures offer strengths for modeling temporal data: CNNs excel at capturing local patterns and translational invariances, while transformers effectively model long-range…

Machine Learning · Computer Science 2025-10-09 Stefano F. Stefenon , João P. Matos-Carvalho , Valderi R. Q. Leithardt , Kin-Choong Yow

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

In this article, we propose a novel standalone hybrid Spiking-Convolutional Neural Network (SC-NN) model and test on using image inpainting tasks. Our approach uses the unique capabilities of SNNs, such as event-based computation and…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Sanaullah , Kaushik Roy , Ulrich Rückert , Thorsten Jungeblut

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

Neuromorphic computing, which exploits Spiking Neural Networks (SNNs) on neuromorphic chips, is a promising energy-efficient alternative to traditional AI. CNN-based SNNs are the current mainstream of neuromorphic computing. By contrast, no…

Neural and Evolutionary Computing · Computer Science 2024-04-08 Man Yao , Jiakui Hu , Tianxiang Hu , Yifan Xu , Zhaokun Zhou , Yonghong Tian , Bo Xu , Guoqi Li

In this paper, we propose a method using the fusion of CNN and transformer structure to improve image classification performance. In the case of CNN, information about a local area on an image can be extracted well, but there is a limit to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Keong Hun Choi , Jin Woo Kim , Yao Wang , Jong Eun Ha

This paper introduces a robust stress detection system utilizing a Convolutional Neural Network (CNN) designed for the analysis of Photoplethysmogram (PPG) signals. Employing the WESAD dataset, we applied Continuous Wavelet Transform (CWT)…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yasin Hasanpoor , Amin Rostami , Bahram Tarvirdizadeh , Khalil Alipour , Mohammad Ghamari

This work presents a new approach for premixed turbulent combustion modeling based on convolutional neural networks (CNN). We first propose a framework to reformulate the problem of subgrid flame surface density estimation as a machine…

Fluid Dynamics · Physics 2019-08-02 C. J. Lapeyre , A. Misdariis , N. Cazard , D. Veynante , T. Poinsot