English
Related papers

Related papers: HDI-Former: Hybrid Dynamic Interaction ANN-SNN Tra…

200 papers

Human Activity Recognition (HAR) has recently witnessed advancements with Transformer-based models. Especially, ActionFormer shows us a new perspectives for HAR in the sense that this approach gives us additional outputs which detect the…

Machine Learning · Computer Science 2025-05-28 Kunpeng Zhao , Asahi Miyazaki , Tsuyoshi Okita

Transformer-based methods have shown impressive performance in low-level vision tasks, such as image super-resolution. However, we find that these networks can only utilize a limited spatial range of input information through attribution…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Xiangyu Chen , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Spiking neural networks (SNNs) have garnered significant attention for their low power consumption and high biological interpretability. Their rich spatio-temporal information processing capability and event-driven nature make them ideally…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Xian Zhong , Shengwang Hu , Wenxuan Liu , Wenxin Huang , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for accuracy. However,…

Neural and Evolutionary Computing · Computer Science 2024-09-05 Yuetong Fang , Ziqing Wang , Lingfeng Zhang , Jiahang Cao , Honglei Chen , Renjing Xu

Human Interaction Recognition is the process of identifying interactive actions between multiple participants in a specific situation. The aim is to recognise the action interactions between multiple entities and their meaning. Many single…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ruoqi Yin , Jianqin Yin

In this paper, we point out that the essential differences between CNN-based and Transformer-based detectors, which cause the worse performance of small objects in Transformer-based methods, are the gap between local information and global…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Dong Chen , Duoqian Miao , Xuerong Zhao

Automotive embedded algorithms have very high constraints in terms of latency, accuracy and power consumption. In this work, we propose to train spiking neural networks (SNNs) directly on data coming from event cameras to design fast and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Loïc Cordone , Benoît Miramond , Philippe Thierion

Event-based cameras are attracting significant interest as they provide rich edge information, high dynamic range, and high temporal resolution. Many state-of-the-art event-based algorithms rely on splitting the events into fixed groups,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jiahang Cao , Mingyuan Sun , Ziqing Wang , Hao Cheng , Qiang Zhang , Shibo Zhou , Renjing Xu

This paper explores the promising interplay between spiking neural networks (SNNs) and event-based cameras for privacy-preserving human action recognition (HAR). The unique feature of event cameras in capturing only the outlines of motion,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Siyuan Yang , Shilin Lu , Shizheng Wang , Meng Hwa Er , Zengwei Zheng , Alex C. Kot

Spiking neural networks (SNNs) have shown clear advantages over traditional artificial neural networks (ANNs) for low latency and high computational efficiency, due to their event-driven nature and sparse communication. However, the…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Jibin Wu , Chenglin Xu , Daquan Zhou , Haizhou Li , Kay Chen Tan

Eye tracking for wearable systems demands low latency and milliwatt-level power, but conventional frame-based pipelines struggle with motion blur, high compute cost, and limited temporal resolution. Such capabilities are vital for enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Paul Hueber , Luca Peres , Florian Pitters , Alejandro Gloriani , Oliver Rhodes

We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major drawbacks; they cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Masato Tamura , Hiroki Ohashi , Tomoaki Yoshinaga

In the era of AI at the edge, self-driving cars, and climate change, the need for energy-efficient, small, embedded AI is growing. Spiking Neural Networks (SNNs) are a promising approach to address this challenge, with their event-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Lennard Bodden , Franziska Schwaiger , Duc Bach Ha , Lars Kreuzberg , Sven Behnke

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

Applications in the Internet of Video Things (IoVT) domain have very tight constraints with respect to power and area. While neuromorphic vision sensors (NVS) may offer advantages over traditional imagers in this domain, the existing NVS…

Image and Video Processing · Electrical Eng. & Systems 2020-03-20 Deepak Singla , Soham Chatterjee , Lavanya Ramapantulu , Andres Ussa , Bharath Ramesh , Arindam Basu

Standard frame-based cameras that sample light intensity frames are heavily impacted by motion blur for high-speed motion and fail to perceive scene accurately when the dynamic range is high. Event-based cameras, on the other hand, overcome…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Chankyu Lee , Adarsh Kumar Kosta , Kaushik Roy

Autonomous Driving (AD) related features represent important elements for the next generation of mobile robots and autonomous vehicles focused on increasingly intelligent, autonomous, and interconnected systems. The applications involving…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Alberto Viale , Alberto Marchisio , Maurizio Martina , Guido Masera , Muhammad Shafique

Scene graph generation (SGG) and human-object interaction (HOI) detection are two important visual tasks aiming at localising and recognising relationships between objects, and interactions between humans and objects, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Object detection typically assumes that training and test data are drawn from an identical distribution, which, however, does not always hold in practice. Such a distribution mismatch will lead to a significant performance drop. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Yuhua Chen , Wen Li , Christos Sakaridis , Dengxin Dai , Luc Van Gool