English
Related papers

Related papers: PETA: Photo Albums Event Recognition using Transfo…

200 papers

We introduce N-ImageNet, a large-scale dataset targeted for robust, fine-grained object recognition with event cameras. The dataset is collected using programmable hardware in which an event camera consistently moves around a monitor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Junho Kim , Jaehyeok Bae , Gangin Park , Dongsu Zhang , Young Min Kim

Event camera is an emerging bio-inspired vision sensors that report per-pixel brightness changes asynchronously. It holds noticeable advantage of high dynamic range, high speed response, and low power budget that enable it to best capture…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zhanpeng Shao , Wen Zhou , Wuzhen Wang , Jianyu Yang , Youfu Li

Data transformations (e.g. rotations, reflections, and cropping) play an important role in self-supervised learning. Typically, images are transformed into different views, and neural networks trained on tasks involving these views produce…

Machine Learning · Computer Science 2022-02-04 Chen Qiu , Timo Pfrommer , Marius Kloft , Stephan Mandt , Maja Rudolph

Recently, Transformer-based image restoration networks have achieved promising improvements over convolutional neural networks due to parameter-independent global interactions. To lower computational cost, existing works generally limit…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Jiale Zhang , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Visual place recognition tasks often encounter significant challenges in landmark detection due to the presence of irrelevant objects such as humans, cars, and trees, despite the remarkable progress achieved by previous models, especially…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Mohammad Javad Rajabi , Morteza Mirzai , Ahmad Nickabadi

Robust video scene classification models should capture the spatial (pixel-wise) and temporal (frame-wise) characteristics of a video effectively. Transformer models with self-attention which are designed to get contextualized…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Saurabh Sahu , Palash Goyal

Recognizing target objects using an event-based camera draws more and more attention in recent years. Existing works usually represent the event streams into point-cloud, voxel, image, etc, and learn the feature representations using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Chengguo Yuan , Yu Jin , Zongzhen Wu , Fanting Wei , Yangzirui Wang , Lan Chen , Xiao Wang

The event camera's low power consumption and ability to capture microsecond brightness changes make it attractive for various computer vision tasks. Existing event representation methods typically convert events into frames, voxel grids, or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Bin Jiang , Zhihao Li , M. Salman Asif , Xun Cao , Zhan Ma

Vision transformer (ViT) expands the success of transformer models from sequential data to images. The model decomposes an image into many smaller patches and arranges them into a sequence. Multi-head self-attentions are then applied to the…

Machine Learning · Computer Science 2023-03-27 Yiran Li , Junpeng Wang , Xin Dai , Liang Wang , Chin-Chia Michael Yeh , Yan Zheng , Wei Zhang , Kwan-Liu Ma

The Event-Enriched Image Analysis (EVENTA) Grand Challenge, hosted at ACM Multimedia 2025, introduces the first large-scale benchmark for event-level multimodal understanding. Traditional captioning and retrieval tasks largely focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Thien-Phuc Tran , Minh-Quang Nguyen , Minh-Triet Tran , Tam V. Nguyen , Trong-Le Do , Duy-Nam Ly , Viet-Tham Huynh , Khanh-Duy Le , Mai-Khiem Tran , Trung-Nghia Le

Professional photo editing remains challenging, requiring extensive knowledge of imaging pipelines and significant expertise. While recent deep learning approaches, particularly style transfer methods, have attempted to automate this…

Image and Video Processing · Electrical Eng. & Systems 2025-12-11 Omar Elezabi , Marcos V. Conde , Zongwei Wu , Radu Timofte

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang

The self-attention mechanism, a cornerstone of Transformer-based state-of-the-art deep learning architectures, is largely heuristic-driven and fundamentally challenging to interpret. Establishing a robust theoretical foundation to explain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Laziz U. Abdullaev , Maksim Tkachenko , Tan M. Nguyen

Transformer-based methods have shown impressive performance in low-level vision tasks, such as image super-resolution. However, we find that these networks can only utilize a limited spatial range of input information through attribution…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Xiangyu Chen , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Designed to learn long-range interactions on sequential data, transformers continue to show state-of-the-art results on a wide variety of tasks. In contrast to CNNs, they contain no inductive bias that prioritizes local interactions. This…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Patrick Esser , Robin Rombach , Björn Ommer

This paper addresses the novel challenge of ``rewinding'' time from a single captured image to recover the fleeting moments missed just before the shutter button is pressed. This problem poses a significant challenge in computer vision and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jingxi Chen , Brandon Y. Feng , Haoming Cai , Mingyang Xie , Christopher Metzler , Cornelia Fermuller , Yiannis Aloimonos

While the Transformer architecture has become ubiquitous in the machine learning field, its adaptation to 3D shape recognition is non-trivial. Due to its quadratic computational complexity, the self-attention operator quickly becomes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

In this paper we propose a new approach for classifying the global emotion of images containing groups of people. To achieve this task, we consider two different and complementary sources of information: i) a global representation of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Aarush Gupta , Dakshit Agrawal , Hardik Chauhan , Jose Dolz , Marco Pedersoli

Human visual recognition of activities or external agents involves an interplay between high-level plan recognition and low-level perception. Given that, a natural question to ask is: can low-level perception be improved by high-level plan…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yantian Zha , Yikang Li , Tianshu Yu , Subbarao Kambhampati , Baoxin Li

Event cameras are bio-inspired vision sensors that naturally capture the dynamics of a scene, filtering out redundant information. This paper presents a deep neural network approach that unlocks the potential of event cameras on a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Ana I. Maqueda , Antonio Loquercio , Guillermo Gallego , Narciso Garcia , Davide Scaramuzza