English
Related papers

Related papers: Towards Attention-aware Foveated Rendering

200 papers

Many animals and humans process the visual field with a varying spatial resolution (foveated vision) and use peripheral processing to make eye movements and point the fovea to acquire high-resolution information about objects of interest.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Aditya Jonnalagadda , William Yang Wang , B. S. Manjunath , Miguel P. Eckstein

Spatiotemporal sensitivity to high frequency information declines with increased peripheral eccentricity. Foveated rendering exploits this by decreasing the spatial resolution of rendered images in peripheral vision, reducing the rendering…

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongkai Chen , Zixin Luo , Yurun Tian , Xuyang Bai , Ziyu Wang , Lei Zhou , Mingmin Zhen , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Recent progress in pretrained Transformer-based language models has shown great success in learning contextual representation of text. However, due to the quadratic self-attention complexity, most of the pretrained Transformers models can…

Computation and Language · Computer Science 2021-10-22 Peng Xu , Xinchi Chen , Xiaofei Ma , Zhiheng Huang , Bing Xiang

Previous studies have proposed image-based clutter measures that correlate with human search times and/or eye movements. However, most models do not take into account the fact that the effects of clutter interact with the foveated nature of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Arturo Deza , Miguel P. Eckstein

The Human visual perception of the world is of a large fixed image that is highly detailed and sharp. However, receptor density in the retina is not uniform: a small central region called the fovea is very dense and exhibits high…

Computer Vision and Pattern Recognition · Computer Science 2017-01-26 Alon Hazan , Yuval Harel , Ron Meir

Foveation and focus cue are the two most discussed topics on vision in designing near-eye displays. Foveation reduces rendering load by omitting spatial details in the content that the peripheral vision cannot appreciate; Providing richer…

Graphics · Computer Science 2019-11-11 Qi Sun , Fu-Chung Huang , Li-Yi Wei , David Luebke , Arie Kaufman , Joohwan Kim

Parsing urban scene images benefits many applications, especially self-driving. Most of the current solutions employ generic image parsing models that treat all scales and locations in the images equally and do not consider the geometry…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xin Li , Zequn Jie , Wei Wang , Changsong Liu , Jimei Yang , Xiaohui Shen , Zhe Lin , Qiang Chen , Shuicheng Yan , Jiashi Feng

Scene text recognition has been a hot research topic in computer vision due to its various applications. The state of the art is the attention-based encoder-decoder framework that learns the mapping between input images and output sequences…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Zhanzhan Cheng , Fan Bai , Yunlu Xu , Gang Zheng , Shiliang Pu , Shuigeng Zhou

Deep learning architectures are an extremely powerful tool for recognizing and classifying images. However, they require supervised learning and normally work on vectors the size of image pixels and produce the best results when trained on…

Machine Learning · Computer Science 2020-10-20 Ryan Burt , Nina N. Thigpen , Andreas Keil , Jose C. Principe

Fast reactions to changes in the surrounding visual environment require efficient attention mechanisms to reallocate computational resources to most relevant locations in the visual field. While current computational models keep improving…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Lapo Faggi , Alessandro Betti , Dario Zanca , Stefano Melacci , Marco Gori

The transformer-based semantic segmentation approaches, which divide the image into different regions by sliding windows and model the relation inside each window, have achieved outstanding success. However, since the relation modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zizhang Wu , Yuanzhu Gan , Tianhao Xu , Fan Wang

Virtual reality finds various applications in productivity, entertainment, and training scenarios requiring working memory and attentional resources. Working memory relies on prioritizing relevant information and suppressing irrelevant…

Human-Computer Interaction · Computer Science 2024-12-31 Francesco Chiossi , Changkun Ou , Carolina Gerhardt , Felix Putze , Sven Mayer

In this paper, a study aimed at investigating the effects of real (using eye tracking to determine the fixation) and simulated foveated blurring in immersive Virtual Reality is presented. Techniques to reduce the optical flow perceived at…

Human-Computer Interaction · Computer Science 2021-07-06 Ariel Caputo , Andrea Giachetti , Salwa Abkal , Chiara Marchesini , Massimo Zancanaro

In the domain of intelligent transportation systems (ITS), collaborative perception has emerged as a promising approach to overcome the limitations of individual perception by enabling multiple agents to exchange information, thus enhancing…

Multiagent Systems · Computer Science 2023-05-04 Ahmed N. Ahmed , Siegfried Mercelis , Ali Anwar

Virtual reality (VR) significantly transforms immersive digital interfaces, greatly enhancing education, professional practices, and entertainment by increasing user engagement and opening up new possibilities in various industries. Among…

Graphics · Computer Science 2025-07-08 Shuo Xin , Haiyu Wang , Sai Qian Zhang

Active perception and foveal vision are the foundations of the human visual system. While foveal vision reduces the amount of information to process during a gaze fixation, active perception will change the gaze direction to the most…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Alexandre M. F. Dias , Luís Simões , Plinio Moreno , Alexandre Bernardino

In spite of the recent advancements in multi-object tracking, occlusion poses a significant challenge. Multi-camera setups have been used to address this challenge by providing a comprehensive coverage of the scene. Recent multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Reef Alturki , Adrian Hilton , Jean-Yves Guillemaut

Vision Transformers are very popular nowadays due to their state-of-the-art performance in several computer vision tasks, such as image classification and action recognition. Although their performance has been greatly enhanced through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dimitrios Konstantinidis , Ilias Papastratis , Kosmas Dimitropoulos , Petros Daras