English
Related papers

Related papers: Gaze-Informed Vision Transformers: Predicting Driv…

200 papers

Vision Transformers (ViT) have marked a paradigm shift in computer vision, outperforming state-of-the-art models across diverse tasks. However, their practical deployment is hampered by high computational and memory demands. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Feiyang Chen , Ziqian Luo , Lisang Zhou , Xueting Pan , Ying Jiang

Recent advances of Transformers have brought new trust to computer vision tasks. However, on small dataset, Transformers is hard to train and has lower performance than convolutional neural networks. We make vision transformers as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Bin Chen , Ran Wang , Di Ming , Xin Feng

Object binding, the brain's ability to bind the many features that collectively represent an object into a coherent whole, is central to human cognition. It groups low-level perceptual features into high-level object representations, stores…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yihao Li , Saeed Salehi , Lyle Ungar , Konrad P. Kording

Vision Transformers (ViTs) have recently taken computer vision by storm. However, the softmax attention underlying ViTs comes with a quadratic complexity in time and memory, hindering the application of ViTs to high-resolution images. We…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Chuanyang Zheng

Rearrangement tasks have been identified as a crucial challenge for intelligent robotic manipulation, but few methods allow for precise construction of unseen structures. We propose a visual foresight model for pick-and-place rearrangement…

Robotics · Computer Science 2022-07-28 Hongtao Wu , Jikai Ye , Xin Meng , Chris Paxton , Gregory Chirikjian

What does human gaze reveal about a users' intents and to which extend can these intents be inferred or even visualized? Gaze was proposed as an implicit source of information to predict the target of visual search and, more recently, to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Hosnieh Sattar , Mario Fritz , Andreas Bulling

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

Recently, several Vision Transformer (ViT) based methods have been proposed for Fine-Grained Visual Classification (FGVC).These methods significantly surpass existing CNN-based ones, demonstrating the effectiveness of ViT in FGVC…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zi-Chao Zhang , Zhen-Duo Chen , Yongxin Wang , Xin Luo , Xin-Shun Xu

Recent advancements in medical image analysis have predominantly relied on Convolutional Neural Networks (CNNs), achieving impressive performance in chest X-ray classification tasks, such as the 92% AUC reported by AutoThorax-Net and the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Baljinnyam Dayan

Metal manufacturing often results in the production of defective products, leading to operational challenges. Since traditional manual inspection is time-consuming and resource-intensive, automatic solutions are needed. The study utilizes…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Toqa Alaa , Mostafa Kotb , Arwa Zakaria , Mariam Diab , Walid Gomaa

Recently, Deep Learning (DL) techniques have been used for User Equipment (UE) positioning. However, the key shortcomings of such models is that: i) they weigh the same attention to the entire input; ii) they are not well suited for the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Parshwa Shah , Dhaval K. Patel , Brijesh Soni , Miguel López-Benítez , Siddhartan Govindasamy

Intention prediction has become a relevant field of research in Human-Machine and Human-Robot Interaction. Indeed, any artificial system (co)-operating with and along humans, designed to assist and coordinate its actions with a human…

Robotics · Computer Science 2025-03-20 Anna Belardinelli

Machine learning models achieve high precision, but their decision-making processes often lack explainability. Furthermore, as model complexity increases, explainability typically decreases. Existing efforts to improve explainability…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Nicolas Echevarrieta-Catalan , Ana Ribas-Rodriguez , Francisco Cedron , Odelia Schwartz , Vanessa Aguiar-Pulido

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Built on top of self-attention mechanisms, vision transformers have demonstrated remarkable performance on a variety of vision tasks recently. While achieving excellent performance, they still require relatively intensive computational cost…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Lingchen Meng , Hengduo Li , Bor-Chun Chen , Shiyi Lan , Zuxuan Wu , Yu-Gang Jiang , Ser-Nam Lim

In the burgeoning field of intelligent transportation systems, enhancing vehicle-driver interaction through facial attribute recognition, such as facial expression, eye gaze, age, etc., is of paramount importance for safety,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Esmaeil Seraj , Walter Talamonti

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer

Vision Transformers have excelled in computer vision but their attention mechanisms operate independently across layers, limiting information flow and feature learning. We propose an effective cross-layer attention propagation method that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Swarnendu Banik , Manish Das , Shiv Ram Dubey , Satish Kumar Singh

Enhancing roadway safety has become an essential computer vision focus area for Intelligent Transportation Systems (ITS). As a part of ITS, Vehicle Trajectory Prediction (VTP) aims to forecast a vehicle's future positions based on its past…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Armin Danesh Pazho , Ghazal Alinezhad Noghre , Vinit Katariya , Hamed Tabkhi

Recently, Vision Transformers (ViTs) have attracted a lot of attention in the field of computer vision. Generally, the powerful representative capacity of ViTs mainly benefits from the self-attention mechanism, which has a high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Deli Yu , Teng Xi , Jianwei Li , Baopu Li , Gang Zhang , Haocheng Feng , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang