English
Related papers

Related papers: AssembleNet++: Assembling Modality Representations…

200 papers

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

In this paper we propose an extension of the Attention Branch Network (ABN) by using instance segmentation for generating sharper attention maps for action recognition. Methods for visual explanation such as Grad-CAM usually generate blurry…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Tomoya Nitta , Tsubasa Hirakawa , Hironobu Fujiyoshi , Toru Tamaki

Inspired by the human cognitive system, attention is a mechanism that imitates the human cognitive awareness about specific information, amplifying critical details to focus more on the essential aspects of data. Deep learning has employed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Mohammed Hassanin , Saeed Anwar , Ibrahim Radwan , Fahad S Khan , Ajmal Mian

Sports videos pose complex challenges, including cluttered backgrounds, camera angle changes, small action-representing objects, and imbalanced action class distribution. Existing methods for detecting actions in sports videos heavily rely…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Kim Hoang Tran , Phuc Vuong Do , Ngoc Quoc Ly , Ngan Le

Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms compute input-dependent dynamic attention weights for…

Machine Learning · Computer Science 2019-12-03 Lanqing Xue , Xiaopeng Li , Nevin L. Zhang

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

In this paper we propose to augment a modern neural-network architecture with an attention model inspired by human perception. Specifically, we adversarially train and analyze a neural model incorporating a human inspired, visual attention…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Daniel Zoran , Mike Chrzanowski , Po-Sen Huang , Sven Gowal , Alex Mott , Pushmeet Kohl

We propose augmenting deep neural networks with an attention mechanism for the visual object detection task. As perceiving a scene, humans have the capability of multiple fixation points, each attended to scene content at different…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Kota Hara , Ming-Yu Liu , Oncel Tuzel , Amir-massoud Farahmand

Retrieval augmented models are becoming increasingly popular for computer vision tasks after their recent success in NLP problems. The goal is to enhance the recognition capabilities of the model by retrieving similar examples for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Ahmet Iscen , Alireza Fathi , Cordelia Schmid

Unsupervised video object learning seeks to decompose video scenes into structural object representations without any supervision from depth, optical flow, or segmentation. We present VONet, an innovative approach that is inspired by MONet.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Haonan Yu , Wei Xu

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

Sequence modeling has demonstrated state-of-the-art performance on natural language and document understanding tasks. However, it is challenging to correctly serialize tokens in form-like documents in practice due to their variety of layout…

Computation and Language · Computer Science 2022-03-25 Chen-Yu Lee , Chun-Liang Li , Timothy Dozat , Vincent Perot , Guolong Su , Nan Hua , Joshua Ainslie , Renshen Wang , Yasuhisa Fujii , Tomas Pfister

Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Yunsheng Wu , Lizhuang Ma

We propose a novel Synergistic Attention Network (SA-Net) to address the light field salient object detection by establishing a synergistic effect between multi-modal features with advanced attention mechanisms. Our SA-Net exploits the rich…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yi Zhang , Geng Chen , Qian Chen , Yujia Sun , Yong Xia , Olivier Deforges , Wassim Hamidouche , Lu Zhang

Among image classification, skip and densely-connection-based networks have dominated most leaderboards. Recently, from the successful development of multi-head attention in natural language processing, it is sure that now is a time of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Ching-Hsun Tseng , Shin-Jye Lee , Jia-Nan Feng , Shengzhong Mao , Yu-Ping Wu , Jia-Yu Shang , Mou-Chung Tseng , Xiao-Jun Zeng

Video salient object detection aims to find the most visually distinctive objects in a video. To explore the temporal dependencies, existing methods usually resort to recurrent neural networks or optical flow. However, these approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Yi-Wen Chen , Xiaojie Jin , Xiaohui Shen , Ming-Hsuan Yang

Current state-of-the-art video models process a video clip as a long sequence of spatio-temporal tokens. However, they do not explicitly model objects, their interactions across the video, and instead process all the tokens in the video. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xingyi Zhou , Anurag Arnab , Chen Sun , Cordelia Schmid

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Liqiang Lin , Pengdi Huang , Chi-Wing Fu , Kai Xu , Hao Zhang , Hui Huang

Accurate segmentation of the vertebra is an important prerequisite in various medical applications (E.g. tele surgery) to assist surgeons. Following the successful development of deep neural networks, recent studies have focused on the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-01 Simindokht Jahangard , Mahdi Bonyani , Abbas Khosravi

Objects are entities we act upon, where the functionality of an object is determined by how we interact with it. In this work we propose a Dual Attention Network model which reasons about human-object interactions. The dual-attentional…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Tete Xiao , Quanfu Fan , Dan Gutfreund , Mathew Monfort , Aude Oliva , Bolei Zhou