English
Related papers

Related papers: Effective Guidance for Model Attention with Simple…

200 papers

The prevalence of employing attention mechanisms has brought along concerns on the interpretability of attention distributions. Although it provides insights about how a model is operating, utilizing attention as the explanation of model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Tristan Gomez , Suiyi Ling , Thomas Fréour , Harold Mouchère

We present a deep learning method for accurately localizing the center of a single corneal reflection (CR) in an eye image. Unlike previous approaches, we use a convolutional neural network (CNN) that was trained solely using simulated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Sean Anthony Byrne , Marcus Nyström , Virmarie Maquiling , Enkelejda Kasneci , Diederick C. Niehorster

This paper is on active learning where the goal is to reduce the data annotation burden by interacting with a (human) oracle during training. Standard active learning methods ask the oracle to annotate data samples. Instead, we take a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Miriam W. Huijser , Jan C. van Gemert

Imitation learning enables robots to learn new tasks from human examples. One fundamental limitation while learning from humans is causal confusion. Causal confusion occurs when the robot's observations include both task-relevant and…

Robotics · Computer Science 2025-03-04 Robert Ramirez Sanchez , Heramb Nemlekar , Shahabedin Sagheb , Cara M. Nunez , Dylan P. Losey

Recent developments in gradient-based attention modeling have seen attention maps emerge as a powerful tool for interpreting convolutional neural networks. Despite good localization for an individual class of interest, these techniques…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Lezi Wang , Ziyan Wu , Srikrishna Karanam , Kuan-Chuan Peng , Rajat Vikram Singh , Bo Liu , Dimitris N. Metaxas

We propose a novel attention based deep learning architecture for visual question answering task (VQA). Given an image and an image related natural language question, VQA generates the natural language answer for the question. Generating…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Kan Chen , Jiang Wang , Liang-Chieh Chen , Haoyuan Gao , Wei Xu , Ram Nevatia

Learning from real-world data is frequently hindered by the compound challenge of long-tailed class distributions and noisy annotations. Existing methods partially address these issues but typically ignore the non-uniform impact of label…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mengke Li , Haiquan Ling , Lihao Chen , Yang Lu , Yiqun Zhang , Hui Huang

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

Artificial Intelligence · Computer Science 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Deep learning in the presence of noisy annotations has been studied extensively in classification, but much less in segmentation tasks. In this work, we study the learning dynamics of deep segmentation networks trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Sheng Liu , Kangning Liu , Weicheng Zhu , Yiqiu Shen , Carlos Fernandez-Granda

Recently, transformer-based generative recommendation has garnered significant attention for user behavior modeling. However, it often requires discretizing items into multi-code representations (e.g., typically four code tokens or more),…

Information Retrieval · Computer Science 2025-12-18 Longtao Xiao , Haolin Zhang , Guohao Cai , Jieming Zhu , Yifan Wang , Heng Chang , Zhenhua Dong , Xiu Li , Ruixuan Li

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar

Deep learning models have demonstrated remarkable capabilities in learning complex patterns and concepts from training data. However, recent findings indicate that these models tend to rely heavily on simple and easily discernible features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Raha Ahmadi , Mohammad Javad Rajabi , Mohammad Khalooie , Mohammad Sabokrou

Deep neural networks need to make robust inference in the presence of occlusion, background clutter, pose and viewpoint variations -- to name a few -- when the task of person re-identification is considered. Attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Jieming Zhou , Soumava Kumar Roy , Pengfei Fang , Mehrtash Harandi , Lars Petersson

The standard way to teach models is by feeding them lots of data. However, this approach often teaches models incorrect ideas because they pick up on misleading signals in the data. To prevent such misconceptions, we must necessarily…

Machine Learning · Computer Science 2024-08-23 Yoonho Lee , Michelle S. Lam , Helena Vasconcelos , Michael S. Bernstein , Chelsea Finn

The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-attention which is appealing for the ability to attend to…

Machine Learning · Computer Science 2021-10-26 Shujian Zhang , Xinjie Fan , Huangjie Zheng , Korawat Tanwisuth , Mingyuan Zhou

The field of artificial intelligence is built on object detection techniques. YOU ONLY LOOK ONCE (YOLO) algorithm and it's more evolved versions are briefly described in this research survey. This survey is all about YOLO and convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Viswanatha V , Chandana R K , Ramachandra A. C.

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Transformer-based architectures have become the prevailing backbone of large language models. However, the quadratic time and memory complexity of self-attention remains a fundamental obstacle to efficient long-context modeling. To address…

Computation and Language · Computer Science 2026-02-10 Yutao Sun , Zhenyu Li , Yike Zhang , Tengyu Pan , Bowen Dong , Yuyi Guo , Jianyong Wang

Harvesting dense pixel-level annotations to train deep neural networks for semantic segmentation is extremely expensive and unwieldy at scale. While learning from synthetic data where labels are readily available sounds promising,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Zuxuan Wu , Xintong Han , Yen-Liang Lin , Mustafa Gkhan Uzunbas , Tom Goldstein , Ser Nam Lim , Larry S. Davis

Attention mechanisms have recently been introduced in deep learning for various tasks in natural language processing and computer vision. But despite their popularity, the "correctness" of the implicitly-learned attention maps has only been…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Chenxi Liu , Junhua Mao , Fei Sha , Alan Yuille