English
Related papers

Related papers: Sharpen Focus: Learning with Attention Separabilit…

200 papers

Interpreting the decisions of deep learning models has been actively studied since the explosion of deep neural networks. One of the most convincing interpretation approaches is salience-based visual interpretation, such as Grad-CAM, where…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiming Lei , Zilong Li , Yangyang Li , Junping Zhang , Hongming Shan

Intra-class variations in the open world lead to various challenges in classification tasks. To overcome these challenges, fine-grained classification was introduced, and many approaches were proposed. Some rely on locating and using…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Salwa Al Khatib , Mohamed El Amine Boudjoghra , Jameel Hassan

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Xiaojie Jin , Yunpeng Chen , Jian Dong , Jiashi Feng , Shuicheng Yan

Despite groundbreaking success in image and text learning, deep learning has not achieved significant improvements against traditional machine learning (ML) when it comes to tabular data. This performance gap underscores the need for…

Machine Learning · Computer Science 2024-01-10 Shourav B. Rabbani , Ivan V. Medri , Manar D. Samad

Nowadays, most classification networks use one-hot encoding to represent categorical data because of its simplicity. However, one-hot encoding may affect the generalization ability as it neglects inter-class correlations. We observe that,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Xue Zhang , Zehua Sheng , Hui-Liang Shen

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

Convolutional Neural Networks (CNNs) frequently "cheat" by exploiting superficial correlations, raising concerns about whether they make predictions for the right reasons. Inspired by cognitive science, which highlights the role of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ryan L. Yang , Dipkamal Bhusal , Nidhi Rastogi

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

Visual Commonsense Reasoning (VCR) remains a significant yet challenging research problem in the realm of visual reasoning. A VCR model generally aims at answering a textual question regarding an image, followed by the rationale prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zhenyang Li , Yangyang Guo , Kejie Wang , Fan Liu , Liqiang Nie , Mohan Kankanhalli

It is known that deep neural networks (DNNs) classify an input image by paying particular attention to certain specific pixels; a graphical representation of the magnitude of attention to each pixel is called a saliency-map. Saliency-maps…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Satoshi Munakata , Caterina Urban , Haruki Yokoyama , Koji Yamamoto , Kazuki Munakata

Incorporating human domain knowledge for breast tumor diagnosis is challenging, since shape, boundary, curvature, intensity, or other common medical priors vary significantly across patients and cannot be employed. This work proposes a new…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Aleksandar Vakanski , Min Xian , Phoebe Freer

Deep learning has achieved outstanding performance for face recognition benchmarks, but performance reduces significantly for low resolution (LR) images. We propose an attention similarity knowledge distillation approach, which transfers…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Sungho Shin , Joosoon Lee , Junseok Lee , Yeonguk Yu , Kyoobin Lee

Convolutional layers are an integral part of many deep neural network solutions in computer vision. Recent work shows that replacing the standard convolution operation with mechanisms based on self-attention leads to improved performance on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Souvik Kundu , Hesham Mostafa , Sharath Nittur Sridhar , Sairam Sundaresan

Typically, objects with the same semantics are not always prominent in images containing different backgrounds. Motivated by this observation that accurately salient object detection is related to both foreground and background, we proposed…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Changqun Xia , Jia Li , Jinming Su , Yonghong Tian

Conventional salient object detection models cannot differentiate the importance of different salient objects. Recently, two works have been proposed to detect saliency ranking by assigning different degrees of saliency to different…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Nian Liu , Long Li , Wangbo Zhao , Junwei Han , Ling Shao

Successful continual learning of new knowledge would enable intelligent systems to recognize more and more classes of objects. However, current intelligent systems often fail to correctly recognize previously learned classes of objects when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Changhong Zhong , Zhiying Cui , Ruixuan Wang , Wei-Shi Zheng

In recent years, various applications in computer vision have achieved substantial progress based on deep learning, which has been widely used for image fusion and shown to achieve adequate performance. However, suffering from limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Zhengwen Shen , Jun Wang , Zaiyu Pan , Yulian Li , Jiangyu Wang

The bottom-up saliency, an early stage of humans' visual attention, can be considered as a binary classification problem between center and surround classes. Discriminant power of features for the classification is measured as mutual…

Computer Vision and Pattern Recognition · Computer Science 2013-01-18 Anh Cat Le Ngo , Kenneth Ang Li-Minn , Guoping Qiu , Jasmine Seng Kah-Phooi

We develop techniques for refining representations for fine-grained classification and segmentation tasks in a self-supervised manner. We find that fine-tuning methods based on instance-discriminative contrastive learning are not as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Oindrila Saha , Subhransu Maji