English
Related papers

Related papers: CA-Stream: Attention-based pooling for interpretab…

200 papers

We consider interactive algorithms in the pool-based setting, and in the stream-based setting. Interactive algorithms observe suggested elements (representing actions or queries), and interactively select some of them and receive responses.…

Machine Learning · Statistics 2018-11-21 Sivan Sabato , Tom Hess

The visual system processes a scene using a sequence of selective glimpses, each driven by spatial and object-based attention. These glimpses reflect what is relevant to the ongoing task and are selected through recurrent processing and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hossein Adeli , Seoyoung Ahn , Gregory Zelinsky

As 3D point clouds become the prevailing shape representation in computer vision, generating high-quality point clouds remains a challenging problem. Flow-based models have shown strong potential due to exact likelihood estimation and…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Linhao Wang , Qichang Zhang , Yifan Yang , Ye Su , Hao Wang

Recent advances in deep learning have shown exciting promise in filling large holes and lead to another orientation for image inpainting. However, existing learning-based methods often create artifacts and fallacious textures because of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Qingguo Xiao , Guangyao Li , Qiaochuan Chen

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

Machine Learning · Computer Science 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Most convolutional neural networks (CNNs) for image classification use a global average pooling (GAP) followed by a fully-connected (FC) layer for output logits. However, this spatial aggregation procedure inherently restricts the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Ildoo Kim , Woonhyuk Baek , Sungwoong Kim

Existing deep architectures cannot operate on very large signals such as megapixel images due to computational and memory constraints. To tackle this limitation, we propose a fully differentiable end-to-end trainable model that samples and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Angelos Katharopoulos , François Fleuret

Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

While image understanding on recognition-level has achieved remarkable advancements, reliable visual scene understanding requires comprehensive image understanding on recognition-level but also cognition-level, which calls for exploiting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xuejiao Tang , Wenbin Zhang , Yi Yu , Kea Turner , Tyler Derr , Mengyu Wang , Eirini Ntoutsi

Disentangled representation learning strives to extract the intrinsic factors within observed data. Factorizing these representations in an unsupervised manner is notably challenging and usually requires tailored loss functions or specific…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Tao Yang , Cuiling Lan , Yan Lu , Nanning zheng

Single image-based crowd counting has recently witnessed increased focus, but many leading methods are far from optimal, especially in highly congested scenes. In this paper, we present Hierarchical Attention-based Crowd Counting Network…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Vishwanath A. Sindagi , Vishal M. Patel

Multiple instance learning is qualified for many pattern recognition tasks with weakly annotated data. The combination of artificial neural network and multiple instance learning offers an end-to-end solution and has been widely utilized.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Jingjun Yi , Beichen Zhou

Block-sparse attention is promising for accelerating long-context LLM pre-filling, yet identifying relevant blocks efficiently remains a bottleneck. Existing methods typically employ coarse-grained attention as a proxy for block importance…

Computation and Language · Computer Science 2026-05-26 Xinghao Wang , Pengyu Wang , Xiaoran Liu , Fangxu Liu , Jason Chu , Kai Song , Xipeng Qiu

Detection-free methods typically follow a coarse-to-fine pipeline, extracting image and point cloud features for patch-level matching and refining dense pixel-to-point correspondences. However, differences in feature channel attention…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Zhixin Cheng , Jiacheng Deng , Xinjun Li , Xiaotian Yin , Bohao Liao , Baoqun Yin , Wenfei Yang , Tianzhu Zhang

Deep neural network models have recently draw lots of attention, as it consistently produce impressive results in many computer vision tasks such as image classification, object detection, etc. However, interpreting such model and show the…

Machine Learning · Computer Science 2019-01-30 Shipeng Xie , Da Chen , Rong Zhang , Hui Xue

In high energy physics, graph-based implementations have the advantage of treating the input data sets in a similar way as they are collected by collider experiments. To expand on this concept, we propose a graph neural network enhanced by…

Data Analysis, Statistics and Probability · Physics 2020-09-29 Vinicius Mikuni , Florencia Canelli

Exemplar-based colourisation aims to add plausible colours to a grayscale image using the guidance of a colour reference image. Most of the existing methods tackle the task as a style transfer problem, using a convolutional neural network…

Image and Video Processing · Electrical Eng. & Systems 2021-05-06 Marc Gorriz Blanch , Issa Khalifeh , Alan Smeaton , Noel O'Connor , Marta Mrak

Most convolutional neural networks use some method for gradually downscaling the size of the hidden layers. This is commonly referred to as pooling, and is applied to reduce the number of parameters, improve invariance to certain…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Faraz Saeedan , Nicolas Weber , Michael Goesele , Stefan Roth

Models based on the Transformer architecture have achieved better accuracy than the ones based on competing architectures for a large set of tasks. A unique feature of the Transformer is its universal application of a self-attention…

Machine Learning · Computer Science 2020-10-01 Nan Ding , Xinjie Fan , Zhenzhong Lan , Dale Schuurmans , Radu Soricut