中文
相关论文

相关论文: Attentional Bottleneck: Towards an Interpretable D…

200 篇论文

Deep Neural Networks (DNNs) are often considered black boxes due to their opaque decision-making processes. To reduce their opacity Concept Models (CMs), such as Concept Bottleneck Models (CBMs), were introduced to predict human-defined…

人机交互 · 计算机科学 2025-12-02 Jack Furby , Dan Cunnington , Dave Braines , Alun Preece

Neural language models are becoming the prevailing methodology for the tasks of query answering, text classification, disambiguation, completion and translation. Commonly comprised of hundreds of millions of parameters, these neural network…

机器学习 · 计算机科学 2020-05-13 Blaž Škrlj , Nika Eržen , Shane Sheehan , Saturnino Luz , Marko Robnik-Šikonja , Senja Pollak

Trajectory prediction models in autonomous driving are vulnerable to perturbations from non-causal agents whose actions should not affect the ego-agent's behavior. Such perturbations can lead to incorrect predictions of other agents'…

机器人学 · 计算机科学 2026-05-19 Ehsan Ahmadi , Ray Mercurius , Soheil Alizadeh , Kasra Rezaee , Amir Rasouli

Human drivers use their attentional mechanisms to focus on critical objects and make decisions while driving. As human attention can be revealed from gaze data, capturing and analyzing gaze information has emerged in recent years to benefit…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Yao Rong , Naemi-Rebecca Kassautzki , Wolfgang Fuhl , Enkelejda Kasneci

Rich phenomena from complex systems have long intrigued researchers, and yet modeling system micro-dynamics and inferring the forms of interaction remain challenging for conventional data-driven approaches, being generally established by…

统计力学 · 物理学 2020-11-13 Seungwoong Ha , Hawoong Jeong

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

机器学习 · 计算机科学 2023-05-11 Kieran A. Murphy , Dani S. Bassett

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

机器学习 · 计算机科学 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Understanding what kinds of cooperative structures deep neural networks (DNNs) can represent remains a fundamental yet insufficiently understood problem. In this work, we treat interactions as the fundamental units of such structure and…

机器学习 · 计算机科学 2025-12-23 Huiqi Deng , Qihan Ren , Zhuofan Chen , Zhenyuan Cui , Wen Shen , Peng Zhang , Hongbin Pei , Quanshi Zhang

Trajectory prediction, as a critical component of autonomous driving systems, has attracted the attention of many researchers. Existing prediction algorithms focus on extracting more detailed scene features or selecting more reasonable…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Wenyi Xiong , Jian Chen , Ziheng Qi

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

Transformer architectures are now central to sequence modeling tasks. At its heart is the attention mechanism, which enables effective modeling of long-term dependencies in a sequence. Recently, transformers have been successfully applied…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Lin Zheng , Huijie Pan , Lingpeng Kong

As we navigate our daily commutes, the threat posed by a distracted driver is at a large, resulting in a troubling rise in traffic accidents. Addressing this safety concern, our project harnesses the analytical power of Convolutional Neural…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Amaan Aijaz Sheikh , Imaad Zaffar Khan

Autonomous driving systems require a deep understanding of human driving behaviors to achieve higher intelligence and safety.Despite advancements in deep learning, challenges such as long-tail distribution due to scarce samples and…

人工智能 · 计算机科学 2025-03-19 Yilin Wang

Convolutional neural networks have enabled major progresses in addressing pixel-level prediction tasks such as semantic segmentation, depth estimation, surface normal prediction and so on, benefiting from their powerful capabilities in…

计算机视觉与模式识别 · 计算机科学 2021-12-16 Guanglei Yang , Paolo Rota , Xavier Alameda-Pineda , Dan Xu , Mingli Ding , Elisa Ricci

In this paper, we seek to measure how much information a component in a neural network could extract from the representations fed into it. Our work stands in contrast to prior probing work, most of which investigates how much information a…

计算与语言 · 计算机科学 2022-11-14 Tiago Pimentel , Josef Valvoda , Niklas Stoehr , Ryan Cotterell

Although neural networks have seen tremendous success as predictive models in a variety of domains, they can be overly confident in their predictions on out-of-distribution (OOD) data. To be viable for safety-critical applications, like…

机器人学 · 计算机科学 2022-11-17 Masha Itkina , Mykel J. Kochenderfer

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For…

机器学习 · 计算机科学 2021-04-01 Alana de Santana Correia , Esther Luna Colombini

Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Yuqi Dai , Jian Sun , Shengbo Eben Li , Qing Xu , Jianqiang Wang , Lei He , Keqiang Li

Attention networks have proven to be an effective approach for embedding categorical inference within a deep neural network. However, for many tasks we may want to model richer structural dependencies without abandoning end-to-end training.…

计算与语言 · 计算机科学 2017-02-17 Yoon Kim , Carl Denton , Luong Hoang , Alexander M. Rush

In meta-learning approaches, it is difficult for a practitioner to make sense of what kind of representations the model employs. Without this ability, it can be difficult to both understand what the model knows as well as to make meaningful…

机器学习 · 计算机科学 2022-04-05 Pedro Sandoval-Segura , Wallace Lawson