English
Related papers

Related papers: Attentional Bottleneck: Towards an Interpretable D…

200 papers

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Masanari Kimura , Masayuki Tanaka

This paper explores the bottleneck of feature representations of deep neural networks (DNNs), from the perspective of the complexity of interactions between input variables encoded in DNNs. To this end, we focus on the multi-order…

Machine Learning · Computer Science 2022-11-08 Huiqi Deng , Qihan Ren , Hao Zhang , Quanshi Zhang

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Autonomous vehicles (AVs) require reliable traffic sign recognition and robust lane detection capabilities to ensure safe navigation in complex and dynamic environments. This paper introduces an integrated approach combining advanced deep…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chandan Kumar Sah , Ankit Kumar Shaw , Xiaoli Lian , Arsalan Shahid Baig , Tuopu Wen , Kun Jiang , Mengmeng Yang , Diange Yang

Attention based Transformer architecture has enabled significant advances in the field of natural language processing. In addition to new pre-training techniques, recent improvements crucially rely on working with a relatively larger…

Machine Learning · Computer Science 2020-02-18 Srinadh Bhojanapalli , Chulhee Yun , Ankit Singh Rawat , Sashank J. Reddi , Sanjiv Kumar

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of…

Machine Learning · Computer Science 2021-09-29 Fenglei Fan , Jinjun Xiong , Mengzhou Li , Ge Wang

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

Humans perceive the world by concurrently processing and fusing high-dimensional inputs from multiple modalities such as vision and audio. Machine perception models, in stark contrast, are typically modality-specific and optimised for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Arsha Nagrani , Shan Yang , Anurag Arnab , Aren Jansen , Cordelia Schmid , Chen Sun

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes…

Machine Learning · Computer Science 2025-02-05 Vinay Kumar Sankarapu , Chintan Chitroda , Yashwardhan Rathore , Neeraj Kumar Singh , Pratinav Seth

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet three desiderata:…

Machine Learning · Computer Science 2021-05-11 Andrei Margeloiu , Matthew Ashman , Umang Bhatt , Yanzhi Chen , Mateja Jamnik , Adrian Weller

Autonomous AI systems will be entering human society in the near future to provide services and work alongside humans. For those systems to be accepted and trusted, the users should be able to understand the reasoning process of the system,…

Machine Learning · Computer Science 2018-09-18 Rahul Iyer , Yuezhang Li , Huao Li , Michael Lewis , Ramitha Sundar , Katia Sycara

Traffic forecasting plays a crucial role in intelligent transportation systems. The spatial-temporal complexities in transportation networks make the problem especially challenging. The recently suggested deep learning models share basic…

Machine Learning · Computer Science 2022-03-23 Yuyol Shin , Yoonjin Yoon

Recent studies have shown the latency and energy consumption of deep neural networks can be significantly improved by splitting the network between the mobile device and cloud. This paper introduces a new deep learning architecture, called…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-05 Amir Erfan Eshratifar , Amirhossein Esmaili , Massoud Pedram

Autonomous vehicle navigation in shared pedestrian environments requires the ability to predict future crowd motion both accurately and with minimal delay. Understanding the uncertainty of the prediction is also crucial. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kunming Li , Stuart Eiffert , Mao Shan , Francisco Gomez-Donoso , Stewart Worrall , Eduardo Nebot

Attention plays a critical role in human visual experience. Furthermore, it has recently been demonstrated that attention can also play an important role in the context of applying artificial neural networks to a variety of tasks from…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Sergey Zagoruyko , Nikos Komodakis

Despite deep convolutional neural networks' great success in object classification, it suffers from severe generalization performance drop under occlusion due to the inconsistency between training and testing data. Because of the large…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Mingqing Xiao , Adam Kortylewski , Ruihai Wu , Siyuan Qiao , Wei Shen , Alan Yuille

Deep Learning refers to a set of machine learning techniques that utilize neural networks with many hidden layers for tasks, such as image classification, speech recognition, language understanding. Deep learning has been proven to be very…

Machine Learning · Computer Science 2017-05-02 Andre Luckow , Matthew Cook , Nathan Ashcraft , Edwin Weill , Emil Djerekarov , Bennie Vorster

Non-holonomic vehicle motion has been studied extensively using physics-based models. Common approaches when using these models interpret the wheel/ground interactions using a linear tire model and thus may not fully capture the nonlinear…

Robotics · Computer Science 2022-07-19 Taekyung Kim , Hojin Lee , Wonsuk Lee

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Atefeh Shahroudnejad , Arash Mohammadi , Konstantinos N. Plataniotis