English
Related papers

Related papers: Attention module improves both performance and int…

200 papers

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Neural machine translation (NMT) has been a new paradigm in machine translation, and the attention mechanism has become the dominant approach with the state-of-the-art records in many language pairs. While there are variants of the…

Computation and Language · Computer Science 2018-04-04 Heeyoul Choi , Kyunghyun Cho , Yoshua Bengio

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Understanding how large-scale functional brain networks reorganize during cognitive decline remains a central challenge in neuroimaging. While recent self-supervised models have shown promise for learning representations from resting-state…

Machine Learning · Computer Science 2026-03-03 Karanpartap Singh , Adam Turnbull , Mohammad Abbasi , Kilian Pohl , Feng Vankee Lin , Ehsan Adeli

Deep neural networks (DNNs) have achieved unprecedented performance on a wide range of complex tasks, rapidly outpacing our understanding of the nature of their solutions. This has caused a recent surge of interest in methods for rendering…

Machine Learning · Statistics 2017-06-30 Samuel Ritter , David G. T. Barrett , Adam Santoro , Matt M. Botvinick

Transformer-based models, even though achieving super-human performance on several downstream tasks, are often regarded as a black box and used as a whole. It is still unclear what mechanisms they have learned, especially their core module:…

Computation and Language · Computer Science 2023-10-17 Chong Li , Shaonan Wang , Yunhao Zhang , Jiajun Zhang , Chengqing Zong

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Wenjie Kang , Lize Jiskoot , Peter De Deyn , Geert Biessels , Huiberdina Koek , Jurgen Claassen , Huub Middelkoop , Wiesje Flier , Willemijn J. Jansen , Stefan Klein , Esther Bron

Document-level Neural Machine Translation (DocNMT) has been proven crucial for handling discourse phenomena by introducing document-level context information. One of the most important directions is to input the whole document directly to…

Computation and Language · Computer Science 2023-09-26 Zihan Liu , Zewei Sun , Shanbo Cheng , Shujian Huang , Mingxuan Wang

Deep neural networks (DNNs) have shown exceptional performances in a wide range of tasks and have become the go-to method for problems requiring high-level predictive power. There has been extensive research on how DNNs arrive at their…

Machine Learning · Computer Science 2023-02-21 Mattias Luber , Anton Thielmann , Benjamin Säfken

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

Deep Neural Networks (DNNs) deliver state-of-the-art performance in many image recognition and understanding applications. However, despite their outstanding performance, these models are black-boxes and it is hard to understand how they…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Moustafa Alzantot , Amy Widdicombe , Simon Julier , Mani Srivastava

Attention is a state of arousal capable of dealing with limited processing bottlenecks in human beings by focusing selectively on one piece of information while ignoring other perceptible information. For decades, concepts and functions of…

Machine Learning · Computer Science 2021-12-14 Alana Santana , Esther Colombini

The 3D scene understanding is mainly considered as a crucial requirement in computer vision and robotics applications. One of the high-level tasks in 3D scene understanding is semantic segmentation of RGB-Depth images. With the availability…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Fahimeh Fooladgar , Shohreh Kasaei

Attention mechanisms, which enable a neural network to accurately focus on all the relevant elements of the input, have become an essential component to improve the performance of deep neural networks. There are mainly two attention…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Qing-Long Zhang Yu-Bin Yang

Simultaneous modeling of the spatio-temporal variation patterns of brain functional network from 4D fMRI data has been an important yet challenging problem for the field of cognitive neuroscience and medical image analysis. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Yu Zhao , Xiang Li , Wei Zhang , Shijie Zhao , Milad Makkie , Mo Zhang , Quanzheng Li , Tianming Liu

Early prediction of cerebral palsy is essential as it leads to early treatment and monitoring. Deep learning has shown promising results in biomedical engineering thanks to its capacity of modelling complicated data with its non-linear…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Manli Zhu , Qianhui Men , Edmond S. L. Ho , Howard Leung , Hubert P. H. Shum

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Yuanyuan Wei , Roger Tam , Xiaoying Tang

Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many…

Early diagnosis of Alzheimer Diagnostics (AD) is a challenging task due to its subtle and complex clinical symptoms. Deep learning-assisted medical diagnosis using image recognition techniques has become an important research topic in this…

Image and Video Processing · Electrical Eng. & Systems 2024-01-26 Yihao Lin , Ximeng Li , Yan Zhang , Jinshan Tang