English
Related papers

Related papers: DeepNNK: Explaining deep models and their generali…

200 papers

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Deep learning, computational neuroscience, and cognitive science have overlapping goals related to understanding intelligence such that perception and behaviour can be simulated in computational systems. In neuroimaging, machine learning…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Jessica A. F. Thompson , Yoshua Bengio , Elia Formisano , Marc Schönwiesner

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

Typical deep learning approaches to modeling high-dimensional data often result in complex models that do not easily reveal a new understanding of the data. Research in the deep learning field is very actively pursuing new methods to…

Machine Learning · Computer Science 2022-05-16 Charles Anderson , Jason Stock , David Anderson

Recent theoretical work has established connections between over-parametrized neural networks and linearized models governed by he Neural Tangent Kernels (NTKs). NTK theory leads to concrete convergence and generalization results, yet the…

Machine Learning · Computer Science 2020-02-18 Yu Bai , Jason D. Lee

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

As a general type of machine learning approach, artificial neural networks have established state-of-art benchmarks in many pattern recognition and data analysis tasks. Among various kinds of neural networks architectures, polynomial neural…

Machine Learning · Computer Science 2022-09-07 Chao Pan , Chuanyi Zhang

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

Machine Learning · Computer Science 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Deep convolutional neural network has demonstrated its capability of learning a deterministic mapping for the desired imagery effect. However, the large variety of user flavors motivates the possibility of continuous transition among…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Xintao Wang , Ke Yu , Chao Dong , Xiaoou Tang , Chen Change Loy

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

The study of deep neural networks (DNNs) in the infinite-width limit, via the so-called neural tangent kernel (NTK) approach, has provided new insights into the dynamics of learning, generalization, and the impact of initialization. One key…

Machine Learning · Computer Science 2021-06-16 Sina Alemohammad , Zichao Wang , Randall Balestriero , Richard Baraniuk

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

As an important technique for modeling the knowledge states of learners, the traditional knowledge tracing (KT) models have been widely used to support intelligent tutoring systems and MOOC platforms. Driven by the fast advancements of deep…

Machine Learning · Computer Science 2020-05-14 Yu Lu , Deliang Wang , Qinggang Meng , Penghe Chen

Artificial intelligence, particularly through recent advancements in deep learning, has achieved exceptional performances in many tasks in fields such as natural language processing and computer vision. In addition to desirable evaluation…

Machine Learning · Computer Science 2024-03-04 Sean Xie , Soroush Vosoughi , Saeed Hassanpour

Even when neural networks are widely used in a large number of applications, they are still considered as black boxes and present some difficulties for dimensioning or evaluating their prediction error. This has led to an increasing…

Machine Learning · Statistics 2021-05-11 Pablo Morala , Jenny Alexandra Cifuentes , Rosa E. Lillo , Iñaki Ucar

The paper presents a novel deep learning approach, which extracts latent information from trained Deep Neural Networks (DNNs) and derives concise representations that are analyzed in an effective, unified way for prediction purposes. It is…

Machine Learning · Computer Science 2020-09-22 D. Kollias , N. Bouas , Y. Vlaxos , V. Brillakis , M. Seferis , I. Kollia , L. Sukissian , J. Wingate , S. Kollias

Deep neural networks (DNNs) have been used to create models for many complex analysis problems like image recognition and medical diagnosis. DNNs are a popular tool within machine learning due to their ability to model complex patterns and…

Machine Learning · Computer Science 2024-05-14 Parth Patil , Ben Boardley , Jack Gardner , Emily Loiselle , Deerajkumar Parthipan

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler