English
Related papers

Related papers: DeepNNK: Explaining deep models and their generali…

200 papers

Data sites selected from modeling high-dimensional problems often appear scattered in non-paternalistic ways. Except for sporadic clustering at some spots, they become relatively far apart as the dimension of the ambient space grows. These…

Numerical Analysis · Mathematics 2021-09-28 Shao-Bo Lin , Xiangyu Chang , Xingping Sun

The Neural Tangent Kernel (NTK) has recently attracted intense study, as it describes the evolution of an over-parameterized Neural Network (NN) trained by gradient descent. However, it is now well-known that gradient descent is not always…

Machine Learning · Computer Science 2021-03-23 Lei Tan , Shutong Wu , Xiaolin Huang

Deep neural networks (DNNs) have demonstrated remarkable success, yet their wide adoption is often hindered by their opaque decision-making. To address this, attribution methods have been proposed to assign relevance values to each part of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Danielle Cohen , Hila Chefer , Lior Wolf

Deep learning has achieved remarkable success across many domains, but it has also created a growing demand for interpretability in model predictions. Although many explainable machine learning methods have been proposed, post-hoc…

Machine Learning · Computer Science 2026-01-28 Shijian Xu , Marcello Massimo Negri , Volker Roth

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

Machine Learning · Computer Science 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

Despite the high performance of neural network-based time series forecasting methods, the inherent challenge in explaining their predictions has limited their applicability in certain application areas. Due to the difficulty in identifying…

Machine Learning · Computer Science 2023-01-09 Ozan Ozyegen , Juyoung Wang , Mucahit Cevik

Imagine experiencing a crash as the passenger of an autonomous vehicle. Wouldn't you want to know why it happened? Current end-to-end optimizable deep neural networks (DNNs) in 3D detection, multi-object tracking, and motion forecasting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Benjamin Thérien , Krzysztof Czarnecki

Inspired by a growing interest in analyzing network data, we study the problem of node classification on graphs, focusing on approaches based on kernel machines. Conventionally, kernel machines are linear classifiers in the implicit feature…

Machine Learning · Statistics 2010-01-25 Xiao Tang , Mu Zhu

Neural NLP models are increasingly accurate but are imperfect and opaque---they break in counterintuitive ways and leave end users puzzled at their behavior. Model interpretation methods ameliorate this opacity by providing explanations for…

Computation and Language · Computer Science 2019-09-23 Eric Wallace , Jens Tuyls , Junlin Wang , Sanjay Subramanian , Matt Gardner , Sameer Singh

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Neural networks currently dominate the machine learning community and they do so for good reasons. Their accuracy on complex tasks such as image classification is unrivaled at the moment and with recent improvements they are reasonably easy…

Machine Learning · Computer Science 2019-01-21 Sascha Saralajew , Lars Holdijk , Maike Rees , Thomas Villmann

Deep neural networks, despite their success in numerous applications, often function without established theoretical foundations. In this paper, we bridge this gap by drawing parallels between deep learning and classical numerical analysis.…

Machine Learning · Computer Science 2023-10-04 Emanuele Zappala , Daniel Levine , Sizhuang He , Syed Rizvi , Sacha Levy , David van Dijk

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Machine Learning algorithms are increasingly being used in recent years due to their flexibility in model fitting and increased predictive performance. However, the complexity of the models makes them hard for the data analyst to interpret…

Machine Learning · Statistics 2018-06-07 Joel Vaughan , Agus Sudjianto , Erind Brahimi , Jie Chen , Vijayan N. Nair

The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose…

Machine Learning · Statistics 2020-07-16 Zhirui Hu , Zheng Tracy Ke , Jun S Liu

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

Network representation learning (NRL) is an effective graph analytics technique and promotes users to deeply understand the hidden characteristics of graph data. It has been successfully applied in many real-world tasks related to network…

Social and Information Networks · Computer Science 2021-03-09 Ke Sun , Lei Wang , Bo Xu , Wenhong Zhao , Shyh Wei Teng , Feng Xia

We propose Deep Companion Learning (DCL), a novel training method for Deep Neural Networks (DNNs) that enhances generalization by penalizing inconsistent model predictions compared to its historical performance. To achieve this, we train a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Ruizhao Zhu , Venkatesh Saligrama

We propose a new neural network framework, termed Neural Network Machine Regression (NNMR), which integrates trainable input gating and adaptive depth regularization to jointly perform feature selection and function estimation in an…

Methodology · Statistics 2026-02-03 Jiuchen Zhang , Ling Zhou , Peter Song