English
Related papers

Related papers: Explaining a prediction in some nonlinear models

200 papers

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

In machine learning, metric elicitation refers to the selection of performance metrics that best reflect an individual's implicit preferences for a given application. Currently, metric elicitation methods only consider metrics that depend…

Machine Learning · Computer Science 2025-01-03 Chethan Bhateja , Joseph O'Brien , Afnaan Hashmi , Eva Prakash

We focus on nonlinear Function-on-Scalar regression, where the predictors are scalar variables, and the responses are functional data. Most existing studies approximate the hidden nonlinear relationships using linear combinations of basis…

Methodology · Statistics 2025-04-01 Kazunori Takeshita , Yoshikazu Terada

The challenge of assigning importance to individual neurons in a network is of interest when interpreting deep learning models. In recent work, Dhamdhere et al. proposed Total Conductance, a "natural refinement of Integrated Gradients" for…

Machine Learning · Computer Science 2018-07-27 Avanti Shrikumar , Jocelin Su , Anshul Kundaje

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Uncertainty is unavoidable in modeling dynamical systems and it may be represented mathematically by differential inclusions. In the past, we proposed an algorithm to compute validated solutions of differential inclusions; here we provide…

Numerical Analysis · Mathematics 2020-01-31 Sanja Zivanovic Gonzalez , Pieter Collins , Luca Geretti , Davide Bresolin , Tiziano Villa

We give estimates for the convolution product of an arbitrary number of endlessly continuable functions. This allows us to deal with nonlinear operations for the corresponding resurgent series, e.g. substitution into a convergent power…

Dynamical Systems · Mathematics 2016-09-07 Shingo Kamimoto , David Sauzin

Function approximation from input and output data pairs constitutes a fundamental problem in supervised learning. Deep neural networks are currently the most popular method for learning to mimic the input-output relationship of a general…

Machine Learning · Computer Science 2019-12-09 Nikos Kargas , Nicholas D. Sidiropoulos

Explaining decisions made by deep neural networks is a rapidly advancing research topic. In recent years, several approaches have attempted to provide visual explanations of decisions made by neural networks designed for structured 2D image…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jawad Tayyub , Muhammad Sarmad , Nicolas Schönborn

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

In this paper, we propose a very concise deep learning approach for collaborative filtering that jointly models distributional representation for users and items. The proposed framework obtains better performance when compared against…

Information Retrieval · Computer Science 2015-02-17 Zhang Junlin , Cai Heng , Huang Tongwen , Xue Huiping

In this paper, we introduce a novel concept for learning of the parameters in a neural network. Our idea is grounded on modeling a learning problem that addresses a trade-off between (i) satisfying local objectives at each node and (ii)…

Machine Learning · Computer Science 2019-02-04 Dimche Kostadinov , Behrooz Razdehi , Slava Voloshynovskiy

We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cases of such…

Methodology · Statistics 2024-03-28 Christoph Schultheiss , Peter Bühlmann

A efficient incremental learning algorithm for classification tasks, called NetLines, well adapted for both binary and real-valued input patterns is presented. It generates small compact feedforward neural networks with one hidden layer of…

Artificial Intelligence · Computer Science 2009-04-30 Juan-Manuel Torres-Moreno , Mirta B. Gordon

Enhancing the existing solution for pricing of fixed income instruments within Black-Karasinski model structure, with neural network at various parameterisation points to demonstrate that the method is able to achieve superior outcomes for…

Computational Finance · Quantitative Finance 2024-04-16 Anna Knezevic

Machine learning predictions are typically interpreted as the sum of contributions of predictors. Yet, each out-of-sample prediction can also be expressed as a linear combination of in-sample values of the predicted variable, with weights…

Econometrics · Economics 2024-12-18 Philippe Goulet Coulombe , Maximilian Goebel , Karin Klieber

The paper surveys the topic of tensor decompositions in modern machine learning applications. It focuses on three active research topics of significant relevance for the community. After a brief review of consolidated works on multi-way…

Machine Learning · Computer Science 2020-02-28 Davide Bacciu , Danilo P. Mandic

While norm-based and leverage-score-based methods have been extensively studied for identifying "important" data points in linear models, analogous tools for nonlinear models remain significantly underdeveloped. By introducing the concept…

Machine Learning · Computer Science 2025-05-20 Prakash Palanivelu Rajmohan , Fred Roosta

Deep ReLU Networks can be decomposed into a collection of linear models, each defined in a region of a partition of the input space. This paper provides three results extending this theory. First, we extend this linear decompositions to…

Machine Learning · Computer Science 2023-05-17 Mattia Jacopo Villani , Peter McBurney

Backpropagation algorithm is the cornerstone for neural network analysis. Paper extends it for training any derivatives of neural network's output with respect to its input. By the dint of it feedforward networks can be used to solve or…

Neural and Evolutionary Computing · Computer Science 2017-12-13 V. I. Avrutskiy