English
Related papers

Related papers: Right for the Right Reasons: Training Differentiab…

200 papers

The lack of interpretability remains a key barrier to the adoption of deep models in many applications. In this work, we explicitly regularize deep models so human users might step through the process behind their predictions in little…

Machine Learning · Statistics 2017-11-17 Mike Wu , Michael C. Hughes , Sonali Parbhoo , Maurizio Zazzi , Volker Roth , Finale Doshi-Velez

Neural network architectures have been extensively employed in the fair representation learning setting, where the objective is to learn a new representation for a given vector which is independent of sensitive information. Various…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Artificial neural networks are often very complex and too deep for a human to understand. As a result, they are usually referred to as black boxes. For a lot of real-world problems, the underlying pattern itself is very complicated, such…

Machine Learning · Computer Science 2020-11-26 Yang Li

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and…

Artificial Intelligence · Computer Science 2022-11-11 Yuanlong Li , Gaopan Huang , Min Zhou , Chuan Fu , Honglin Qiao , Yan He

Decision making algorithms are used in a multitude of different applications. Conventional approaches for designing decision algorithms employ principled and simplified modelling, based on which one can determine decisions via tractable…

Signal Processing · Electrical Eng. & Systems 2022-06-23 Nir Shlezinger , Yonina C. Eldar , Stephen P. Boyd

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

We propose a novel explanation method that explains the decisions of a deep neural network by investigating how the intermediate representations at each layer of the deep network were refined during the training process. This way we can a)…

Machine Learning · Computer Science 2021-09-14 Lukas Pfahler , Katharina Morik

A major issue with using deep learning models in sensitive applications is that they provide no explanation for their output. To address this problem, unsupervised selective rationalization produces rationales alongside predictions by…

Computation and Language · Computer Science 2023-05-30 Adam Storek , Melanie Subbiah , Kathleen McKeown

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague…

Computation and Language · Computer Science 2023-02-14 Xudong Han , Timothy Baldwin , Trevor Cohn

Traditional approaches to ensure group fairness in algorithmic decision making aim to equalize ``total'' error rates for different subgroups in the population. In contrast, we argue that the fairness approaches should instead focus only on…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Preethi Lahoti , Krishna P. Gummadi

This paper describes the use of neural networks to enhance simulations for subsequent training of anomaly-detection systems. Simulations can provide edge conditions for anomaly detection which may be sparse or non-existent in real-world…

Neural and Evolutionary Computing · Computer Science 2020-11-06 Philip Feldman

In an attempt to better understand generalization in deep learning, we study several possible explanations. We show that implicit regularization induced by the optimization method is playing a key role in generalization and success of deep…

Machine Learning · Computer Science 2017-09-11 Behnam Neyshabur

Classic approaches to content moderation typically apply a rule-based heuristic approach to flag content. While rules are easily customizable and intuitive for humans to interpret, they are inherently fragile and lack the flexibility or…

Computation and Language · Computer Science 2023-07-25 Christopher Clarke , Matthew Hall , Gaurav Mittal , Ye Yu , Sandra Sajeev , Jason Mars , Mei Chen

Despite their massive size, successful deep artificial neural networks can exhibit a remarkably small difference between training and test performance. Conventional wisdom attributes small generalization error either to properties of the…

Machine Learning · Computer Science 2017-02-28 Chiyuan Zhang , Samy Bengio , Moritz Hardt , Benjamin Recht , Oriol Vinyals

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

Detection and identification of nonlinearity is a task of high importance for structural dynamics. Detecting nonlinearity in a structure, which has been designed to operate in its linear region, might indicate the existence of damage.…

Machine Learning · Computer Science 2024-01-08 G. Tsialiamanis , C. R. Farrar

The increasing use of deep learning across various domains highlights the importance of understanding the decision-making processes of these black-box models. Recent research focusing on the decision boundaries of deep classifiers, relies…

Machine Learning · Computer Science 2024-08-13 Inês Gomes , Luís F. Teixeira , Jan N. van Rijn , Carlos Soares , André Restivo , Luís Cunha , Moisés Santos

Modern statistical learning techniques have often emphasized prediction performance over interpretability, giving rise to "black box" models that may be difficult to understand, and to generalize to other settings. We conceptually divide a…

Methodology · Statistics 2019-09-16 Wenjia Wang , Yi-Hui Zhou

Learning accurate dynamics models is necessary for optimal, compliant control of robotic systems. Current approaches to white-box modeling using analytic parameterizations, or black-box modeling using neural networks, can suffer from high…

Robotics · Computer Science 2019-03-05 Jayesh K. Gupta , Kunal Menda , Zachary Manchester , Mykel J. Kochenderfer