中文
相关论文

相关论文: Sparse Oblique Decision Trees: A Tool to Understan…

200 篇论文

Deep models have advanced prediction in many domains, but their lack of interpretability remains a key barrier to the adoption in many real world applications. There exists a large body of work aiming to help humans understand these black…

机器学习 · 计算机科学 2019-08-15 Mike Wu , Sonali Parbhoo , Michael C. Hughes , Volker Roth , Finale Doshi-Velez

Random forests on the one hand, and neural networks on the other hand, have met great success in the machine learning community for their predictive performance. Combinations of both have been proposed in the literature, notably leading to…

机器学习 · 计算机科学 2021-10-15 Ludovic Arnould , Claire Boyer , Erwan Scornet , Sorbonne Lpsm

Obtaining versions of deep neural networks that are both highly-accurate and highly-sparse is one of the main challenges in the area of model compression, and several high-performance pruning techniques have been investigated by the…

机器学习 · 计算机科学 2023-09-11 Denis Kuznedelev , Eldar Kurtic , Eugenia Iofinova , Elias Frantar , Alexandra Peste , Dan Alistarh

Deep neural networks with lots of parameters are typically used for large-scale computer vision tasks such as image classification. This is a result of using dense matrix multiplications and convolutions. However, sparse computations are…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Suraj Srinivas , Akshayvarun Subramanya , R. Venkatesh Babu

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to…

机器学习 · 计算机科学 2022-09-09 Haoling Li , Jie Song , Mengqi Xue , Haofei Zhang , Jingwen Ye , Lechao Cheng , Mingli Song

Neural networks (NNs) are known to exhibit simplicity bias where they tend to prefer learning 'simple' features over more 'complex' ones, even when the latter may be more informative. Simplicity bias can lead to the model making biased…

机器学习 · 计算机科学 2023-10-11 Bhavya Vasudeva , Kameron Shahabi , Vatsal Sharan

With the explosion in the availability of spatio-temporal tracking data in modern sports, there is an enormous opportunity to better analyse, learn and predict important events in adversarial group environments. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2018-05-15 Tharindu Fernando , Sridha Sridharan , Clinton Fookes , Simon Denman

The decision tree recursively partitions the input space into regions and derives axis-aligned decision boundaries from data. Despite its simplicity and interpretability, decision trees lack parameterized representation, which makes it…

机器学习 · 计算机科学 2024-11-19 Jinxiong Zhang

While sparse coding-based clustering methods have shown to be successful, their bottlenecks in both efficiency and scalability limit the practical usage. In recent years, deep learning has been proved to be a highly effective, efficient and…

机器学习 · 计算机科学 2015-10-19 Zhangyang Wang , Shiyu Chang , Jiayu Zhou , Meng Wang , Thomas S. Huang

The performance of trained neural networks is robust to harsh levels of pruning. Coupled with the ever-growing size of deep learning models, this observation has motivated extensive research on learning sparse models. In this work, we focus…

机器学习 · 计算机科学 2022-11-29 Jose Gallego-Posada , Juan Ramirez , Akram Erraqabi , Yoshua Bengio , Simon Lacoste-Julien

We propose a novel explanation method that explains the decisions of a deep neural network by investigating how the intermediate representations at each layer of the deep network were refined during the training process. This way we can a)…

机器学习 · 计算机科学 2021-09-14 Lukas Pfahler , Katharina Morik

Finding neural network weights that generalize well from small datasets is difficult. A promising approach is to learn a weight initialization such that a small number of weight changes results in low generalization error. We show that this…

In Machine Learning, White Box Adversarial Attacks rely on knowing underlying knowledge about the model attributes. This works focuses on discovering to distrinct pieces of model information: the underlying architecture and primary training…

机器学习 · 计算机科学 2020-09-08 Josh Kalin , Matthew Ciolino , David Noever , Gerry Dozier

We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder.…

计算机视觉与模式识别 · 计算机科学 2020-02-11 Riccardo Guidotti , Anna Monreale , Stan Matwin , Dino Pedreschi

We introduce techniques for exploring the functionality of a neural network and extracting simple, human-readable approximations to its performance. By performing gradient ascent on the input space of the network, we are able to produce…

高能物理 - 唯象学 · 物理学 2018-04-26 Thomas Roxlo , Matthew Reece

Supervised classification of temporal sequences of astronomical images into meaningful transient astrophysical phenomena has been considered a hard problem because it requires the intervention of human experts. The classifier uses the…

天体物理仪器与方法 · 物理学 2020-10-07 Catalina Gómez , Mauricio Neira , Marcela Hernández Hoyos , Pablo Arbeláez , Jaime E. Forero-Romero

Deep learning has revolutionized human society, yet the black-box nature of deep neural networks hinders further application to reliability-demanded industries. In the attempt to unpack them, many works observe or impact internal variables…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Borui Zhang , Wenzhao Zheng , Jie Zhou , Jiwen Lu

TADS are a novel, concise white-box representation of neural networks. In this paper, we apply TADS to the problem of neural network verification, using them to generate either proofs or concise error characterizations for desirable neural…

机器学习 · 计算机科学 2023-05-01 Gerrit Nolte , Maximilian Schlüter , Alnis Murtovi , Bernhard Steffen

Axis-aligned decision forests have long been the leading class of machine learning algorithms for modeling tabular data. In many applications of machine learning such as learning-to-rank, decision forests deliver remarkable performance.…

机器学习 · 计算机科学 2020-09-22 Sebastian Bruch , Jan Pfeifer , Mathieu Guillame-bert

Decision Trees (DTs) constitute one of the major highly non-linear AI models, valued, e.g., for their efficiency on tabular data. Learning accurate DTs is, however, complicated, especially for oblique DTs, and does take a significant…

机器学习 · 计算机科学 2024-10-21 Subrat Prasad Panda , Blaise Genest , Arvind Easwaran , Ponnuthurai Nagaratnam Suganthan