English
Related papers

Related papers: Pruning Bayesian Networks for Efficient Computatio…

200 papers

We study the min-cost seed selection problem in online social networks, where the goal is to select a set of seed nodes with the minimum total cost such that the expected number of influenced nodes in the network exceeds a predefined…

Data Structures and Algorithms · Computer Science 2017-12-21 Kai Han , Yuntian He , Xiaokui Xiao , Shaojie Tang , Jingxin Xu , Liusheng Huang

We introduce semiparametric Bayesian networks that combine parametric and nonparametric conditional probability distributions. Their aim is to incorporate the advantages of both components: the bounded complexity of parametric models and…

Machine Learning · Computer Science 2021-09-08 David Atienza , Concha Bielza , Pedro Larrañaga

A recent work by Ramanujan et al. (2020) provides significant empirical evidence that sufficiently overparameterized, random neural networks contain untrained subnetworks that achieve state-of-the-art accuracy on several predictive tasks. A…

Machine Learning · Computer Science 2021-10-26 Kartik Sreenivasan , Shashank Rajput , Jy-yong Sohn , Dimitris Papailiopoulos

We present a new approach for inference in Bayesian networks, which is mainly based on partial differentiation. According to this approach, one compiles a Bayesian network into a multivariate polynomial and then computes the partial…

Artificial Intelligence · Computer Science 2013-01-18 Adnan Darwiche

Neural networks have seen limited use in prediction for high-dimensional data with small sample sizes, because they tend to overfit and require tuning many more hyperparameters than existing off-the-shelf machine learning methods. With…

Machine Learning · Statistics 2020-05-12 Jean Feng , Noah Simon

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

Machine Learning · Computer Science 2024-08-12 Joaquin Alvarez

It is common to encounter situations where one must solve a sequence of similar computational problems. Running a standard algorithm with worst-case runtime guarantees on each instance will fail to take advantage of valuable structure…

Machine Learning · Computer Science 2019-04-29 Daniel Alabi , Adam Tauman Kalai , Katrina Ligett , Cameron Musco , Christos Tzamos , Ellen Vitercik

Bayesian networks are now being used in enormous fields, for example, diagnosis of a system, data mining, clustering and so on. In spite of their wide range of applications, the statistical properties have not yet been clarified, because…

Machine Learning · Computer Science 2012-12-12 Keisuke Yamazaki , Sumio Watanbe

Many algorithms for score-based Bayesian network structure learning (BNSL), in particular exact ones, take as input a collection of potentially optimal parent sets for each variable in the data. Constructing such collections naively is…

Machine Learning · Statistics 2020-08-04 Alvaro H. C. Correia , James Cussens , Cassio de Campos

Pruning on neural networks before training not only compresses the original models, but also accelerates the network training phase, which has substantial application value. The current work focuses on fine-grained pruning, which uses…

Machine Learning · Computer Science 2022-09-28 Xiatao Kang , Ping Li , Jiayi Yao , Chengxi Li

We develop a fast, tractable technique called Net-Trim for simplifying a trained neural network. The method is a convex post-processing module, which prunes (sparsifies) a trained network layer by layer, while preserving the internal…

Machine Learning · Computer Science 2019-02-27 Alireza Aghasi , Afshin Abdi , Justin Romberg

Currently, Deep Convolutional Neural Networks (DCNNs) are used to solve all kinds of problems in the field of machine learning and artificial intelligence due to their learning and adaptation capabilities. However, most successful DCNN…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Francisco Erivaldo Fernandes Junior , Gary G. Yen

This paper introduces a computational framework for reasoning in Bayesian belief networks that derives significant advantages from focused inference and relevance reasoning. This framework is based on d -separation and other simple and…

Artificial Intelligence · Computer Science 2013-02-08 Yan Lin , Marek J. Druzdzel

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

For decomposable score-based structure learning of Bayesian networks, existing approaches first compute a collection of candidate parent sets for each variable and then optimize over this collection by choosing one parent set for each…

Artificial Intelligence · Computer Science 2017-07-20 Cassio P. de Campos , Mauro Scanagatta , Giorgio Corani , Marco Zaffalon

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

Channel pruning, which seeks to reduce the model size by removing redundant channels, is a popular solution for deep networks compression. Existing channel pruning methods usually conduct layer-wise channel selection by directly minimizing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yiming Hu , Siyang Sun , Jianquan Li , Jiagang Zhu , Xingang Wang , Qingyi Gu

One surprising trait of neural networks is the extent to which their connections can be pruned with little to no effect on accuracy. But when we cross a critical level of parameter sparsity, pruning any further leads to a sudden drop in…

Machine Learning · Computer Science 2023-01-20 Junyang Cai , Khai-Nguyen Nguyen , Nishant Shrestha , Aidan Good , Ruisen Tu , Xin Yu , Shandian Zhe , Thiago Serra

Data sets are growing in complexity thanks to the increasing facilities we have nowadays to both generate and store data. This poses many challenges to machine learning that are leading to the proposal of new methods and paradigms, in order…

Machine Learning · Computer Science 2018-12-04 Irene Córdoba , Concha Bielza , Pedro Larrañaga

Pruning is an efficient model compression technique to remove redundancy in the connectivity of deep neural networks (DNNs). Computations using sparse matrices obtained by pruning parameters, however, exhibit vastly different parallelism…

Machine Learning · Computer Science 2019-05-15 Dongsoo Lee , Se Jung Kwon , Byeongwook Kim , Parichay Kapoor , Gu-Yeon Wei