English
Related papers

Related papers: On Tractable Representations of Binary Neural Netw…

200 papers

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

To compute robust 2D assembly plans, we present an approach that combines geometric planning with a deep neural network. We train the network using the Box2D physics simulator with added stochastic noise to yield robustness scores--the…

Robotics · Computer Science 2020-09-22 Tzvika Geft , Aviv Tamar , Ken Goldberg , Dan Halperin

Analysis and manipulation of trained neural networks is a challenging and important problem. We propose a symbolic representation for piecewise-linear neural networks and discuss its efficient computation. With this representation, one can…

Machine Learning · Computer Science 2019-08-21 Matthew Sotoudeh , Aditya V. Thakur

There has been a great deal of recent interest in learning and approximation of functions that can be expressed as expectations of a given nonlinearity with respect to its random internal parameters. Examples of such representations include…

Optimization and Control · Mathematics 2022-12-05 Tanya Veeravalli , Maxim Raginsky

For every fixed $d \in \mathbb{N}$, we design a data structure that represents a binary $n \times n$ matrix that is $d$-twin-ordered. The data structure occupies $O_d(n)$ bits, which is the least one could hope for, and can be queried for…

Data Structures and Algorithms · Computer Science 2021-10-18 Michał Pilipczuk , Marek Sokołowski , Anna Zych-Pawlewicz

Neural Ordinary Differential Equations (NODEs) are a novel neural architecture, built around initial value problems with learned dynamics which are solved during inference. Thought to be inherently more robust against adversarial…

Machine Learning · Computer Science 2023-03-10 Mustafa Zeqiri , Mark Niklas Müller , Marc Fischer , Martin Vechev

This research introduces an extended application of neural networks for solving nonlinear partial differential equations (PDEs). A neural network, combined with a pseudo-arclength continuation, is proposed to construct bifurcation diagrams…

Numerical Analysis · Mathematics 2025-07-24 Muhammad Luthfi Shahab , Hadi Susanto

Understanding properties of deep neural networks is an important challenge in deep learning. In this paper, we take a step in this direction by proposing a rigorous way of verifying properties of a popular class of neural networks,…

Machine Learning · Statistics 2018-06-04 Nina Narodytska , Shiva Prasad Kasiviswanathan , Leonid Ryzhyk , Mooly Sagiv , Toby Walsh

Deep neural networks (DNNs) are powerful machine learning models and have succeeded in various artificial intelligence tasks. Although various architectures and modules for the DNNs have been proposed, selecting and designing the…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Shinichi Shirakawa , Yasushi Iwata , Youhei Akimoto

Node classification is one of the hottest tasks in graph analysis. Though existing studies have explored various node representations in directed and undirected graphs, they have overlooked the distinctions of their capabilities to capture…

Machine Learning · Computer Science 2023-12-07 Seiji Maekawa , Yuya Sasaki , Makoto Onizuka

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to…

Machine Learning · Computer Science 2022-09-09 Haoling Li , Jie Song , Mengqi Xue , Haofei Zhang , Jingwen Ye , Lechao Cheng , Mingli Song

Inspired by the recently introduced framework of AND/OR search spaces for graphical models, we propose to augment Multi-Valued Decision Diagrams (MDD) with AND nodes, in order to capture function decomposition structure and to extend these…

Artificial Intelligence · Computer Science 2014-01-16 Robert Mateescu , Rina Dechter , Radu Marinescu

We present a method to train self-binarizing neural networks, that is, networks that evolve their weights and activations during training to become binary. To obtain similar binary networks, existing methods rely on the sign activation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Fayez Lahoud , Radhakrishna Achanta , Pablo Márquez-Neila , Sabine Süsstrunk

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

Spiking Neural Networks (SNNs) have become an essential paradigm in neuroscience and artificial intelligence, providing brain-inspired computation. Recent advances in literature have studied the network representations of deep neural…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Biswadeep Chakraborty , Saibal Mukhopadhyay

Recently, the deep neural network (derived from the artificial neural network) has attracted many researchers' attention by its outstanding performance. However, since this network requires high-performance GPUs and large storage, it is…

Neural and Evolutionary Computing · Computer Science 2016-02-25 Song Wang , Dongchun Ren , Li Chen , Wei Fan , Jun Sun , Satoshi Naoi

Deep neural networks (DNNs) are known for extracting useful information from large amounts of data. However, the representations learned in DNNs are typically hard to interpret, especially in dense layers. One crucial issue of the classical…

Neural and Evolutionary Computing · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

Single neurons in neural networks are often interpretable in that they represent individual, intuitively meaningful features. However, many neurons exhibit $\textit{mixed selectivity}$, i.e., they represent multiple unrelated features. A…

Machine Learning · Statistics 2023-10-19 David Klindt , Sophia Sanborn , Francisco Acosta , Frédéric Poitevin , Nina Miolane

The operation of a system, such as a vehicle, communication network or automatic process, heavily depends on the correct operation of its components. A Stochastic Binary System (SBS) mathematically models the behavior of on-off systems,…

Discrete Mathematics · Computer Science 2020-11-05 Héctor Cancela , Gustavo Guerberoff , Franco Robledo , Pablo Romero