English
Related papers

Related papers: Bound Propagation meets Constraint Simplification:…

200 papers

Bound propagation based incomplete neural network verifiers such as CROWN are very efficient and can significantly accelerate branch-and-bound (BaB) based complete verification of neural networks. However, bound propagation cannot fully…

Machine Learning · Computer Science 2021-11-02 Shiqi Wang , Huan Zhang , Kaidi Xu , Xue Lin , Suman Jana , Cho-Jui Hsieh , J. Zico Kolter

This work aims to jointly optimize the coding and node selection to minimize the processing time for distributed computing tasks over wireless edge networks. Since the joint optimization problem formulation is NP-hard and nonlinear, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-11 Cong T. Nguyen , Diep N. Nguyen , Dinh Thai Hoang , Hoang-Anh Pham , Eryk Dutkiewicz

Existing high-performance deep learning models require very intensive computing. For this reason, it is difficult to embed a deep learning model into a system with limited resources. In this paper, we propose the novel idea of the network…

Machine Learning · Computer Science 2019-02-13 Dae-Woong Jeong , Jaehun Kim , Youngseok Kim , Tae-Ho Kim , Myungsu Chae

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar

With the emergence of Artificial Intelligence (AI)-based decision-making, explanations help increase new technology adoption through enhanced trust and reliability. However, our experimental study challenges the notion that every user…

Human-Computer Interaction · Computer Science 2024-05-01 Sabid Bin Habib Pias , Alicia Freel , Timothy Trammel , Taslima Akter , Donald Williamson , Apu Kapadia

The integration of low-level perception with high-level reasoning is one of the oldest problems in Artificial Intelligence. Recently, several proposals were made to implement the reasoning process in complex neural network architectures.…

Artificial Intelligence · Computer Science 2020-09-23 Zhun Yang

In this paper we study a constraint-based representation of neural network architectures. We cast the learning problem in the Lagrangian framework and we investigate a simple optimization procedure that is well suited to fulfil the…

Machine Learning · Computer Science 2020-04-20 Giuseppe Marra , Matteo Tiezzi , Stefano Melacci , Alessandro Betti , Marco Maggini , Marco Gori

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

Recurrent neural networks have proved to be an effective method for statistical language modeling. However, in practice their memory and run-time complexity are usually too large to be implemented in real-time offline mobile applications.…

Computation and Language · Computer Science 2019-04-09 Artem M. Grachev , Dmitry I. Ignatov , Andrey V. Savchenko

Explanation methods aim to make neural networks more trustworthy and interpretable. In this paper, we demonstrate a property of explanation methods which is disconcerting for both of these purposes. Namely, we show that explanations can be…

We derive upper bounds on the complexity of ReLU neural networks approximating the solution of a linear system given the matrix and the right-hand side. We focus on matrices which are symmetric positive definite and sparse, as they appear…

Numerical Analysis · Mathematics 2026-03-20 Benjamin Dörich , Roland Maier , Lukas Ullmer

Parity constraints, common in application domains such as circuit verification, bounded model checking, and logical cryptanalysis, are not necessarily most efficiently solved if translated into conjunctive normal form. Thus, specialized…

Logic in Computer Science · Computer Science 2014-06-19 Tero Laitinen , Tommi Junttila , Ilkka Niemelä

Explainable AI (XAI) has emerged as a powerful tool for improving the performance of AI models, going beyond providing model transparency and interpretability. The scarcity of labeled data remains a fundamental challenge in developing…

Computation and Language · Computer Science 2025-06-05 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Atnafu Lambebo Tonja , Hassan Shakil , Samer Iskander , Olga Kolesnikova , Jugal Kalita

A perturbative method is developed for calculating the effects of recurrent synaptic interactions between neurons embedded in a network. A series expansion is constructed that converges for networks with noisy membrane potential and weak…

Disordered Systems and Neural Networks · Physics 2009-11-10 Patrick D. Roberts

Binary Decision Diagram (BDD) based set bounds propagation is a powerful approach to solving set-constraint satisfaction problems. However, prior BDD based techniques in- cur the significant overhead of constructing and manipulating graphs…

Artificial Intelligence · Computer Science 2014-01-17 Graeme Gange , Peter James Stuckey , Vitaly Lagoon

In Constraint Programming, solving discrete minimization problems with hard and soft constraints can be done either using (i) soft global constraints, (ii) a reformulation into a linear program, or (iii) a reformulation into local cost…

Artificial Intelligence · Computer Science 2025-09-24 Pierre Montalbano , Simon de Givry , George Katsirelos

Network compression is crucial to making the deep networks to be more efficient, faster, and generalizable to low-end hardware. Current network compression methods have two open problems: first, there lacks a theoretical framework to…

Machine Learning · Computer Science 2022-06-09 Ziqi Zhou , Li Lian , Yilong Yin , Ze Wang

Deploying AI systems in public institutions can have far-reaching consequences for many people, making it a matter of public interest. Providing opportunities for stakeholders to come together, understand these systems, and debate their…

Human-Computer Interaction · Computer Science 2025-04-24 Timothée Schmude , Laura Koesten , Torsten Möller , Sebastian Tschiatschek

Recent deep-thinking large language models often reason extensively to improve performance, but such lengthy reasoning is not always desirable, as it incurs excessive inference costs with disproportionate performance gains. Controlling…

Computation and Language · Computer Science 2025-06-17 Junyan Li , Wenshuo Zhao , Yang Zhang , Chuang Gan

In recent years many methods have been developed to understand the internal workings of neural networks, often by describing the function of individual neurons in the model. However, these methods typically only focus on explaining the very…

Machine Learning · Computer Science 2024-05-14 Tuomas Oikarinen , Tsui-Wei Weng