English
Related papers

Related papers: The Complexity of Integer Bound Propagation

200 papers

Neural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data augmentation to partially mitigate such…

Computation and Language · Computer Science 2019-12-23 Po-Sen Huang , Robert Stanforth , Johannes Welbl , Chris Dyer , Dani Yogatama , Sven Gowal , Krishnamurthy Dvijotham , Pushmeet Kohli

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. Message passing is…

Artificial Intelligence · Computer Science 2019-06-05 Andrea Montanari , Federico Ricci-Tersenghi , Guilhem Semerjian

Cut-set bounds on achievable rates for network communication protocols are not in general tight. In this paper we introduce a new technique for proving converses for the problem of transmission of correlated sources in networks, that…

Information Theory · Computer Science 2011-05-31 Amin Aminzadeh Gohari , Shenghao Yang , Sidharth Jaggi

Dynamic diversification---finding a set of data points with maximum diversity from a time-dependent sample pool---is an important task in recommender systems, web search, database search, and notification services, to avoid showing users…

Data Structures and Algorithms · Computer Science 2018-06-19 Hannah Marienwald , Wikor Pronobis , Klaus-Robert Müller , Shinichi Nakajima

Neural machine translation often adopts the fine-tuning approach to adapt to specific domains. However, nonrestricted fine-tuning can easily degrade on the general domain and over-fit to the target domain. To mitigate the issue, we propose…

Computation and Language · Computer Science 2021-03-29 Jianze Liang , Chengqi Zhao , Mingxuan Wang , Xipeng Qiu , Lei Li

The talent scheduling problem is a simplified version of the real-world film shooting problem, which aims to determine a shooting sequence so as to minimize the total cost of the actors involved. In this article, we first formulate the…

Artificial Intelligence · Computer Science 2014-01-24 Zizhen Zhang , Hu Qin , Xiaocong Liang , Andrew Lim

Recurrent neural networks (RNNs) are a class of neural networks used in sequential tasks. However, in general, RNNs have a large number of parameters and involve enormous computational costs by repeating the recurrent structures in many…

Machine Learning · Statistics 2024-03-25 Takashi Furuya , Kazuma Suetake , Koichi Taniguchi , Hiroyuki Kusumoto , Ryuji Saiin , Tomohiro Daimon

Influence propagation has been the subject of extensive study due to its important role in social networks, epidemiology, and many other areas. Understanding propagation mechanisms is critical to control the spread of fake news or…

Optimization and Control · Mathematics 2022-09-28 Vinicius Ferreira , Artur Pessoa , Thibaut Vidal

Precision tuning or customized precision number representations is emerging, in these recent years, as one of the most promising techniques that has a positive impact on the footprint of programs concerning energy consumption, bandwidth…

Software Engineering · Computer Science 2022-03-16 Dorra Ben Khalifa , Matthieu Martel

We study the complexity of identifying the integer feasibility of reverse convex sets. We present various settings where the complexity can be either NP-Hard or efficiently solvable when the dimension is fixed. Of particular interest is the…

Optimization and Control · Mathematics 2024-09-10 Robert Hildebrand , Adrian Göß

Structured pruning is a popular method for compressing a neural network: given a large trained network, one alternates between removing channel connections and fine-tuning; reducing the overall width of the network. However, the efficacy of…

Machine Learning · Statistics 2019-06-10 Elliot J. Crowley , Jack Turner , Amos Storkey , Michael O'Boyle

An approach to reasoning with default rules where the proportion of exceptions, or more generally the probability of encountering an exception, can be at least roughly assessed is presented. It is based on local uncertainty propagation…

Artificial Intelligence · Computer Science 2013-03-26 Stephane Amarger , Didier Dubois , Henri Prade

We introduce a technique to compute probably approximately correct (PAC) bounds on precision and recall for matching algorithms. The bounds require some verified matches, but those matches may be used to develop the algorithms. The bounds…

Machine Learning · Computer Science 2016-04-12 Ya Le , Eric Bax , Nicola Barbieri , David Garcia Soriano , Jitesh Mehta , James Li

This paper is concerned with distributed computation of several commonly used centrality measures in complex networks. In particular, we propose deterministic algorithms, which converge in finite time, for the distributed computation of the…

Systems and Control · Computer Science 2016-11-15 Keyou You , Roberto Tempo , Li Qiu

We propose a method combining boundary integral equations and neural networks (BINet) to solve partial differential equations (PDEs) in both bounded and unbounded domains. Unlike existing solutions that directly operate over original PDEs,…

Numerical Analysis · Mathematics 2021-10-04 Guochang Lin , Pipi Hu , Fukai Chen , Xiang Chen , Junqing Chen , Jun Wang , Zuoqiang Shi

We suggest analyzing neural networks through the prism of space constraints. We observe that most training algorithms applied in practice use bounded memory, which enables us to use a new notion introduced in the study of space-time…

Machine Learning · Computer Science 2017-03-03 Michal Moshkovitz , Naftali Tishby

Belief propagation approaches, such as Max-Sum and its variants, are a kind of important methods to solve large-scale Distributed Constraint Optimization Problems (DCOPs). However, for problems with n-ary constraints, these algorithms face…

Multiagent Systems · Computer Science 2019-06-19 Ziyu Chen , Xingqiong Jiang , Yanchen Deng , Dingding Chen , Zhongshi He

Since the beginning of the development of interior-point methods, there exists a puzzling gap between the results in theory and the observations in numerical experience, i.e., algorithms with good polynomial bound are not computationally…

Optimization and Control · Mathematics 2018-03-02 Yaguang Yang

As the need for more accurate and powerful Convolutional Neural Networks (CNNs) increases, so too does the size, execution time, memory footprint, and power consumption. To overcome this, solutions such as pruning have been proposed with…

Artificial Intelligence · Computer Science 2026-02-20 Joseph Bingham , Sam Helmich

Finding feasible points for which the proof succeeds is a critical issue in safe Branch and Bound algorithms which handle continuous problems. In this paper, we introduce a new strategy to compute very accurate approximations of feasible…

Numerical Analysis · Computer Science 2008-07-16 Alexandre Goldsztejn , Yahia Lebbah , Claude Michel , Michel Rueher