English
Related papers

Related papers: Training Recurrent Neural Networks as a Constraint…

200 papers

We introduce tensor network contraction algorithms for counting satisfying assignments of constraint satisfaction problems (#CSPs). We represent each arbitrary #CSP formula as a tensor network, whose full contraction yields the number of…

Statistical Mechanics · Physics 2019-11-14 Stefanos Kourtis , Claudio Chamon , Eduardo R. Mucciolo , Andrei E. Ruckenstein

This paper presents a set of continuous-time distributed algorithms that solve unconstrained, separable, convex optimization problems over undirected networks with fixed topologies. The algorithms are developed using a Lyapunov function…

Systems and Control · Computer Science 2011-09-27 Jie Lu , Choon Yik Tang

The Travelling Salesman Problem (TSP) is a classical combinatorial optimisation problem. Deep learning has been successfully extended to meta-learning, where previous solving efforts assist in learning how to optimise future optimisation…

Machine Learning · Computer Science 2020-11-04 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

As the state-of-the-art machine learning methods in many fields rely on larger datasets, storing datasets and training models on them become significantly more expensive. This paper proposes a training set synthesis technique for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen

Training a classifier under non-convex constraints has gotten increasing attention in the machine learning community thanks to its wide range of applications such as algorithmic fairness and class-imbalanced classification. However, several…

Machine Learning · Statistics 2022-10-31 You-Lin Chen , Zhaoran Wang , Mladen Kolar

An ongoing challenge in neural information processing is: how do neurons adjust their connectivity to improve task performance over time (i.e., actualize learning)? It is widely believed that there is a consistent, synaptic-level learning…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Aman Bhargava , Mohammad R. Rezaei , Milad Lankarany

Neural networks are a group of neurons stacked together in multiple layers to mimic the biological neurons in a human brain. Neural networks have been trained using the backpropagation algorithm based on gradient descent strategy for…

Neural and Evolutionary Computing · Computer Science 2025-04-22 Deepak Kumar

A constraint satisfaction problem (CSP) is a computational problem where the input consists of a finite set of variables and a finite set of constraints, and where the task is to decide whether there exists a satisfying assignment of values…

Computational Complexity · Computer Science 2019-04-23 Manuel Bodirsky

Optimization algorithms for solving nonconvex inverse problem have attracted significant interests recently. However, existing methods require the nonconvex regularization to be smooth or simple to ensure convergence. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Qingchao Zhang , Xiaojing Ye , Hongcheng Liu , Yunmei Chen

We consider Markov Decision Problems defined over continuous state and action spaces, where an autonomous agent seeks to learn a map from its states to actions so as to maximize its long-term discounted accumulation of rewards. We address…

Machine Learning · Computer Science 2018-04-23 Alec Koppel , Ekaterina Tolstaya , Ethan Stump , Alejandro Ribeiro

A Qualitative Constraint Network (QCN) is a constraint graph for representing problems under qualitative temporal and spatial relations, among others. More formally, a QCN includes a set of entities, and a list of qualitative constraints…

Artificial Intelligence · Computer Science 2021-09-27 Malek Mouhoub , Hamad Al Marri , Eisa Alanazi

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

In Programming by Demonstration, the robot learns novel skills from human demonstrations. After learning, the robot should be able not only to reproduce the skill, but also to generalize it to shifted domains without collecting new training…

Robotics · Computer Science 2023-11-07 Hector Perez-Villeda , Justus Piater , Matteo Saveriano

Distributed machine learning has recently become a critical paradigm for training large models on vast datasets. We examine the stochastic optimization problem for deep learning within synchronous parallel computing environments under…

Machine Learning · Computer Science 2024-11-07 Yoni Choukroun , Shlomi Azoulay , Pavel Kisilev

Backtracking search algorithms are often used to solve the Constraint Satisfaction Problem (CSP). The efficiency of backtracking search depends greatly on the variable ordering heuristics. Currently, the most commonly used heuristics are…

Artificial Intelligence · Computer Science 2021-12-28 Wen Song , Zhiguang Cao , Jie Zhang , Andrew Lim

Quantum Machine Learning is an emerging sub-field in machine learning where one of the goals is to perform pattern recognition tasks by encoding data into quantum states. This extension from classical to quantum domain has been made…

Quantum Physics · Physics 2023-04-18 Ankit Kulshrestha , Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Ilya Safro

In training neural networks, it is common practice to use partial gradients computed over batches, mostly very small subsets of the training set. This approach is motivated by the argument that such a partial gradient is close to the true…

Machine Learning · Computer Science 2024-11-25 Jan Spörer , Bernhard Bermeitinger , Tomas Hrycej , Niklas Limacher , Siegfried Handschuh

Gate-based quantum computations represent an essential to realize near-term quantum computer architectures. A gate-model quantum neural network (QNN) is a QNN implemented on a gate-model quantum computer, realized via a set of unitaries…

Quantum Physics · Physics 2019-09-04 Laszlo Gyongyosi , Sandor Imre

Quadratic Assignment Problem (QAP) is a practical combinatorial optimization problems that has been studied for several years. Since it is NP-hard, solving large problem instances of QAP is challenging. Although heuristics can find…

Machine Learning · Computer Science 2024-04-02 Satoko Iida , Ryota Yasudo

This paper introduces a new algorithm for solving a sub-class of quantified constraint satisfaction problems (QCSP) where existential quantifiers precede universally quantified inequalities on continuous domains. This class of QCSPs has…

Numerical Analysis · Computer Science 2008-07-16 Alexandre Goldsztejn , Claude Michel , Michel Rueher