English
Related papers

Related papers: Nested Search versus Limited Discrepancy Search

200 papers

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Machine Learning · Computer Science 2019-08-01 Stanisław Jastrzębski , Quentin de Laroussilhe , Mingxing Tan , Xiao Ma , Neil Houlsby , Andrea Gesmundo

A new variant of the classic capacitated facility location problem, which considers incompatibilities between customers, has recently been introduced in the literature. This problem captures the situation where given pairs of customers…

Artificial Intelligence · Computer Science 2026-05-28 Ida Gjergji , Lucas Kletzander , Nysret Musliu , Andrea Schaerf

Neural Architecture Search (NAS) is a research field concerned with utilizing optimization algorithms to design optimal neural network architectures. There are many approaches concerning the architectural search spaces, optimization…

Machine Learning · Computer Science 2020-05-25 George Kyriakides , Konstantinos Margaritis

For the exploration of large state spaces, symbolic search using binary decision diagrams (BDDs) can save huge amounts of memory and computation time. State sets are represented and modified by accessing and manipulating their…

Artificial Intelligence · Computer Science 2012-10-25 Stefan Edelkamp , Peter Kissmann , Álvaro Torralba

We introduce AdaSub, a stochastic optimization algorithm that computes a search direction based on second-order information in a low-dimensional subspace that is defined adaptively based on available current and past information. Compared…

Optimization and Control · Mathematics 2023-11-08 João Victor Galvão da Mata , Martin S. Andersen

We propose a new random method to minimize deterministic continuous functions over subsets $\mathcal{S}$ of high-dimensional space $\mathbb{R}^K$ without assuming convexity. Our procedure alternates between a Global Search (GS) regime to…

Data Analysis, Statistics and Probability · Physics 2025-06-09 Pierre Bertrand , Michel Broniatowski , Wolfgang Stummer

Distributed Nash equilibrium (NE) seeking problem for multi-coalition games has attracted increasing attention in recent years, but the research mainly focuses on the case without agreement demand within coalitions. This paper considers a…

Optimization and Control · Mathematics 2021-12-10 Jialing Zhou , Yuezu Lv , Guanghui Wen , Jinhu Lv , Dezhi Zheng

Pareto Local Search (PLS) is a basic building block in many metaheuristics for Multiobjective Combinatorial Optimization Problem (MCOP). In this paper, an enhanced PLS variant called Parallel Pareto Local Search based on Decomposition…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-12 Jialong Shi , Qingfu Zhang , Jianyong Sun

Differentiable neural architecture search methods became popular in recent years, mainly due to their low search costs and flexibility in designing the search space. However, these methods suffer the difficulty in optimizing network, so…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Bowen Shi , Qi Tian , Hongkai Xiong

Weight sharing promises to make neural architecture search (NAS) tractable even on commodity hardware. Existing methods in this space rely on a diverse set of heuristics to design and train the shared-weight backbone network, a.k.a. the…

Machine Learning · Computer Science 2021-10-05 Kaicheng Yu , René Ranftl , Mathieu Salzmann

Decoding for many NLP tasks requires an effective heuristic algorithm for approximating exact search since the problem of searching the full output space is often intractable, or impractical in many settings. The default algorithm for this…

Computation and Language · Computer Science 2022-11-16 Clara Meister , Tim Vieira , Ryan Cotterell

This article presents the long-term behaviour analysis of Stochastic Diffusion Search (SDS), a distributed agent-based system for best-fit pattern matching. SDS operates by allocating simple agents into different regions of the search…

Artificial Intelligence · Computer Science 2007-05-23 Slawomir J. Nasuto , Mark J. Bishop

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

Machine Learning · Computer Science 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

A commonly used technique for managing AI complexity in real-time strategy (RTS) games is to use action and/or state abstractions. High-level abstractions can often lead to good strategic decision making, but tactical decision quality may…

Artificial Intelligence · Computer Science 2017-09-12 Nicolas A. Barriga , Marius Stanescu , Michael Buro

We study the $r$-near neighbors reporting problem ($r$-NN), i.e., reporting \emph{all} points in a high-dimensional point set $S$ that lie within a radius $r$ of a given query point $q$. Our approach builds upon on the locality-sensitive…

Databases · Computer Science 2017-03-29 Ninh Pham

Absence of large-scale labeled data in the practitioner's target domain can be a bottleneck to applying machine learning algorithms in practice. Transfer learning is a popular strategy for leveraging additional data to improve the…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Sasha Doubov , David Acuna , Sanja Fidler

Search is a central problem in artificial intelligence, and breadth-first search (BFS) and depth-first search (DFS) are the two most fundamental ways to search. In this paper we derive estimates for average BFS and DFS runtime. The average…

Artificial Intelligence · Computer Science 2018-04-13 Tom Everitt , Marcus Hutter

In this work, we study the task of scheduling jobs on a single machine with sequence dependent family setup times under the goal of minimizing the makespan, that is, the completion time of the last job in the schedule. This notoriously…

Data Structures and Algorithms · Computer Science 2025-03-25 Kaja Balzereit , Niels Grüttemeier , Nils Morawietz , Dennis Reinhardt , Stefan Windmann , Petra Wolf

Under normality and homoscedasticity assumptions, Linear Discriminant Analysis (LDA) is known to be optimal in terms of minimising the Bayes error for binary classification. In the heteroscedastic case, LDA is not guaranteed to minimise…

Machine Learning · Computer Science 2017-03-27 Kojo Sarfo Gyamfi , James Brusey , Andrew Hunt , Elena Gaura