English
Related papers

Related papers: Finding Competitive Network Architectures Within a…

200 papers

Finding optimal channel dimensions (i.e., the number of filters in DNN layers) is essential to design DNNs that perform well under computational resource constraints. Recent work in neural architecture search aims at automating the…

Machine Learning · Computer Science 2023-06-16 Ahmet Caner Yüzügüler , Nikolaos Dimitriadis , Pascal Frossard

This article presents MCTS-BN, an adaptation of the Monte Carlo Tree Search (MCTS) algorithm for the structural learning of Bayesian Networks (BNs). Initially designed for game tree exploration, MCTS has been repurposed to address the…

Machine Learning · Computer Science 2025-02-04 Jorge D. Laborda , Pablo Torrijos , José M. Puerta , José A. Gámez

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Temporal Graph Neural Networks (TGNNs) have emerged as powerful tools for modeling dynamic interactions across various domains. The design space of TGNNs is notably complex, given the unique challenges in runtime efficiency and scalability…

Machine Learning · Computer Science 2024-12-31 Yuxin Yang , Hongkuan Zhou , Rajgopal Kannan , Viktor Prasanna

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Deep learning researchers and practitioners usually leverage GPUs to help train their deep neural networks (DNNs) faster. However, choosing which GPU to use is challenging both because (i) there are many options, and (ii) users grapple with…

Machine Learning · Computer Science 2021-06-09 Geoffrey X. Yu , Yubo Gao , Pavel Golikov , Gennady Pekhimenko

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao

Similarity search finds application in specialized database systems handling complex data such as images or videos, which are typically represented by high-dimensional features and require specific indexing structures. This paper tackles…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jeff Johnson , Matthijs Douze , Hervé Jégou

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

Machine Learning · Computer Science 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis

Deep Learning has enabled remarkable progress over the last years on a variety of tasks, such as image recognition, speech recognition, and machine translation. One crucial aspect for this progress are novel neural architectures. Currently…

Machine Learning · Statistics 2019-04-29 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

Neural Architecture Search has achieved state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, many assumptions, that require human definition, related with the problems being solved or the…

Machine Learning · Computer Science 2020-08-03 Vasco Lopes , Luís A. Alexandre

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

Machine Learning · Computer Science 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

Machine Learning · Computer Science 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

The robustness of deep neural networks (DNN) models has attracted increasing attention due to the urgent need for security in many applications. Numerous existing open-sourced tools or platforms are developed to evaluate the robustness of…

Machine Learning · Computer Science 2023-01-18 Jialiang Sun , Wen Yao , Tingsong Jiang , Chao Li , Xiaoqian Chen

Neural architecture search (NAS) for Graph neural networks (GNNs), called NAS-GNNs, has achieved significant performance over manually designed GNN architectures. However, these methods inherit issues from the conventional NAS methods, such…

Machine Learning · Computer Science 2023-06-19 Peng Xu , Lin Zhang , Xuanzhou Liu , Jiaqi Sun , Yue Zhao , Haiqin Yang , Bei Yu

Deep neural network architectures have traditionally been designed and explored with human expertise in a long-lasting trial-and-error process. This process requires huge amount of time, expertise, and resources. To address this tedious…

Machine Learning · Statistics 2018-07-23 Aliasghar Mortazi , Ulas Bagci

Long training times for high-accuracy deep neural networks (DNNs) impede research into new DNN architectures and slow the development of high-accuracy DNNs. In this paper we present FireCaffe, which successfully scales deep neural network…

Computer Vision and Pattern Recognition · Computer Science 2016-01-11 Forrest N. Iandola , Khalid Ashraf , Matthew W. Moskewicz , Kurt Keutzer

The growing capacity of neural networks has strongly contributed to their success at complex machine learning tasks and the computational demand of such large models has, in turn, stimulated a significant improvement in the hardware…

Machine Learning · Computer Science 2021-04-27 Mohammed Amer , Tomás Maul , Iman Yi Liao

We consider Monte-Carlo Tree Search (MCTS) applied to Markov Decision Processes (MDPs) and Partially Observable MDPs (POMDPs), and the well-known Upper Confidence bound for Trees (UCT) algorithm. In UCT, a tree with nodes (states) and edges…

Artificial Intelligence · Computer Science 2020-07-14 Tuan Dam , Pascal Klink , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…