English
Related papers

Related papers: Smooth Variational Graph Embeddings for Efficient …

200 papers

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

Machine Learning · Computer Science 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

Sound · Computer Science 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Neural architecture search (NAS) automates the design process of high-performing architectures, but remains bottlenecked by expensive performance evaluation. Most existing studies that achieve faster evaluation are mostly tied to cell-based…

Machine Learning · Computer Science 2025-10-07 Shiwen Qin , Alexander Auras , Shay B. Cohen , Elliot J. Crowley , Michael Moeller , Linus Ericsson , Jovita Lukasik

Graph neural architecture search (GraphNAS) has recently aroused considerable attention in both academia and industry. However, two key challenges seriously hinder the further research of GraphNAS. First, since there is no consensus for the…

Machine Learning · Computer Science 2024-03-12 Yijian Qin , Ziwei Zhang , Xin Wang , Zeyang Zhang , Wenwu Zhu

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational costs, most recent approaches to NAS as well as the few…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jovita Lukasik , David Friede , Heiner Stuckenschmidt , Margret Keuper

The efficient, automated search for well-performing neural architectures (NAS) has drawn increasing attention in the recent past. Thereby, the predominant research objective is to reduce the necessity of costly evaluations of neural…

Machine Learning · Computer Science 2022-08-02 Jovita Lukasik , Steffen Jung , Margret Keuper

Most differentiable neural architecture search methods construct a super-net for search and derive a target-net as its sub-graph for evaluation. There exists a significant gap between the architectures in search and evaluation. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Yibo Yang , Shan You , Hongyang Li , Fei Wang , Chen Qian , Zhouchen Lin

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Neural architecture search (NAS) in expressive search spaces is a computationally hard problem, but it also holds the potential to automatically discover completely novel and performant architectures. To achieve this we need effective…

Neural and Evolutionary Computing · Computer Science 2025-12-05 Adri Gómez Martín , Felix Möller , Steven McDonagh , Monica Abella , Manuel Desco , Elliot J. Crowley , Aaron Klein , Linus Ericsson

There has been a large literature of neural architecture search, but most existing work made use of heuristic rules that largely constrained the search flexibility. In this paper, we first relax these manually designed constraints and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Kaifeng Bi , Lingxi Xie , Xin Chen , Longhui Wei , Qi Tian

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

Machine Learning · Computer Science 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Graph neural architecture search (NAS) has gained popularity in automatically designing powerful graph neural networks (GNNs) with relieving human efforts. However, existing graph NAS methods mainly work under the homophily assumption and…

Machine Learning · Computer Science 2023-02-27 Xin Zheng , Miao Zhang , Chunyang Chen , Qin Zhang , Chuan Zhou , Shirui Pan

We introduce Universal Neural Architecture Space (UniNAS), a generic search space for neural architecture search (NAS) which unifies convolutional networks, transformers, and their hybrid architectures under a single, flexible framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Ondřej Týbl , Lukáš Neumann

Early Exit Neural Networks (EENNs) endow astandard Deep Neural Network (DNN) with Early Exit Classifiers (EECs), to provide predictions at intermediate points of the processing when enough confidence in classification is achieved. This…

Machine Learning · Computer Science 2025-08-07 Matteo Gambella , Jary Pomponi , Simone Scardapane , Manuel Roveri