English
Related papers

Related papers: $\Lambda$-DARTS: Mitigating Performance Collapse b…

200 papers

Albeit being a prevalent architecture searching approach, differentiable architecture search (DARTS) is largely hindered by its substantial memory cost since the entire supernet resides in the memory. This is where the single-path DARTS…

Machine Learning · Computer Science 2023-08-04 Xiaoxing Wang , Xiangxiang Chu , Yuda Fan , Zhexi Zhang , Bo Zhang , Xiaokang Yang , Junchi Yan

Existing neural architecture search (NAS) methods often return an architecture with good search performance but generalizes poorly to the test setting. To achieve better generalization, we propose a novel neighborhood-aware NAS formulation…

Machine Learning · Computer Science 2021-11-01 Xiaofang Wang , Shengcao Cao , Mengtian Li , Kris M. Kitani

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

Machine Learning · Computer Science 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Strong priors are imposed on the search space of Differentiable Architecture Search (DARTS), such that cells of the same type share the same topological structure and each intermediate node retains two operators from distinct nodes. While…

Machine Learning · Computer Science 2025-04-30 Xuan Rao , Bo Zhao , Derong Liu , Cesare Alippi

Spiking Neural Networks (SNNs) have gained enormous popularity in the field of artificial intelligence due to their low power consumption. However, the majority of SNN methods directly inherit the structure of Artificial Neural Networks…

Neural and Evolutionary Computing · Computer Science 2024-11-05 Yilei Man , Linhai Xie , Shushan Qiao , Yumei Zhou , Delong Shang

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

Speech Emotion Recognition (SER) is a critical enabler of emotion-aware communication in human-computer interactions. Recent advancements in Deep Learning (DL) have substantially enhanced the performance of SER models through increased…

Sound · Computer Science 2024-01-22 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Berrak Sisman , Björn Schuller

Differentiable ARchiTecture Search (DARTS) has attracted much attention due to its simplicity and significant improvement in efficiency. However, the excessive accumulation of the skip connection, when training epochs become large, makes it…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Chao Li , Jia Ning , Han Hu , Kun He

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Neural architecture search (NAS) has shown great promise in the field of automated machine learning (AutoML). NAS has outperformed hand-designed networks and made a significant step forward in the field of automating the design of deep…

Machine Learning · Computer Science 2022-05-16 Matej Grobelnik , Joaquin Vanschoren

Neural Architecture Search (NAS) has been widely adopted to design neural networks for various computer vision tasks. One of its most promising subdomains is differentiable NAS (DNAS), where the optimal architecture is found in a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Konstanty Subbotko , Wojciech Jablonski , Piotr Bilinski

This study aims at making the architecture search process more adaptive for one-shot or online training. It is extended from the existing study on differentiable neural architecture search, and we made the backbone architecture…

Artificial Intelligence · Computer Science 2021-06-15 Renlong Jie , Junbin Gao

Accurate classification of medical images is essential for modern diagnostics. Deep learning advancements led clinicians to increasingly use sophisticated models to make faster and more accurate decisions, sometimes replacing human…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Lunchen Xie , Eugenio Lomurno , Matteo Gambella , Danilo Ardagna , Manuel Roveri , Matteo Matteucci , Qingjiang Shi

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

Machine Learning · Computer Science 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Differentiable Architecture Search (DARTS) provides a baseline for searching effective network architectures based gradient, but it is accompanied by huge computational overhead in searching and training network architecture. Recently, many…

Machine Learning · Computer Science 2020-10-19 Zhaowen Wang , Wei Zhang , Zhiming Wang

The search cost of neural architecture search (NAS) has been largely reduced by weight-sharing methods. These methods optimize a super-network with all possible edges and operations, and determine the optimal sub-network by discretization,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Yunjie Tian , Chang Liu , Lingxi Xie , Jianbin Jiao , Qixiang Ye

This paper reports the first successful application of a differentiable architecture search (DARTS) approach to the deepfake and spoofing detection problems. An example of neural architecture search, DARTS operates upon a continuous,…

Machine Learning · Computer Science 2021-07-01 Wanying Ge , Michele Panariello , Jose Patino , Massimiliano Todisco , Nicholas Evans