中文
相关论文

相关论文: Homogeneous Architecture Augmentation for Neural P…

200 篇论文

Deep neural networks have recently drawn considerable attention to build and evaluate artificial learning models for perceptual tasks. Here, we present a study on the performance of the deep learning models to deal with global optimization…

神经与进化计算 · 计算机科学 2020-12-18 Hojjat Rakhshani , Lhassane Idoumghar , Soheila Ghambari , Julien Lepagnot , Mathieu Brévilliers

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

声音 · 计算机科学 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

Data augmentation is an effective technique to improve the generalization of deep neural networks. Recently, AutoAugment proposed a well-designed search space and a search algorithm that automatically finds augmentation policies in a…

计算机视觉与模式识别 · 计算机科学 2021-10-08 Chih-Yang Chen , Che-Han Chang

Recently, predictor-based algorithms emerged as a promising approach for neural architecture search (NAS). For NAS, we typically have to calculate the validation accuracy of a large number of Deep Neural Networks (DNNs), what is…

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Designing effective neural architectures poses a significant challenge in deep learning. While Neural Architecture Search (NAS) automates the search for optimal architectures, existing methods are often constrained by predetermined search…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zekang Yang , Wang Zeng , Sheng Jin , Chen Qian , Ping Luo , Wentao Liu

Cognitive diagnosis plays a vital role in modern intelligent education platforms to reveal students' proficiency in knowledge concepts for subsequent adaptive tasks. However, due to the requirement of high model interpretability, existing…

神经与进化计算 · 计算机科学 2023-07-11 Shangshang Yang , Haiping Ma , Cheng Zhen , Ye Tian , Limiao Zhang , Yaochu Jin , Xingyi Zhang

We implement a differentiable Neural Architecture Search (NAS) method inspired by FBNet for discovering neural networks that are heavily optimized for a particular target device. The FBNet NAS method discovers a neural network from a given…

计算机视觉与模式识别 · 计算机科学 2019-06-19 Sai Vineeth Kalluru Srinivas , Harideep Nair , Vinay Vidyasagar

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its…

机器学习 · 计算机科学 2022-12-08 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Mohammad Abdullah Al Faruque , Smail Niar

This paper offers a new perspective on Artificial Neural Networks (ANNs) architecture. Traditional ANNs commonly use tree-like or DAG structures for simplicity, which can be preset or determined by Neural Architecture Search (NAS). Yet,…

机器学习 · 计算机科学 2025-06-05 Xinshun Liu , Yizhi Fang , Yichao Jiang

We introduce Universal Neural Architecture Space (UniNAS), a generic search space for neural architecture search (NAS) which unifies convolutional networks, transformers, and their hybrid architectures under a single, flexible framework.…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Ondřej Týbl , Lukáš Neumann

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search. In particular, we model the NAS problem as a sparse supernet using a new continuous…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Yan Wu , Aoming Liu , Zhiwu Huang , Siwei Zhang , Luc Van Gool

Automated machine learning (AutoML) usually involves several crucial components, such as Data Augmentation (DA) policy, Hyper-Parameter Optimization (HPO), and Neural Architecture Search (NAS). Although many strategies have been developed…

机器学习 · 计算机科学 2023-03-31 Kaichen Zhou , Lanqing Hong , Shoukang Hu , Fengwei Zhou , Binxin Ru , Jiashi Feng , Zhenguo Li

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

机器学习 · 计算机科学 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

机器学习 · 计算机科学 2021-10-14 Attila Nagy , Ábel Boros

Spiking Neural Networks (SNNs) have gained enormous popularity in the field of artificial intelligence due to their low power consumption. However, the majority of SNN methods directly inherit the structure of Artificial Neural Networks…

神经与进化计算 · 计算机科学 2024-11-05 Yilei Man , Linhai Xie , Shushan Qiao , Yumei Zhou , Delong Shang

One-shot methods have significantly advanced the field of neural architecture search (NAS) by adopting weight-sharing strategy to reduce search costs. However, the accuracy of performance estimation can be compromised by co-adaptation.…

机器学习 · 计算机科学 2024-12-17 Jianfeng Li , Jiawen Zhang , Feng Wang , Lianbo Ma

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…