中文
相关论文

相关论文: Self-Supervised Neural Architecture Search for Mul…

200 篇论文

Most applications demand high-performance deep neural architectures costing limited resources. Neural architecture searching is a way of automatically exploring optimal deep neural networks in a given huge search space. However, all…

机器学习 · 计算机科学 2020-06-01 Yunhe Wang , Yixing Xu , Dacheng Tao

In this paper we propose the Structured Deep Neural Network (Structured DNN) as a structured and deep learning algorithm, learning to find the best structured object (such as a label sequence) given a structured input (such as a vector…

机器学习 · 计算机科学 2015-06-04 Yi-Hsiu Liao , Hung-Yi Lee , Lin-shan Lee

In class-incremental learning, a model learns continuously from a sequential data stream in which new classes occur. Existing methods often rely on static architectures that are manually crafted. These methods can be prone to capacity…

机器学习 · 计算机科学 2019-09-17 Shenyang Huang , Vincent François-Lavet , Guillaume Rabusseau

To search an optimal sub-network within a general deep neural network (DNN), existing neural architecture search (NAS) methods typically rely on handcrafting a search space beforehand. Such requirements make it challenging to extend them…

机器学习 · 计算机科学 2023-10-09 Tianyi Chen , Luming Liang , Tianyu Ding , Ilya Zharkov

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

机器学习 · 计算机科学 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

By the widespread popularity of electronic devices, the emergence of biometric technology has brought significant convenience to user authentication compared with the traditional password and mode unlocking. Among many biological…

计算机视觉与模式识别 · 计算机科学 2019-04-29 Ning Zhu

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

机器学习 · 计算机科学 2019-11-22 George Adam , Jonathan Lorraine

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search. In particular, we model the NAS problem as a sparse supernet using a new continuous…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Yan Wu , Aoming Liu , Zhiwu Huang , Siwei Zhang , Luc Van Gool

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

机器学习 · 计算机科学 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

The architectural advancements in deep neural networks have led to remarkable leap-forwards across a broad array of computer vision tasks. Instead of relying on human expertise, neural architecture search (NAS) has emerged as a promising…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Zhichao Lu , Ran Cheng , Shihua Huang , Haoming Zhang , Changxiao Qiu , Fan Yang

In many deep neural network (DNN) applications, the difficulty of gathering high-quality data in the industry field hinders the practical use of DNN. Thus, the concept of transfer learning has emerged, which leverages the pretrained…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Youngkee Kim , Won Joon Yun , Youn Kyu Lee , Soyi Jung , Joongheon Kim

In this paper we propose the Structured Deep Neural Network (structured DNN) as a structured and deep learning framework. This approach can learn to find the best structured object (such as a label sequence) given a structured input (such…

计算与语言 · 计算机科学 2015-11-10 Yi-Hsiu Liao , Hung-yi Lee , Lin-shan Lee

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Neural Architecture Search (NAS) provides state-of-the-art results when trained on well-curated datasets with annotated labels. However, annotating data or even having balanced number of samples can be a luxury for practitioners from…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Aleksandr Timofeev , Grigorios G. Chrysos , Volkan Cevher

Recent years have witnessed the popularity of Graph Neural Networks (GNN) in various scenarios. To obtain optimal data-specific GNN architectures, researchers turn to neural architecture search (NAS) methods, which have made impressive…

机器学习 · 计算机科学 2020-09-08 Huan Zhao , Lanning Wei , Quanming Yao

Differentiable architecture search is prevalent in the field of NAS because of its simplicity and efficiency, where two paradigms, multi-path algorithms and single-path methods, are dominated. Multi-path framework (e.g. DARTS) is intuitive…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Haoxian Tan , Sheng Guo , Yujie Zhong , Matthew R. Scott , Weilin Huang

The main challenge to deploy deep neural network (DNN) over a mobile edge network is how to split the DNN model so as to match the network architecture as well as all the nodes' computation and communication capacity. This essentially…

人工智能 · 计算机科学 2021-11-17 Yuqing Tian , Zhaoyang Zhang , Zhaohui Yang , Qianqian Yang