中文
相关论文

相关论文: Dynamic Ensemble of Low-fidelity Experts: Mitigati…

200 篇论文

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

机器学习 · 计算机科学 2024-06-26 Jiaming Yan

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

机器学习 · 计算机科学 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

机器学习 · 计算机科学 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

We present LDP, a lightweight dense prediction neural architecture search (NAS) framework. Starting from a pre-defined generic backbone, LDP applies the novel Assisted Tabu Search for efficient architecture exploration. LDP is fast and…

计算机视觉与模式识别 · 计算机科学 2022-03-10 Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

This paper aims to explore the feasibility of neural architecture search (NAS) given only a pre-trained model without using any original training data. This is an important circumstance for privacy protection, bias avoidance, etc., in…

机器学习 · 计算机科学 2022-07-15 Zechun Liu , Zhiqiang Shen , Yun Long , Eric Xing , Kwang-Ting Cheng , Chas Leichner

Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design. To achieve better performance, however, the searching…

机器学习 · 计算机科学 2022-05-23 Yijun Bian , Qingquan Song , Mengnan Du , Jun Yao , Huanhuan Chen , Xia Hu

Artificial intelligence and machine learning models deployed on edge devices, e.g., for quality control in Additive Manufacturing (AM), are frequently small in size. Such models usually have to deliver highly accurate results within a short…

分布式、并行与集群计算 · 计算机科学 2025-11-26 Marcel Aach , Cyril Blanc , Andreas Lintermann , Kurt De Grave

The recent progress in neural architecture search (NAS) has allowed scaling the automated design of neural architectures to real-world domains, such as object detection and semantic segmentation. However, one prerequisite for the…

机器学习 · 计算机科学 2021-06-15 Thomas Elsken , Benedikt Staffler , Jan Hendrik Metzen , Frank Hutter

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint…

机器学习 · 计算机科学 2024-03-06 Yash Akhauri , Mohamed S. Abdelfattah

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

计算机视觉与模式识别 · 计算机科学 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

Architecture plays an important role in deciding the performance of deep neural networks. However, the search for the optimal architecture is often hindered by the vast search space, making it a time-intensive process. Recently, a novel…

机器学习 · 计算机科学 2024-12-02 Yuxuan Li , Yunhui Guo

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS)…

机器学习 · 计算机科学 2021-06-24 Seyed Saeed Changiz Rezaei , Fred X. Han , Di Niu , Mohammad Salameh , Keith Mills , Shuo Lian , Wei Lu , Shangling Jui

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Neural architecture search (NAS) enables researchers to automatically explore broad design spaces in order to improve efficiency of neural networks. This efficiency is especially important in the case of on-device deployment, where…

机器学习 · 计算机科学 2021-01-20 Łukasz Dudziak , Thomas Chau , Mohamed S. Abdelfattah , Royson Lee , Hyeji Kim , Nicholas D. Lane

Evaluation is a critical but costly procedure in neural architecture search (NAS). Performance predictors have been widely adopted to reduce evaluation costs by directly estimating architecture performance. The effectiveness of predictors…

机器学习 · 计算机科学 2025-06-09 Han Ji , Yuqi Feng , Jiahao Fan , Yanan Sun

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Neural architecture search (NAS) has become a common approach to developing and discovering new neural architectures for different target platforms and purposes. However, scanning the search space is comprised of long training processes of…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Tal Hakim

Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with…

机器学习 · 计算机科学 2022-02-08 Minsu Cho , Mohammadreza Soltani , Chinmay Hegde

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa