中文
相关论文

相关论文: Long-term Reproducibility for Neural Architecture …

200 篇论文

Neural Architecture Search (NAS) has received extensive attention due to its capability to discover neural network architectures in an automated manner. aw_nas is an open-source Python framework implementing various NAS algorithms in a…

神经与进化计算 · 计算机科学 2020-12-21 Xuefei Ning , Changcheng Tang , Wenshuo Li , Songyi Yang , Tianchen Zhao , Niansong Zhang , Tianyi Lu , Shuang Liang , Huazhong Yang , Yu Wang

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

Background: Academic search engines (i.e., digital libraries and indexers) play an increasingly important role in systematic reviews however these engines do not seem to effectively support such reviews, e.g., researchers confront usability…

软件工程 · 计算机科学 2022-11-02 Zheng Li , Austen Rainer

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

Neural architecture search (NAS) has advanced significantly in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell. In this paper, we extend the search space of NAS. In…

机器学习 · 计算机科学 2020-06-08 Yinqiao Li , Chi Hu , Yuhao Zhang , Nuo Xu , Yufan Jiang , Tong Xiao , Jingbo Zhu , Tongran Liu , Changliang Li

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Neural architecture search (NAS) for Graph neural networks (GNNs), called NAS-GNNs, has achieved significant performance over manually designed GNN architectures. However, these methods inherit issues from the conventional NAS methods, such…

机器学习 · 计算机科学 2023-06-19 Peng Xu , Lin Zhang , Xuanzhou Liu , Jiaqi Sun , Yue Zhao , Haiqin Yang , Bei Yu

This paper aims to explore the feasibility of neural architecture search (NAS) given only a pre-trained model without using any original training data. This is an important circumstance for privacy protection, bias avoidance, etc., in…

机器学习 · 计算机科学 2022-07-15 Zechun Liu , Zhiqiang Shen , Yun Long , Eric Xing , Kwang-Ting Cheng , Chas Leichner

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

机器学习 · 计算机科学 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Continual learning with neural networks is an important learning framework in AI that aims to learn a sequence of tasks well. However, it is often confronted with three challenges: (1) overcome the catastrophic forgetting problem, (2) adapt…

机器学习 · 计算机科学 2020-06-11 Qiang Gao , Zhipeng Luo , Diego Klabjan

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

机器学习 · 计算机科学 2019-11-22 George Adam , Jonathan Lorraine

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

机器学习 · 计算机科学 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

As progress is made on training machine learning models on incrementally expanding classification tasks (i.e., incremental learning), a next step is to translate this progress to industry expectations. One technique missing from incremental…

机器学习 · 计算机科学 2022-05-23 James Seale Smith , Zachary Seymour , Han-Pang Chiu

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

机器学习 · 计算机科学 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results. The past few years have seen an…

计算与语言 · 计算机科学 2021-03-23 Anya Belz , Shubham Agarwal , Anastasia Shimorina , Ehud Reiter

Research is facing a reproducibility crisis, in which the results and findings of many studies are difficult or even impossible to reproduce. This is also the case in machine learning (ML) and artificial intelligence (AI) research. Often,…

机器学习 · 计算机科学 2023-07-21 Harald Semmelrock , Simone Kopeinik , Dieter Theiler , Tony Ross-Hellauer , Dominik Kowald

Reproducibility is widely acknowledged as a fundamental principle in scientific research. Currently, the scientific community grapples with numerous challenges associated with reproducibility, often referred to as the ''reproducibility…

软件工程 · 计算机科学 2024-09-16 Benjamin A. Antunes , David R. C. Hill

Neural Architecture Search (NAS) has emerged as a powerful framework for automatically discovering neural architectures that balance accuracy and efficiency. However, as AI transitions from static benchmarks to real-world deployment, the…

机器学习 · 计算机科学 2026-05-07 Matteo Gambella , Fabrizio Pittorino , Manuel Roveri

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

机器学习 · 计算机科学 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs