中文
相关论文

相关论文: Robustifying and Boosting Training-Free Neural Arc…

200 篇论文

Present day artificial neural architecture search (NAS) strategies are essentially prediction-error-optimized. That holds true for AI functions in general. From the developmental neuroscience perspective, I present evidence for the central…

神经元与认知 · 定量生物学 2023-10-06 Martin G. Frasch

Neural architecture search (NAS) for Graph neural networks (GNNs), called NAS-GNNs, has achieved significant performance over manually designed GNN architectures. However, these methods inherit issues from the conventional NAS methods, such…

机器学习 · 计算机科学 2023-06-19 Peng Xu , Lin Zhang , Xuanzhou Liu , Jiaqi Sun , Yue Zhao , Haiqin Yang , Bei Yu

Albeit being a prevalent architecture searching approach, differentiable architecture search (DARTS) is largely hindered by its substantial memory cost since the entire supernet resides in the memory. This is where the single-path DARTS…

机器学习 · 计算机科学 2023-08-04 Xiaoxing Wang , Xiangxiang Chu , Yuda Fan , Zhexi Zhang , Bo Zhang , Xiaokang Yang , Junchi Yan

Neural architecture search (NAS) has been successfully used to design numerous high-performance neural networks. However, NAS is typically compute-intensive, so most existing approaches restrict the search to decide the operations and…

High sensitivity of neural architecture search (NAS) methods against their input such as step-size (i.e., learning rate) and search space prevents practitioners from applying them out-of-the-box to their own problems, albeit its purpose is…

机器学习 · 计算机科学 2019-05-22 Youhei Akimoto , Shinichi Shirakawa , Nozomu Yoshinari , Kento Uchida , Shota Saito , Kouhei Nishida

Accurate surface roughness prediction is critical for ensuring high product quality, especially in areas like manufacturing and aerospace, where the smallest imperfections can compromise performance or safety. However, this is challenging…

计算工程、金融与科学 · 计算机科学 2024-05-29 Penghui Ruan , Divya Saxena , Jiannong Cao , Xiaoyun Liu , Ruoxin Wang , Chi Fai Cheung

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

机器学习 · 计算机科学 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

机器学习 · 计算机科学 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture…

机器学习 · 统计学 2020-09-23 Alexis Cooper , Xin Zhou , Scott Heidbrink , Daniel M. Dunlavy

Neural Networks design is a complex and often daunting task, particularly for resource-constrained scenarios typical of mobile-sized models. Neural Architecture Search is a promising approach to automate this process, but existing…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Niccolò Cavagnero , Luca Robbiano , Francesca Pistilli , Barbara Caputo , Giuseppe Averta

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

机器学习 · 计算机科学 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

In the realm of neural architecture design, achieving high performance is largely reliant on the manual expertise of researchers. Despite the emergence of Neural Architecture Search (NAS) as a promising technique for automating this…

机器学习 · 计算机科学 2025-01-07 Yannis Y. He

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

机器学习 · 计算机科学 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Recurrent neural networks (RNNs) are a powerful approach for time series prediction. However, their performance is strongly affected by their architecture and hyperparameter settings. The architecture optimization of RNNs is a…

机器学习 · 计算机科学 2021-04-26 Andrés Camero , Hao Wang , Enrique Alba , Thomas Bäck

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

机器学习 · 计算机科学 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Federated Learning (FL) often struggles with data heterogeneity due to the naturally uneven distribution of user data across devices. Federated Neural Architecture Search (NAS) enables collaborative search for optimal model architectures…

机器学习 · 计算机科学 2025-04-10 Xinyuan Huang , Jiechao Gao

Training-free network architecture search (NAS) aims to discover high-performing networks with zero-cost proxies, capturing network characteristics related to the final performance. However, network rankings estimated by previous…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Junghyup Lee , Bumsub Ham