中文
相关论文

相关论文: Differentiable Neural Architecture Learning for Ef…

200 篇论文

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Arjun Sridhar , Yiran Chen

To prevent the leakage of private information while enabling automated machine intelligence, there is an emerging trend to integrate federated learning and Neural Architecture Search (NAS). Although promising as it may seem, the coupling of…

机器学习 · 计算机科学 2020-11-09 Chunhui Zhang , Yongyuan Liang , Xiaoming Yuan , Lei Cheng

Despite the significant advances achieved in Artificial Neural Networks (ANNs), their design process remains notoriously tedious, depending primarily on intuition, experience and trial-and-error. This human-dependent process is often…

人工智能 · 计算机科学 2025-02-20 Mohamed Shahawy , Elhadj Benkhelifa , David White

Training Artificial Neural Networks poses a challenging and critical problem in machine learning. Despite the effectiveness of gradient-based learning methods, such as Stochastic Gradient Descent (SGD), in training neural networks, they do…

Deep networks have been used to learn transferable representations for domain adaptation. Existing deep domain adaptation methods systematically employ popular hand-crafted networks designed specifically for image-classification tasks,…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Yichen Li , Xingchao Peng

This paper presents a hardware-efficient deep neural network (DNN), optimized through hardware-aware neural architecture search (HW-NAS); the DNN supports the classification of session-level encrypted traffic on resource-constrained…

网络与互联网体系结构 · 计算机科学 2026-03-20 Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino

Deep learning methods have become very successful at solving many complex tasks such as image classification and segmentation, speech recognition and machine translation. Nevertheless, manually designing a neural network for a specific…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Maria Baldeon Calisto , Susana Lai-Yuen

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

机器学习 · 计算机科学 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

机器学习 · 计算机科学 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

Deep Graph Neural Networks (GNNs) show promising performance on a range of graph tasks, yet at present are costly to run and lack many of the optimisations applied to DNNs. We show, for the first time, how to systematically quantise GNNs…

机器学习 · 计算机科学 2020-09-22 Yiren Zhao , Duo Wang , Daniel Bates , Robert Mullins , Mateja Jamnik , Pietro Lio

Recently proposed neural architecture search (NAS) algorithms adopt neural predictors to accelerate the architecture search. The capability of neural predictors to accurately predict the performance metrics of neural architecture is…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Chen Wei , Yiping Tang , Chuang Niu , Haihong Hu , Yue Wang , Jimin Liang

Neural Architecture Search (NAS) for Federated Learning (FL) is an emerging field. It automates the design and training of Deep Neural Networks (DNNs) when data cannot be centralized due to privacy, communication costs, or regulatory…

Convolutional Neural Network (CNN) has gained state-of-the-art results in many pattern recognition and computer vision tasks. However, most of the CNN structures are manually designed by experienced researchers. Therefore, auto- matically…

神经与进化计算 · 计算机科学 2018-10-26 Guoqiang Zhong , Tao Li , Wenxue Liu , Yang Chen

Deep learning algorithms, in particular 2D and 3D fully convolutional neural networks (FCNs), have rapidly become the mainstream methodology for volumetric medical image segmentation. However, 2D convolutions cannot fully leverage the rich…

图像与视频处理 · 电气工程与系统科学 2019-08-06 Zhuotun Zhu , Chenxi Liu , Dong Yang , Alan Yuille , Daguang Xu

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. We apply this idea to Federated Learning (FL), wherein predefined neural network models are trained on the client/device data. This…

机器学习 · 计算机科学 2020-10-21 Anubhav Garg , Amit Kumar Saha , Debo Dutta

We present the first differentiable Network Architecture Search (NAS) for Graph Neural Networks (GNNs). GNNs show promising performance on a wide range of tasks, but require a large amount of architecture engineering. First, graphs are…

机器学习 · 计算机科学 2020-03-24 Yiren Zhao , Duo Wang , Xitong Gao , Robert Mullins , Pietro Lio , Mateja Jamnik

Differentiable architecture search has gradually become the mainstream research topic in the field of Neural Architecture Search (NAS) for its high efficiency compared with the early NAS methods. Recent differentiable NAS also aims at…

机器学习 · 计算机科学 2023-07-04 Bo Lyu , Shiping Wen

Deep Convolutional Neural Networks (CNN) provides an "end-to-end" solution for image pattern recognition with impressive performance in many areas of application including medical imaging. Most CNN models of high performance use…

图像与视频处理 · 电气工程与系统科学 2020-05-29 Mohammed Ahmed , Hongbo Du , Alaa AlZoubi

Deep neural networks (DNNs) have been shown to outperform conventional machine learning algorithms across a wide range of applications, e.g., image recognition, object detection, robotics, and natural language processing. However, the high…

分布式、并行与集群计算 · 计算机科学 2020-04-23 Ye Yu , Yingmin Li , Shuai Che , Niraj K. Jha , Weifeng Zhang

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu