中文
相关论文

相关论文: Federated Neural Architecture Search with Model-Ag…

200 篇论文

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Federated learning continues to evolve but faces challenges in interpretability and explainability. To address these challenges, we introduce a novel approach that employs Neural Additive Models (NAMs) within a federated learning framework.…

机器学习 · 计算机科学 2025-06-24 Amitash Nanda , Sree Bhargavi Balija , Debashis Sahoo

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however,…

机器学习 · 计算机科学 2021-02-24 Niv Nayman , Yonathan Aflalo , Asaf Noy , Lihi Zelnik-Manor

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

图像与视频处理 · 电气工程与系统科学 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

This paper aims to explore the feasibility of neural architecture search (NAS) given only a pre-trained model without using any original training data. This is an important circumstance for privacy protection, bias avoidance, etc., in…

机器学习 · 计算机科学 2022-07-15 Zechun Liu , Zhiqiang Shen , Yun Long , Eric Xing , Kwang-Ting Cheng , Chas Leichner

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Deep neural networks (DNNs) have shown superior performances on various multimodal learning problems. However, it often requires huge efforts to adapt DNNs to individual multimodal tasks by manually engineering unimodal features and…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Yihang Yin , Siyu Huang , Xiang Zhang

Recently, numerous efficient Transformers have been proposed to reduce the quadratic computational complexity of standard Transformers caused by the Softmax attention. However, most of them simply swap Softmax with an efficient attention…

计算与语言 · 计算机科学 2022-07-29 Zexiang Liu , Dong Li , Kaiyue Lu , Zhen Qin , Weixuan Sun , Jiacheng Xu , Yiran Zhong

Centralized training methods have shown promising results in MR image reconstruction, but privacy concerns arise when gathering data from multiple institutions. Federated learning, a distributed collaborative training scheme, can utilize…

图像与视频处理 · 电气工程与系统科学 2023-07-24 Ruoyou Wu , Cheng Li , Juan Zou , Shanshan Wang

Deep learning methods have become very successful at solving many complex tasks such as image classification and segmentation, speech recognition and machine translation. Nevertheless, manually designing a neural network for a specific…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Maria Baldeon Calisto , Susana Lai-Yuen

With growing concerns regarding data privacy and rapid increase in data volume, Federated Learning(FL) has become an important learning paradigm. However, jointly learning a deep neural network model in a FL setting proves to be a…

机器学习 · 计算机科学 2022-07-11 Disha Makhija , Xing Han , Nhat Ho , Joydeep Ghosh

Due to user privacy and regulatory restrictions, federate learning (FL) is proposed as a distributed learning framework for training deep neural networks (DNN) on decentralized data clients. Recent advancements in FL have applied Neural…

机器学习 · 计算机科学 2022-10-18 Hongjiang Chen , Yang Wang , Leibo Liu , Shaojun Wei , Shouyi Yin

Federated Learning (FL) is extensively used to train AI/ML models in distributed and privacy-preserving settings. Participant edge devices in FL systems typically contain non-independent and identically distributed (Non-IID) private data…

机器学习 · 计算机科学 2024-05-02 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated learning (FL) promotes decentralized training while prioritizing data confidentiality. However, its application on resource-constrained devices is challenging due to the high demand for computation and memory resources to train…

机器学习 · 计算机科学 2024-03-25 Hong Huang , Weiming Zhuang , Chen Chen , Lingjuan Lyu

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal