English
Related papers

Related papers: Automated Model Design using Gated Neuron Selectio…

200 papers

Heterogeneous graph neural architecture search (HGNAS) represents a powerful tool for automatically designing effective heterogeneous graph neural networks. However, existing HGNAS algorithms suffer from inefficient searches and unstable…

Artificial Intelligence · Computer Science 2023-12-15 Haoyuan Dong , Yang Gao , Haishuai Wang , Hong Yang , Peng Zhang

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

Computation and Language · Computer Science 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

Machine Learning · Computer Science 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

The accurate segmentation of retinal blood vessels plays a crucial role in the early diagnosis and treatment of various ophthalmic diseases. Designing a network model for this task requires meticulous tuning and extensive experimentation to…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Tingting Wu , Ruyi Min , Peixuan Song , Hengtao Guo , Tieyong Zeng , Feng-Lei Fan

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

Machine Learning · Computer Science 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

Transferable neural architecture search (TNAS) has been introduced to design efficient neural architectures for multiple tasks, to enhance the practical applicability of NAS in real-world scenarios. In TNAS, architectural knowledge…

Machine Learning · Computer Science 2024-12-19 Xun Zhou , Xingyu Wu , Liang Feng , Zhichao Lu , Kay Chen Tan

Neural Architecture Search (NAS) has emerged as a promising technique for automatic neural network design. However, existing MCTS based NAS approaches often utilize manually designed action space, which is not directly related to the…

Machine Learning · Computer Science 2021-04-02 Linnan Wang , Saining Xie , Teng Li , Rodrigo Fonseca , Yuandong Tian

Deep learning has revolutionized the design of the channel state information (CSI) feedback module in wireless communications. However, designing the optimal neural network (NN) architecture for CSI feedback can be a laborious and…

Information Theory · Computer Science 2023-11-28 Xiangyi Li , Jiajia Guo , Chao-Kai Wen , Shi Jin

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

Neural and Evolutionary Computing · Computer Science 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Accurate classification of medical images is essential for modern diagnostics. Deep learning advancements led clinicians to increasingly use sophisticated models to make faster and more accurate decisions, sometimes replacing human…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Lunchen Xie , Eugenio Lomurno , Matteo Gambella , Danilo Ardagna , Manuel Roveri , Matteo Matteucci , Qingjiang Shi

Deep Neural Networks (DNNs) are increasingly deployed across diverse industries, driving demand for mobile device support. However, existing mobile inference frameworks often rely on a single processor per model, limiting hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Yunquan Gao , Zhiguo Zhang , Praveen Kumar Donta , Chinmaya Kumar Dehury , Xiujun Wang , Dusit Niyato , Qiyang Zhang

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and…

Machine Learning · Computer Science 2020-12-10 Sercan O. Arik , Tomas Pfister

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

There are vast number of configurable parameters in a Radio Access Telecom Network. A significant amount of these parameters is configured by Radio Node or cell based on their deployment setting. Traditional methods rely on domain knowledge…

Machine Learning · Computer Science 2024-06-10 Shirwan Piroti , Ashima Chawla , Tahar Zanouda

Deep learning has largely reduced the need for manual feature selection in image segmentation. Nevertheless, network architecture optimization and hyperparameter tuning are mostly manual and time consuming. Although there are increasing…

Image and Video Processing · Electrical Eng. & Systems 2019-09-16 Ken C. L. Wong , Mehdi Moradi

The future 6G network is envisioned to be AI-native, and as such, ML models will be pervasive in support of optimizing performance, reducing energy consumption, and in coping with increasing complexity and heterogeneity. A key challenge is…

Networking and Internet Architecture · Computer Science 2024-06-05 Adam Orucu , Farnaz Moradi , Masoumeh Ebrahimi , Andreas Johnsson

This paper presents TAG, an automatic system to derive optimized DNN training graph and its deployment onto any device topology, for expedited training in device- and topology- heterogeneous ML clusters. We novelly combine both the DNN…

Machine Learning · Computer Science 2023-02-14 Shiwei Zhang , Xiaodong Yi , Lansong Diao , Chuan Wu , Siyu Wang , Wei Lin

This paper introduces AutoGCN, a generic Neural Architecture Search (NAS) algorithm for Human Activity Recognition (HAR) using Graph Convolution Networks (GCNs). HAR has gained attention due to advances in deep learning, increased data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Felix Tempel , Inga Strümke , Espen Alexander F. Ihlen

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

Neural and Evolutionary Computing · Computer Science 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang