中文
相关论文

相关论文: SuperSAM: Crafting a SAM Supernetwork via Structur…

200 篇论文

Neural Architecture Search (NAS) has emerged as a promising technique for automatic neural network design. However, existing MCTS based NAS approaches often utilize manually designed action space, which is not directly related to the…

机器学习 · 计算机科学 2021-04-02 Linnan Wang , Saining Xie , Teng Li , Rodrigo Fonseca , Yuandong Tian

Neural architecture search (NAS) emerged as a way to automatically optimize neural networks for a specific task and dataset. Despite an abundance of research on NAS for images and natural language applications, similar studies for time…

统计金融 · 定量金融 2024-12-05 Denis Levchenko , Efstratios Rappos , Shabnam Ataee , Biagio Nigro , Stephan Robert-Nicoud

Neural Architecture Search (NAS) has become a widely used tool for automating neural network design. While one-shot NAS methods have successfully reduced computational requirements, they often require extensive training. On the other hand,…

机器学习 · 计算机科学 2023-11-23 Hua Zheng , Kuang-Hung Liu , Igor Fedorov , Xin Zhang , Wen-Yen Chen , Wei Wen

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

With the increasing demand to efficiently deploy DNNs on mobile edge devices, it becomes much more important to reduce unnecessary computation and increase the execution speed. Prior methods towards this goal, including model compression…

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

机器学习 · 计算机科学 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

神经与进化计算 · 计算机科学 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

机器学习 · 计算机科学 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

This paper proposes a novel cell-based neural architecture search algorithm (NAS), which completely alleviates the expensive costs of data labeling inherited from supervised learning. Our algorithm capitalizes on the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Nam Nguyen , J. Morris Chang

A myriad of recent breakthroughs in hand-crafted neural architectures for visual recognition have highlighted the urgent need to explore hybrid architectures consisting of diversified building blocks. Meanwhile, neural architecture search…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Changlin Li , Tao Tang , Guangrun Wang , Jiefeng Peng , Bing Wang , Xiaodan Liang , Xiaojun Chang

Neural Architecture Search (NAS) is an emerging topic in machine learning and computer vision. The fundamental ideology of NAS is using an automatic mechanism to replace manual designs for exploring powerful network architectures. One of…

机器学习 · 计算机科学 2020-09-24 Lanfei Wang , Lingxi Xie , Tianyi Zhang , Jun Guo , Qi Tian

Transferable neural architecture search (TNAS) has been introduced to design efficient neural architectures for multiple tasks, to enhance the practical applicability of NAS in real-world scenarios. In TNAS, architectural knowledge…

机器学习 · 计算机科学 2024-12-19 Xun Zhou , Xingyu Wu , Liang Feng , Zhichao Lu , Kay Chen Tan

Network pruning can significantly reduce the computation and memory footprint of large neural networks. To achieve a good trade-off between model size and performance, popular pruning techniques usually rely on hand-crafted heuristics and…

计算机视觉与模式识别 · 计算机科学 2021-01-19 Wenyuan Zeng , Yuwen Xiong , Raquel Urtasun

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structure of each layer…

机器学习 · 计算机科学 2021-10-28 Sungwoong Kim , Ildoo Kim , Sungbin Lim , Woonhyuk Baek , Chiheon Kim , Hyungjoo Cho , Boogeon Yoon , Taesup Kim

Search spaces hallmark the advancement of Neural Architecture Search (NAS). Large and complex search spaces with versatile building operators and structures provide more opportunities to brew promising architectures, yet pose severe…

计算机视觉与模式识别 · 计算机科学 2023-07-07 Bhavna Gopal , Arjun Sridhar , Tunhou Zhang , Yiran Chen

Improving the efficiency of Neural Architecture Search (NAS) is a challenging but significant task that has received much attention. Previous works mainly adopted the Differentiable Architecture Search (DARTS) and improved its search…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Chongjun Tu , Peng Ye , Weihao Lin , Hancheng Ye , Chong Yu , Tao Chen , Baopu Li , Wanli Ouyang

Accurate segmentation of ultrasound images is essential for reliable medical diagnoses but is challenged by poor image quality and scarce labeled data. Prior approaches have relied on manually designed, complex network architectures to…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Renqi Chen , Xinzhe Zheng , Haoyang Su , Kehan Wu

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

机器学习 · 计算机科学 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

Deep learning is increasingly impacting various aspects of contemporary society. Artificial neural networks have emerged as the dominant models for solving an expanding range of tasks. The introduction of Neural Architecture Search (NAS)…

机器学习 · 计算机科学 2023-07-04 Simone Sarti , Eugenio Lomurno , Matteo Matteucci

One-shot weight sharing methods have recently drawn great attention in neural architecture search due to high efficiency and competitive performance. However, weight sharing across models has an inherent deficiency, i.e., insufficient…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Houwen Peng , Hao Du , Hongyuan Yu , Qi Li , Jing Liao , Jianlong Fu