中文
相关论文

相关论文: SVD-NAS: Coupling Low-Rank Approximation and Neura…

200 篇论文

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

We present LDP, a lightweight dense prediction neural architecture search (NAS) framework. Starting from a pre-defined generic backbone, LDP applies the novel Assisted Tabu Search for efficient architecture exploration. LDP is fast and…

计算机视觉与模式识别 · 计算机科学 2022-03-10 Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

In the era of data proliferation, efficiently sifting through vast information to extract meaningful insights has become increasingly crucial. This paper addresses the computational overhead and resource inefficiency prevalent in existing…

信息检索 · 计算机科学 2024-12-20 Sheng Zhang , Maolin Wang , Yao Zhao , Chenyi Zhuang , Jinjie Gu , Ruocheng Guo , Xiangyu Zhao , Zijian Zhang , Hongzhi Yin

The performance of Deep Neural Networks (DNNs) keeps elevating in recent years with increasing network depth and width. To enable DNNs on edge devices like mobile phones, researchers proposed several network compression methods including…

计算机视觉与模式识别 · 计算机科学 2020-01-27 Yuhui Xu , Yuxi Li , Shuai Zhang , Wei Wen , Botao Wang , Yingyong Qi , Yiran Chen , Weiyao Lin , Hongkai Xiong

Neural Architecture Search (NAS) is a research field concerned with utilizing optimization algorithms to design optimal neural network architectures. There are many approaches concerning the architectural search spaces, optimization…

机器学习 · 计算机科学 2020-05-25 George Kyriakides , Konstantinos Margaritis

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources.…

机器学习 · 计算机科学 2024-02-13 Ruiyang Qin , Yuting Hu , Zheyu Yan , Jinjun Xiong , Ahmed Abbasi , Yiyu Shi

Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared with gradient-based approaches, due to the rollout…

机器学习 · 计算机科学 2021-05-28 Jihao Liu , Ming Zhang , Yangting Sun , Boxiao Liu , Guanglu Song , Yu Liu , Hongsheng Li

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

机器学习 · 计算机科学 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

With the flourish of differentiable neural architecture search (NAS), automatically searching latency-constrained architectures gives a new perspective to reduce human labor and expertise. However, the searched architectures are usually…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Yibo Hu , Xiang Wu , Ran He

Differentiable architecture search has gradually become the mainstream research topic in the field of Neural Architecture Search (NAS) for its high efficiency compared with the early NAS methods. Recent differentiable NAS also aims at…

机器学习 · 计算机科学 2023-07-04 Bo Lyu , Shiping Wen

To reduce the human efforts in neural network design, Neural Architecture Search (NAS) has been applied with remarkable success to various high-level vision tasks such as classification and semantic segmentation. The underlying idea for the…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Xuelian Cheng , Yiran Zhong , Mehrtash Harandi , Yuchao Dai , Xiaojun Chang , Tom Drummond , Hongdong Li , Zongyuan Ge

Differential Neural Architecture Search (NAS) requires all layer choices to be held in memory simultaneously; this limits the size of both search space and final architecture. In contrast, Probabilistic NAS, such as PARSEC, learns a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Zhicheng Yan , Xiaoliang Dai , Peizhao Zhang , Yuandong Tian , Bichen Wu , Matt Feiszli

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

计算机视觉与模式识别 · 计算机科学 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de-noising, in-painting and super-resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can…

计算机视觉与模式识别 · 计算机科学 2020-01-15 Kary Ho , Andrew Gilbert , Hailin Jin , John Collomosse

By the widespread popularity of electronic devices, the emergence of biometric technology has brought significant convenience to user authentication compared with the traditional password and mode unlocking. Among many biological…

计算机视觉与模式识别 · 计算机科学 2019-04-29 Ning Zhu

Neural architecture search (NAS) has achieved remarkable results in deep neural network design. Differentiable architecture search converts the search over discrete architectures into a hyperparameter optimization problem which can be…

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

计算机视觉与模式识别 · 计算机科学 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun