English
Related papers

Related papers: NASRec: Weight Sharing Neural Architecture Search …

200 papers

Weight-sharing (WS) has recently emerged as a paradigm to accelerate the automated search for efficient neural architectures, a process dubbed Neural Architecture Search (NAS). Although very appealing, this framework is not without…

Machine Learning · Computer Science 2020-05-19 Aloïs Pourchot , Alexis Ducarouge , Olivier Sigaud

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

Machine Learning · Computer Science 2019-08-01 Liam Li , Ameet Talwalkar

Sequential recommender systems (SRS) have become the key technology in capturing user's dynamic interests and generating high-quality recommendations. Current state-of-the-art sequential recommender models are typically based on a…

Information Retrieval · Computer Science 2020-05-27 Yang Sun , Fajie Yuan , Min Yang , Guoao Wei , Zhou Zhao , Duo Liu

Transfer learning can boost the performance on the targettask by leveraging the knowledge of the source domain. Recent worksin neural architecture search (NAS), especially one-shot NAS, can aidtransfer learning by establishing sufficient…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Ming Sun , Haoxuan Dou , Junjie Yan

Modern solutions to the single image super-resolution (SISR) problem using deep neural networks aim not only at better performance accuracy but also at a lighter and computationally efficient model. To that end, recently, neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Yan Wu , Zhiwu Huang , Suryansh Kumar , Rhea Sanjay Sukthanker , Radu Timofte , Luc Van Gool

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

Machine Learning · Computer Science 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

Machine Learning · Statistics 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Despite remarkable progress achieved, most neural architecture search (NAS) methods focus on searching for one single accurate and robust architecture. To further build models with better generalization capability and performance, model…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Minghao Chen , Houwen Peng , Jianlong Fu , Haibin Ling

Next Set Recommendation (NSRec), encompassing related tasks such as next basket recommendation and temporal sets prediction, stands as a trending research topic. Although numerous attempts have been made on this topic, there are certain…

Information Retrieval · Computer Science 2024-10-31 Yuli Liu , Min Liu , Christian Walder , Lexing Xie

Weight sharing has become a de facto standard in neural architecture search because it enables the search to be done on commodity hardware. However, recent works have empirically shown a ranking disorder between the performance of…

Machine Learning · Computer Science 2021-04-13 Kaicheng Yu , Rene Ranftl , Mathieu Salzmann

Deep learning has brought great progress for the sequential recommendation (SR) tasks. With advanced network architectures, sequential recommender models can be stacked with many hidden layers, e.g., up to 100 layers on real-world…

Information Retrieval · Computer Science 2021-05-13 Jiachun Wang , Fajie Yuan , Jian Chen , Qingyao Wu , Min Yang , Yang Sun , Guoxiao Zhang

Deep neural networks have emerged as a powerful technique for learning representations from user-item interaction data in collaborative filtering (CF) for recommender systems. However, many existing methods heavily rely on unique user and…

Information Retrieval · Computer Science 2025-10-21 Xubin Ren , Chao Huang

Neural Architecture Search (NAS), aiming at automatically designing neural architectures by machines, has been considered a key step toward automatic machine learning. One notable NAS branch is the weight-sharing NAS, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Guangrun Wang , Changlin Li , Liuchun Yuan , Jiefeng Peng , Xiaoyu Xian , Xiaodan Liang , Xiaojun Chang , Liang Lin

Neural architecture search has attracted wide attentions in both academia and industry. To accelerate it, researchers proposed weight-sharing methods which first train a super-network to reuse computation among different operators, from…

Machine Learning · Computer Science 2020-12-16 Xin Chen , Lingxi Xie , Jun Wu , Longhui Wei , Yuhui Xu , Qi Tian

With the shift towards on-device deep learning, ensuring a consistent behavior of an AI service across diverse compute platforms becomes tremendously important. Our work tackles the emergent problem of reducing predictive inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Rahul Duggal , Hao Zhou , Shuo Yang , Jun Fang , Yuanjun Xiong , Wei Xia

Recently, neural architecture search (NAS) has been applied to automate the design of neural networks in real-world applications. A large number of algorithms have been developed to improve the search cost or the performance of the final…

Machine Learning · Computer Science 2022-06-20 Yao Shu , Yizhou Chen , Zhongxiang Dai , Bryan Kian Hsiang Low

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

Machine Learning · Computer Science 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa