English
Related papers

Related papers: SwiftNet: Using Graph Propagation as Meta-knowledg…

200 papers

Graph Neural Networks (GNNs) have shown superior performance in node classification. However, GNNs perform poorly in the Few-Shot Node Classification (FSNC) task that requires robust generalization to make accurate predictions for unseen…

Machine Learning · Computer Science 2024-10-23 Yihong Luo , Yuhan Chen , Siya Qiu , Yiwei Wang , Chen Zhang , Yan Zhou , Xiaochun Cao , Jing Tang

One of the main barriers for deploying neural networks on embedded systems has been large memory and power consumption of existing neural networks. In this work, we introduce SqueezeNext, a new family of neural network architectures whose…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Amir Gholami , Kiseok Kwon , Bichen Wu , Zizheng Tai , Xiangyu Yue , Peter Jin , Sicheng Zhao , Kurt Keutzer

Heterogeneous graph representation learning aims to learn low-dimensional vector representations of different types of entities and relations to empower downstream tasks. Existing methods either capture semantic relationships but indirectly…

Machine Learning · Computer Science 2025-08-14 Hao Xu , Shengqi Sang , Peizhen Bai , Laurence Yang , Haiping Lu

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Approximate Nearest Neighbor Search (ANNS) in high dimensional space is essential in database and information retrieval. Recently, there has been a surge of interest in exploring efficient graph-based indices for the ANNS problem. Among…

Information Retrieval · Computer Science 2021-03-19 Cong Fu , Changxu Wang , Deng Cai

Designing a lightweight semantic segmentation network often requires researchers to find a trade-off between performance and speed, which is always empirical due to the limited interpretability of neural networks. In order to release…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Peiwen Lin , Peng Sun , Guangliang Cheng , Sirui Xie , Xi Li , Jianping Shi

Neural Architecture Search (NAS) has enabled automatic discovery of more efficient neural network architectures, especially for mobile and embedded vision applications. Although recent research has proposed ways of quickly estimating…

Machine Learning · Computer Science 2022-04-28 Saeejith Nair , Saad Abbasi , Alexander Wong , Mohammad Javad Shafiee

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

Neural Architecture Search (NAS) has been widely studied for designing discriminative deep learning models such as image classification, object detection, and semantic segmentation. As a large number of priors have been obtained through the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Jie An , Haoyi Xiong , Jinwen Ma , Jiebo Luo , Jun Huan

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

Machine Learning · Computer Science 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

This work proposes a novel Graph-based neural ArchiTecture Encoding Scheme, a.k.a. GATES, to improve the predictor-based neural architecture search. Specifically, different from existing graph-based schemes, GATES models the operations as…

Machine Learning · Computer Science 2020-09-02 Xuefei Ning , Yin Zheng , Tianchen Zhao , Yu Wang , Huazhong Yang

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Nils Gessert , Alexander Schlaefer

Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared with gradient-based approaches, due to the rollout…

Machine Learning · Computer Science 2021-05-28 Jihao Liu , Ming Zhang , Yangting Sun , Boxiao Liu , Guanglu Song , Yu Liu , Hongsheng Li

Graph Neural Architecture Search (GNAS) has achieved superior performance on various graph-structured tasks. However, existing GNAS studies overlook the applications of GNAS in resource-constraint scenarios. This paper proposes to design a…

Machine Learning · Computer Science 2024-06-25 Beini Xie , Heng Chang , Ziwei Zhang , Zeyang Zhang , Simin Wu , Xin Wang , Yuan Meng , Wenwu Zhu

Image semantic segmentation technology is one of the key technologies for intelligent systems to understand natural scenes. As one of the important research directions in the field of visual intelligence, this technology has broad…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Junjun Wu , Huiyu Kuang , Qinghua Lu , Zeqin Lin , Qingwu Shi , Xilin Liu , Xiaoman Zhu

Designing accurate and efficient ConvNets for mobile devices is challenging because the design space is combinatorially large. Due to this, previous neural architecture search (NAS) methods are computationally expensive. ConvNet…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Bichen Wu , Xiaoliang Dai , Peizhao Zhang , Yanghan Wang , Fei Sun , Yiming Wu , Yuandong Tian , Peter Vajda , Yangqing Jia , Kurt Keutzer

Graph neural architecture search (NAS) has gained popularity in automatically designing powerful graph neural networks (GNNs) with relieving human efforts. However, existing graph NAS methods mainly work under the homophily assumption and…

Machine Learning · Computer Science 2023-02-27 Xin Zheng , Miao Zhang , Chunyang Chen , Qin Zhang , Chuan Zhou , Shirui Pan

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv