English
Related papers

Related papers: Towards Efficient Few-shot Graph Neural Architectu…

200 papers

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

Machine Learning · Computer Science 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

To solve the problem that convolutional neural networks (CNNs) are difficult to process non-grid type relational data like graphs, Kipf et al. proposed a graph convolutional neural network (GCN). The core idea of the GCN is to perform…

Machine Learning · Computer Science 2019-04-17 Shangsheng Xie , Mingming Lu

Few-shot text classification aims to classify the text under the few-shot scenario. Most of the previous methods adopt optimization-based meta learning to obtain task distribution. However, due to the neglect of matching between the few…

Computation and Language · Computer Science 2023-07-31 Tianyi Lei , Honghui Hu , Qiaoyang Luo , Dezhong Peng , Xu Wang

Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with…

Machine Learning · Computer Science 2022-02-08 Minsu Cho , Mohammadreza Soltani , Chinmay Hegde

Graph-structured data is ubiquitous in the real world, and Graph Neural Networks (GNNs) have become increasingly popular in various fields due to their ability to process such irregular data directly. However, as data scale, GNNs become…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Xianfeng Song , Yi Zou , Zheng Shi

In this paper, we study the problem of graph similarity search with graph edit distance (GED) constraints. Due to the NP-hardness of GED computation, existing solutions to this problem adopt the filtering-and-verification framework with a…

Databases · Computer Science 2020-04-03 Jongik Kim

\textit{Differentiable ARchiTecture Search} (DARTS) has recently become the mainstream of neural architecture search (NAS) due to its efficiency and simplicity. With a gradient-based bi-level optimization, DARTS alternately optimizes the…

Machine Learning · Computer Science 2021-06-22 Miao Zhang , Steven Su , Shirui Pan , Xiaojun Chang , Ehsan Abbasnejad , Reza Haffari

Various hand-designed CNN architectures have been developed, such as VGG, ResNet, DenseNet, etc., and achieve State-of-the-Art (SoTA) levels on different tasks. Neural Architecture Search (NAS) now focuses on automatically finding the best…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yu-Ming Zhang , Jun-Wei Hsieh , Chun-Chieh Lee , Kuo-Chin Fan

The article proposes a Caputo fractional conjugate gradient (CFCG) method for unconstrained optimization problems which is applicable to smooth as well as non-smooth problmes. The proposed method uses a non-adaptive version of the Caputo…

Optimization and Control · Mathematics 2025-12-22 Barsha Shawa , Md Abu Talhamainuddin Ansary

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

First-order methods such as stochastic gradient descent (SGD) are currently the standard algorithm for training deep neural networks. Second-order methods, despite their better convergence rate, are rarely used in practice due to the…

Machine Learning · Computer Science 2019-09-26 Tianle Cai , Ruiqi Gao , Jikai Hou , Siyu Chen , Dong Wang , Di He , Zhihua Zhang , Liwei Wang

In this work, we propose a Neural Architecture Search (NAS) for retinal layer segmentation in Optical Coherence Tomography (OCT) scans. We incorporate the Unet architecture in the NAS framework as its backbone for the segmentation of the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-30 Saba Heidari Gheshlaghi , Omid Dehzangi , Ali Dabouei , Annahita Amireskandari , Ali Rezai , Nasser M Nasrabadi

One-shot Neural architecture search (One-shot NAS) has been proposed as a time-efficient approach to obtain optimal subnet architectures and weights under different complexity cases by training only once. However, the subnet performance…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mingyang Zhang , Xinyi Yu , Haodong Zhao , Linlin Ou

Semantic segmentation of 3D medical images is a challenging task due to the high variability of the shape and pattern of objects (such as organs or tumors). Given the recent success of deep learning in medical image segmentation, Neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-25 Cheng Peng , Andriy Myronenko , Ali Hatamizadeh , Vish Nath , Md Mahfuzur Rahman Siddiquee , Yufan He , Daguang Xu , Rama Chellappa , Dong Yang

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

Machine Learning · Computer Science 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Graph Neural Networks (GNNs) obtain tremendous success in modeling relational data. Still, they are prone to adversarial attacks, which are massive threats to applying GNNs to risk-sensitive domains. Existing defensive methods neither…

Machine Learning · Computer Science 2023-04-11 Beini Xie , Heng Chang , Ziwei Zhang , Xin Wang , Daixin Wang , Zhiqiang Zhang , Rex Ying , Wenwu Zhu

Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the ability of fast…

Machine Learning · Computer Science 2023-09-20 Hao Liu , Jiarui Feng , Lecheng Kong , Dacheng Tao , Yixin Chen , Muhan Zhang

Aiming at two molecular graph datasets and one protein association subgraph dataset in OGB graph classification task, we design a graph neural network framework for graph classification task by introducing PAS(Pooling Architecture Search).…

Machine Learning · Computer Science 2022-07-14 Xu Wang , Huan Zhao , Lanning Wei , Quanming Yao