English
Related papers

Related papers: Unifying Nonlocal Blocks for Neural Networks

200 papers

Graph clustering is a central topic in unsupervised learning with a multitude of practical applications. In recent years, multi-view graph clustering has gained a lot of attention for its applicability to real-world instances where one has…

Machine Learning · Computer Science 2024-06-10 Vincent Cohen-Addad , Tommaso d'Orsi , Silvio Lattanzi , Rajai Nasser

Unsupervised approaches to learning in neural networks are of substantial interest for furthering artificial intelligence, both because they would enable the training of networks without the need for large numbers of expensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Chengxu Zhuang , Alex Lin Zhai , Daniel Yamins

Deep learning's performance has been extensively recognized recently. Graph neural networks (GNNs) are designed to deal with graph-structural data that classical deep learning does not easily manage. Since most GNNs were created using…

Machine Learning · Computer Science 2023-09-20 Zhiqian Chen , Fanglan Chen , Lei Zhang , Taoran Ji , Kaiqun Fu , Liang Zhao , Feng Chen , Lingfei Wu , Charu Aggarwal , Chang-Tien Lu

Deep learning has been widely used for hyperspectral pixel classification due to its ability of generating deep feature representation. However, how to construct an efficient and powerful network suitable for hyperspectral data is still…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Jingzhou Chen , Siyu Chen , Peilin Zhou , Yuntao Qian

Although a video is effectively a sequence of images, visual perception systems typically model images and videos separately, thus failing to exploit the correlation and the synergy provided by these two media. While a few prior research…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Yufei Wang , Du Tran , Lorenzo Torresani

Convolutional Neural Networks (CNNs) model long-range dependencies by deeply stacking convolution operations with small window sizes, which makes the optimizations difficult. This paper presents region-based non-local (RNL) operations as a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Guoxi Huang , Adrian G. Bors

Learning to capture long-range relations is fundamental to image/video recognition. Existing CNN models generally rely on increasing depth to model such relations which is highly inefficient. In this work, we propose the "double attention…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Yunpeng Chen , Yannis Kalantidis , Jianshu Li , Shuicheng Yan , Jiashi Feng

Graph neural networks (GNNs) have shown remarkable performance on homophilic graph data while being far less impressive when handling non-homophilic graph data due to the inherent low-pass filtering property of GNNs. In general, since…

Machine Learning · Computer Science 2023-10-27 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Youru Li , Yao Zhao

Brain imaging data such as EEG or MEG are high-dimensional spatiotemporal data often degraded by complex, non-Gaussian noise. For reliable analysis of brain imaging data, it is important to extract discriminative, low-dimensional intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Yiluan Guo , Hossein Nejati , Ngai-Man Cheung

The architectures of deep neural networks (DNN) rely heavily on the underlying grid structure of variables, for instance, the lattice of pixels in an image. For general high dimensional data with variables not associated with a grid, the…

Machine Learning · Statistics 2024-08-07 Lixiang Zhang , Lin Lin , Jia Li

Filters in convolutional networks are typically parameterized in a pixel basis, that does not take prior knowledge about the visual world into account. We investigate the generalized notion of frames designed with image properties in mind,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Jörn-Henrik Jacobsen , Bert de Brabandere , Arnold W. M. Smeulders

We focus on spectral clustering of unlabeled graphs and review some results on clustering methods which achieve weak or strong consistent identification in data generated by such models. We also present a new algorithm which appears to…

Statistics Theory · Mathematics 2015-08-11 Sharmodeep Bhattacharyya , Peter J. Bickel

Graph Neural Networks often struggle with long-range information propagation and in the presence of heterophilous neighborhoods. We address both challenges with a unified framework that incorporates a clustering inductive bias into the…

Machine Learning · Computer Science 2024-05-28 Yanfei Dong , Mohammed Haroon Dupty , Lambert Deng , Zhuanghua Liu , Yong Liang Goh , Wee Sun Lee

Graph clustering is a fundamental task in unsupervised learning with broad real-world applications. While spectral clustering methods for undirected graphs are well-established and guided by a minimum cut optimization consensus, their…

Machine Learning · Statistics 2025-06-04 Ning Zhang , Xiaowen Dong , Mihai Cucuringu

Deep learning based methods, such as Convolution Neural Network (CNN), have demonstrated their efficiency in hyperspectral image (HSI) classification. These methods can automatically learn spectral-spatial discriminative features within…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Yu Shen , Sijie Zhu , Chen Chen , Qian Du , Liang Xiao , Jianyu Chen , Delu Pan

Graph embedding is a transformation of nodes of a network into a set of vectors. A good embedding should capture the underlying graph topology and structure, node-to-node relationship, and other relevant information about the graph, its…

Social and Information Networks · Computer Science 2021-12-02 Bogumił Kamiński , Łukasz Kraiński , Paweł Prałat , François Théberge

This paper addresses representational block named Hierarchical-Split Block, which can be taken as a plug-and-play block to upgrade existing convolutional neural networks, improves model performance significantly in a network.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Pengcheng Yuan , Shufei Lin , Cheng Cui , Yuning Du , Ruoyu Guo , Dongliang He , Errui Ding , Shumin Han

Precise segmentation of medical images is fundamental for extracting critical clinical information, which plays a pivotal role in enhancing the accuracy of diagnoses, formulating effective treatment plans, and improving patient outcomes.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Jintong Hu , Siyan Chen , Zhiyi Pan , Sen Zeng , Wenming Yang

Graph Neural Networks learn on graph-structured data by iteratively aggregating local neighborhood information. While this local message passing paradigm imparts a powerful inductive bias and exploits graph sparsity, it also yields three…

Machine Learning · Computer Science 2025-11-07 Ryien Hosseini , Filippo Simini , Venkatram Vishwanath , Rebecca Willett , Henry Hoffmann

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

Machine Learning · Computer Science 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush