English
Related papers

Related papers: Contrasformer: A Brain Network Contrastive Transfo…

200 papers

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Existing graph neural networks may suffer from the "suspended animation problem" when the model architecture goes deep. Meanwhile, for some graph learning scenarios, e.g., nodes with text/image attributes or graphs with long-distance node…

Machine Learning · Computer Science 2020-01-23 Jiawei Zhang

Efficiently utilizing discriminative features is crucial for convolutional neural networks to achieve remarkable performance in medical image segmentation and is also important for model generalization across multiple domains, where letting…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Ran Gu , Jiangshan Lu , Jingyang Zhang , Wenhui Lei , Xiaofan Zhang , Guotai Wang , Shaoting Zhang

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Oversmoothing is a common phenomenon in a wide range of Graph Neural Networks (GNNs) and Transformers, where performance worsens as the number of layers increases. Instead of characterizing oversmoothing from the view of complete collapse…

Machine Learning · Computer Science 2023-05-03 Xiaojun Guo , Yifei Wang , Tianqi Du , Yisen Wang

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong

Graph Neural Networks (GNNs) have garnered intensive attention for Network Intrusion Detection System (NIDS) due to their suitability for representing the network traffic flows. However, most present GNN-based methods for NIDS are…

Machine Learning · Computer Science 2024-03-05 Renjie Xu , Guangwei Wu , Weiping Wang , Xing Gao , An He , Zhengpeng Zhang

Nuclei appear small in size, yet, in real clinical practice, the global spatial information and correlation of the color or brightness contrast between nuclei and background, have been considered a crucial component for accurate nuclei…

Image and Video Processing · Electrical Eng. & Systems 2023-07-18 Zhenqi He , Mathias Unberath , Jing Ke , Yiqing Shen

Finding the biomarkers associated with ASD is helpful for understanding the underlying roots of the disorder and can lead to earlier diagnosis and more targeted treatment. A promising approach to identify biomarkers is using Graph Neural…

Machine Learning · Computer Science 2019-07-15 Xiaoxiao Li , Nicha C. Dvornek , Yuan Zhou , Juntang Zhuang , Pamela Ventola , James S. Duncan

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang

In recent years, Graph Neural Networks (GNNs) have made significant advancements, particularly in tasks such as node classification, link prediction, and graph representation. However, challenges arise from biases that can be hidden not…

Machine Learning · Computer Science 2024-04-10 Mahdi Tavassoli Kejani , Fadi Dornaika , Jean-Michel Loubes

Graph neural networks (GNNs) have various practical applications, such as drug discovery, recommendation engines, and chip design. However, GNNs lack transparency as they cannot provide understandable explanations for their predictions. To…

Machine Learning · Computer Science 2023-06-09 Samidha Verma , Burouj Armgaan , Sourav Medya , Sayan Ranu

With the growing interest in foundation models for brain signals, graph-based pretraining has emerged as a promising paradigm for learning transferable representations from connectome data. However, existing contrastive and masked…

Machine Learning · Computer Science 2026-03-10 Xinxu Wei , Rong Zhou , Lifang He , Yu Zhang

Brain graphs (i.e, connectomes) constructed from medical scans such as magnetic resonance imaging (MRI) have become increasingly important tools to characterize the abnormal changes in the human brain. Due to the high acquisition cost and…

Machine Learning · Computer Science 2021-05-07 Alaa Bessadok , Mohamed Ali Mahjoub , Islem Rekik

In the field of neuroimaging, accurate brain age prediction is pivotal for uncovering the complexities of brain aging and pinpointing early indicators of neurodegenerative conditions. Recent advancements in self-supervised learning,…

Anomaly detection using a network-based approach is one of the most efficient ways to identify abnormal events such as fraud, security breaches, and system faults in a variety of applied domains. While most of the earlier works address the…

Artificial Intelligence · Computer Science 2025-01-22 Hossein Rafieizadeh , Hadi Zare , Mohsen Ghassemi Parsa , Hadi Davardoust , Meshkat Shariat Bagheri

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

Brain Functional Networks (BFNs), graph theoretical models of brain activity data, provide a systems perspective of complex functional connectivity within the brain. Neurological disorders are known to have basis in abnormal functional…

Quantitative Methods · Quantitative Biology 2016-08-30 Megha Singh , Rahul Badhwar , Ganesh Bagler

Vision Transformer (ViT) has shown its advantages over the convolutional neural network (CNN) with its ability to capture global long-range dependencies for visual representation learning. Besides ViT, contrastive learning is another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Hua-Bao Ling , Bowen Zhu , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

Deep clustering has shown its promising capability in joint representation learning and clustering via deep neural networks. Despite the significant progress, the existing deep clustering works mostly utilize some distribution-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yuankun Xu , Dong Huang , Chang-Dong Wang , Jian-Huang Lai