English
Related papers

Related papers: HCL-FF: Hierarchical and Contrastive Learning for …

200 papers

Federated Learning (FL) enables edge devices to collaboratively learn a global model, but it may not perform well when clients have high data heterogeneity. In this paper, we propose a dynamic clustering algorithm for personalized federated…

Machine Learning · Computer Science 2025-08-05 Heting Liu , Junzhe Huang , Fang He , Guohong Cao

Homography estimation is an important task in computer vision applications, such as image stitching, video stabilization, and camera calibration. Traditional homography estimation methods heavily depend on the quantity and distribution of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Lang Nie , Chunyu Lin , Kang Liao , Shuaicheng Liu , Yao Zhao

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

Machine Learning · Computer Science 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Predicting the neural response to natural images in the visual cortex requires extracting relevant features from the images and relating those feature to the observed responses. In this work, we optimize the feature extraction in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Alex Mulrooney , Austin J. Brockmeier

Recent deep learning models such as ChatGPT utilizing the back-propagation algorithm have exhibited remarkable performance. However, the disparity between the biological brain processes and the back-propagation algorithm has been noted. The…

Machine Learning · Computer Science 2024-04-24 Taewook Hwang , Hyein Seo , Sangkeun Jung

Federated learning (FL) is a promising approach that enables distributed clients to collaboratively train a global model while preserving their data privacy. However, FL often suffers from data heterogeneity problems, which can…

Machine Learning · Computer Science 2023-11-29 Ye Lin Tun , Minh N. H. Nguyen , Chu Myaet Thwal , Jinwoo Choi , Choong Seon Hong

Graph Neural Networks (GNNs) have become powerful tools in modeling graph-structured data in recommender systems. However, real-life recommendation scenarios usually involve heterogeneous relationships (e.g., social-aware user influence,…

Information Retrieval · Computer Science 2023-03-03 Mengru Chen , Chao Huang , Lianghao Xia , Wei Wei , Yong Xu , Ronghua Luo

The backpropagation algorithm, despite its widespread use in neural network learning, may not accurately emulate the human cortex's learning process. Alternative strategies, such as the Forward-Forward Algorithm (FFA), offer a closer match…

Neural and Evolutionary Computing · Computer Science 2023-05-23 Desmond Y. M. Tang

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Neural visual decoding is a central problem in brain computer interface research, aiming to reconstruct human visual perception and to elucidate the structure of neural representations. However, existing approaches overlook a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yang Du , Siyuan Dai , Yonghao Song , Paul M. Thompson , Haoteng Tang , Liang Zhan

Deep learning based medical imaging classification models usually suffer from the domain shift problem, where the classification performance drops when training data and real-world data differ in imaging equipment manufacturer, image…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Wenshuo Zhou , Dalu Yang , Binghong Wu , Yehui Yang , Junde Wu , Xiaorong Wang , Lei Wang , Haifeng Huang , Yanwu Xu

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Hierarchical federated learning (HFL) is a promising distributed deep learning model training paradigm, but it has crucial security concerns arising from adversarial attacks. This research investigates and assesses the security of HFL using…

Machine Learning · Computer Science 2024-08-21 D Alqattan , R Sun , H Liang , G Nicosia , V Snasel , R Ranjan , V Ojha

Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-supervised signals from…

Information Retrieval · Computer Science 2025-04-15 Yu Zhang , Yiwen Zhang , Yi Zhang , Lei Sang , Yun Yang

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han