English
Related papers

Related papers: Cooperative Distribution Alignment via JSD Upper B…

200 papers

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an…

Optimization and Control · Mathematics 2022-02-21 Iman Nodozi , Abhishek Halder

We consider centralized distributed optimization in the classical federated learning setup, where $n$ workers jointly find an $\varepsilon$-stationary point of an $L$-smooth, $d$-dimensional nonconvex function $f$, having access only to…

Optimization and Control · Mathematics 2026-03-31 Alexander Tyurin

When implementing hierarchical federated learning over wireless networks, scalability assurance and the ability to handle both interference and device data heterogeneity are crucial. This work introduces a new two-level learning method…

Information Theory · Computer Science 2024-01-12 Seyed Mohammad Azimi-Abarghouyi , Viktoria Fodor

This paper presents a distributed Koopman operator learning framework for modeling unknown nonlinear dynamics using sequential observations from multiple agents. Each agent estimates a local Koopman approximation based on lifted data and…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Ali Azarbahram , Shenyu Liu , Gian Paolo Incremona

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

We aim at the problem named One-Shot Unsupervised Domain Adaptation. Unlike traditional Unsupervised Domain Adaptation, it assumes that only one unlabeled target sample can be available when learning to adapt. This setting is realistic but…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yawei Luo , Ping Liu , Tao Guan , Junqing Yu , Yi Yang

This paper considers distributed optimization problems, where each agent cooperatively minimizes the sum of local objective functions through the communication with its neighbors. The widely adopted distributed gradient method in solving…

Optimization and Control · Mathematics 2025-08-19 Yeming Xu , Ziyuan Guo , Kaihong Lu , Huanshui Zhang

Previous studies dominantly target at self-supervised learning on real-valued networks and have achieved many promising results. However, on the more challenging binary neural networks (BNNs), this task has not yet been fully explored in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiqiang Shen , Zechun Liu , Jie Qin , Lei Huang , Kwang-Ting Cheng , Marios Savvides

Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models. Existing methods…

Machine Learning · Computer Science 2023-06-01 Maohao Shen , Yuheng Bu , Gregory Wornell

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto

Domain alignment refers broadly to learning correspondences between data distributions from distinct domains. In this work, we focus on a setting where domains share underlying structural patterns despite differences in their specific…

Machine Learning · Computer Science 2026-01-06 Julie Keisler , Anastase Alexandre Charantonis , Yannig Goude , Boutheina Oueslati , Claire Monteleoni

Unsupervised Domain Adaptive Object Detection (DAOD) could adapt a model trained on a source domain to an unlabeled target domain for object detection. Existing unsupervised DAOD methods usually perform feature alignments from the target to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Jie Shao , Jiacheng Wu , Wenzhong Shen , Cheng Yang

Despite the success of deep neural networks in medical image classification, the problem remains challenging as data annotation is time-consuming, and the class distribution is imbalanced due to the relative scarcity of diseases. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhongzheng Huang , Jiawei Wu , Tao Wang , Zuoyong Li , Anastasia Ioannou

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

Domain adaptation has received a lot of attention in recent years, and many algorithms have been proposed with impressive progress. However, it is still not fully explored concerning the joint probability distribution (P(X, Y)) distance for…

Machine Learning · Computer Science 2021-01-26 Wei Wang , Baopu Li , Shuhui Yang , Jing Sun , Zhengming Ding , Junyang Chen , Xiao Dong , Zhihui Wang , Haojie Li

An unsupervised learning classification model is described. It achieves classification error probability competitive with that of popular supervised learning classifiers such as SVM or kNN. The model is based on the incremental execution of…

Machine Learning · Computer Science 2024-10-01 Daniel N. Nissani

Mapping data from and/or onto a known family of distributions has become an important topic in machine learning and data analysis. Deep generative models (e.g., generative adversarial networks ) have been used effectively to match known and…

Machine Learning · Computer Science 2020-10-30 Surojit Saha , Shireen Elhabian , Ross T. Whitaker

Unsupervised learning has been extensively adopted to train deep neural networks (DNNs) for learning wireless resource allocation. Yet, the performance of DNNs is vulnerable to distribution shifts between training and test data, e.g.,…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Shengjie Liu , Chenyang Yang

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensional or structured…

Machine Learning · Statistics 2026-05-08 Trevor Harris

Unsupervised Domain Adaptation (UDA) is quite challenging due to the large distribution discrepancy between the source domain and the target domain. Inspired by diffusion models which have strong capability to gradually convert data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Duo Peng , Qiuhong Ke , Yinjie Lei , Jun Liu