English
Related papers

Related papers: Learning Unified Representations from Heterogeneou…

200 papers

Spatiotemporal time series forecasting plays a key role in a wide range of real-world applications. While significant progress has been made in this area, fully capturing and leveraging spatiotemporal heterogeneity remains a fundamental…

Machine Learning · Computer Science 2024-09-04 Zheng Dong , Renhe Jiang , Haotian Gao , Hangchen Liu , Jinliang Deng , Qingsong Wen , Xuan Song

In distributed and federated learning, heterogeneity across data sources remains a major obstacle to effective model aggregation and convergence. We focus on feature heterogeneity and introduce energy distance as a sensitive measure for…

Machine Learning · Statistics 2025-01-28 Mengchen Fan , Baocheng Geng , Roman Shterenberg , Joseph A. Casey , Zhong Chen , Keren Li

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

High-dimensional multivariate longitudinal data, which arise when many outcome variables are measured repeatedly over time, are becoming increasingly common in social, behavioral and health sciences. We propose a latent variable model for…

Methodology · Statistics 2025-12-09 Sze Ming Lee , Yunxiao Chen , Tony Sit

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

Machine Learning · Computer Science 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable information from these time…

Machine Learning · Computer Science 2026-05-19 Patara Trirat , Yooju Shin , Junhyeok Kang , Youngeun Nam , Jihye Na , Minyoung Bae , Joeun Kim , Byunghyun Kim , Jae-Gil Lee

Human computer interaction (HCI) involves a multidisciplinary fusion of technologies, through which the control of external devices could be achieved by monitoring physiological status of users. However, physiological biosignals often vary…

Signal Processing · Electrical Eng. & Systems 2020-09-29 Mo Han , Ozan Ozdenizci , Toshiaki Koike-Akino , Ye Wang , Deniz Erdogmus

Federated Learning (FL) remains highly vulnerable to poisoning attacks, especially under real-world hyper-heterogeneity, where clients differ significantly in data distributions, communication capabilities, and model architectures. Such…

Machine Learning · Computer Science 2025-08-07 Weiyao Zhang , Jinyang Li , Qi Song , Miao Wang , Chungang Lin , Haitong Luo , Xuying Meng , Yujun Zhang

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

Deep learning methods exhibit promising performance for predictive modeling in healthcare, but two important challenges remain: -Data insufficiency:Often in healthcare predictive modeling, the sample size is insufficient for deep learning…

Machine Learning · Computer Science 2017-04-04 Edward Choi , Mohammad Taha Bahadori , Le Song , Walter F. Stewart , Jimeng Sun

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic…

Methodology · Statistics 2024-06-26 Xiaohui Yuan , Shujie Ren

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

In modern federated learning, one of the main challenges is to account for inherent heterogeneity and the diverse nature of data distributions for different clients. This problem is often addressed by introducing personalization of the…

Machine Learning · Statistics 2023-12-19 Nikita Kotelevskii , Samuel Horváth , Karthik Nandakumar , Martin Takáč , Maxim Panov

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

We introduce a two-parameter ensemble of random discrete-time Markov models that simultaneously captures critical slowing down and broken detailed balance. Extending a previously studied heterogeneous Markov ensemble, we incorporate…

Disordered Systems and Neural Networks · Physics 2026-02-06 Faheem Mosam , Eric De Giuli

Minimum redundancy among different elements of an embedding in a latent space is a fundamental requirement or major preference in representation learning to capture intrinsic informational structures. Current self-supervised learning…

Machine Learning · Computer Science 2022-07-19 Chuang Niu , Ge Wang

Given only aggregate choice data and limited information about how menus are distributed across the population, we describe what can be inferred robustly about the distribution of preferences (or more general decision rules). We strengthen…

Theoretical Economics · Economics 2024-05-16 Larry G Epstein , Kaushil Patel

Human Activity Recognition (HAR) on mobile devices has been demonstrated to be possible using neural models trained on data collected from the device's inertial measurement units. These models have used Convolutional Neural Networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Sannara EK , François Portet , Philippe Lalanda

Deep learning methods have reached state-of-the-art performance in cardiac image segmentation. Currently, the main bottleneck towards their effective translation into clinics requires assuring continuous high model performance and…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Francesco Galati , Maria A. Zuluaga

Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHeteroFL methods rely on training loss to transfer knowledge…

Machine Learning · Computer Science 2024-06-04 Liping Yi , Han Yu , Chao Ren , Gang Wang , Xiaoguang Liu , Xiaoxiao Li