English
Related papers

Related papers: Improving Heterogeneous Model Reuse by Density Est…

200 papers

This paper integrates deep neural networks (DNNs) into structural economic models to increase flexibility and capture rich heterogeneity while preserving interpretability. Economic structure and machine learning are complements in empirical…

Econometrics · Economics 2025-04-28 Max H. Farrell , Tengyuan Liang , Sanjog Misra

As an intrinsic and fundamental property of big data, data heterogeneity exists in a variety of real-world applications, such as precision medicine, autonomous driving, financial applications, etc. For machine learning algorithms, the…

Machine Learning · Computer Science 2023-04-04 Jiashuo Liu , Jiayun Wu , Bo Li , Peng Cui

Model fusion research aims to aggregate the knowledge of multiple individual models to enhance performance by combining their weights. In this work, we study the inverse problem: investigating whether model fusion can be used to reduce…

Computation and Language · Computer Science 2024-10-11 Kerem Zaman , Leshem Choshen , Shashank Srivastava

We seek to improve crowd counting as we perceive limits of currently prevalent density map estimation approach on both prediction accuracy and time efficiency. We leverage multilevel pixelation of density map as it helps improve SNR of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Zhuojun Chen , Junhao Cheng , Yuchen Yuan , Dongping Liao , Yizhou Li , Jiancheng Lv

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

Methodology · Statistics 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous treatment effects under…

Econometrics · Economics 2022-02-01 Gabriel Okasa

Data generated by edge devices has the potential to train intelligent autonomous systems across various domains. Despite the emergence of diverse machine learning approaches addressing privacy concerns and utilizing distributed data,…

Machine Learning · Computer Science 2024-03-12 Adarsh N L , Arun P , Alok Porwal , Malcolm Aranha

The ubiquity of large-scale Pre-Trained Models (PTMs) is on the rise, sparking interest in model hubs, and dedicated platforms for hosting PTMs. Despite this trend, a comprehensive exploration of the challenges that users encounter and how…

Software Engineering · Computer Science 2024-01-25 Mina Taraghi , Gianolli Dorcelus , Armstrong Foundjem , Florian Tambon , Foutse Khomh

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Massive amounts of data are the foundation of data-driven recommendation models. As an inherent nature of big data, data heterogeneity widely exists in real-world recommendation systems. It reflects the differences in the properties among…

Information Retrieval · Computer Science 2023-05-26 Zimu Wang , Jiashuo Liu , Hao Zou , Xingxuan Zhang , Yue He , Dongxu Liang , Peng Cui

Estimating heterogeneous treatment effect is an important task in causal inference with wide application fields. It has also attracted increasing attention from machine learning community in recent years. In this work, we reinterpret the…

Methodology · Statistics 2018-10-26 Ran Chen , Hanzhong Liu

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

The commonly used latent space embedding techniques, such as Principal Component Analysis, Factor Analysis, and manifold learning techniques, are typically used for learning effective representations of homogeneous data. However, they do…

Machine Learning · Computer Science 2021-10-04 Yasin Yilmaz , Mehmet Aktukmak , Alfred O. Hero

Federated Learning is a training framework that enables multiple participants to collaboratively train a shared model while preserving data privacy and minimizing communication overhead. The heterogeneity of devices and networking resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Rahul Mishra , Hari Prabhat Gupta , Garvit Banga

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

This work is motivated by multimodality breast cancer imaging data, which is quite challenging in that the signals of discrete tumor-associated microvesicles (TMVs) are randomly distributed with heterogeneous patterns. This imposes a…

Machine Learning · Statistics 2019-03-22 Xiwei Tang , Xuan Bi , Annie Qu

In this paper we focus on the dynamic state estimation which harnesses a vast amount of sensing data harvested by multiple parties and recognize that in many applications, to improve collaborations between parties, the estimation procedure…

Systems and Control · Electrical Eng. & Systems 2021-01-05 Yuqing Ni , Junfeng Wu , Li Li , Ling Shi

Efficient extraction of useful knowledge from these data is still a challenge, mainly when the data is distributed, heterogeneous and of different quality depending on its corresponding local infrastructure. To reduce the overhead cost,…

Databases · Computer Science 2017-04-17 Nhien-An Le-Khac , M-Tahar Kechadi

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…