English
Related papers

Related papers: Heterogeneity Adjustment with Applications to Grap…

200 papers

Developers often need to decide which APIs to use for the functions being implemented. With the ever-growing number of APIs and libraries, it becomes increasingly difficult for developers to find appropriate APIs, indicating the necessity…

Software Engineering · Computer Science 2022-08-04 Yujia Chen , Xiaoxue Ren , Cuiyun Gao , Yun Peng , Xin Xia , Michael R. Lyu

Low-rank adaptation (LoRA) offers an efficient alternative to full-weight adaptation in federated fine-tuning of language models, significantly reducing computational costs. By adjusting ranks for each client, federated LoRA enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Yuji Byun , Jaeho Lee

In this paper, we introduce a novel family of iterative algorithms which carry out $\alpha$-divergence minimisation in a Variational Inference context. They do so by ensuring a systematic decrease at each step in the $\alpha$-divergence…

Computation · Statistics 2023-04-12 Kamélia Daudel , Randal Douc , François Roueff

Dynamic Facial Expression Recognition (DFER) plays a critical role in affective computing and human-computer interaction. Although existing methods achieve comparable performance, they inevitably suffer from performance degradation under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Feng-Qi Cui , Anyang Tong , Jinyang Huang , Jie Zhang , Dan Guo , Zhi Liu , Meng Wang

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

In myriad statistical applications, data are collected from related but heterogeneous sources. These sources share some commonalities while containing idiosyncratic characteristics. One of the most fundamental challenges in such scenarios…

Methodology · Statistics 2024-03-29 Naichen Shi , Raed Al Kontar , Salar Fattahi

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

With the development of deep learning, the field of face anti-spoofing (FAS) has witnessed great progress. FAS is usually considered a classification problem, where each class is assumed to contain a single cluster optimized by softmax…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Qinghong Sun , Zhenfei Yin , Yichao Wu , Yuanhan Zhang , Jing Shao

Graph neural networks (GNNs) face significant challenges with class imbalance, leading to biased inference results. To address this issue in heterogeneous graphs, we propose a novel framework that combines Graph Neural Network (GNN) and…

Machine Learning · Computer Science 2024-11-26 Hung-Chun Hsu , Bo-Jun Wu , Ming-Yi Hong , Che Lin , Chih-Yu Wang

Federated learning is a decentralized collaborative training paradigm preserving stakeholders' data ownership while improving performance and generalization. However, statistical heterogeneity among client datasets degrades system…

Machine Learning · Computer Science 2025-09-09 Vasilis Siomos , Jonathan Passerat-Palmbach , Giacomo Tarroni

Prompt and accurate detection of system anomalies is essential to ensure the reliability of software systems. Unlike manual efforts that exploit all available run-time information, existing approaches usually leverage only a single type of…

Software Engineering · Computer Science 2023-02-16 Baitong Li , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Yongqiang Yang , Michael R. Lyu

The progressive hedging algorithm (PHA) is a cornerstone among algorithms for large-scale stochastic programming problems. However, its traditional implementation is hindered by some limitations, including the requirement to solve all…

Optimization and Control · Mathematics 2025-03-13 Di Zhang , Yihang Zhang , Suvrajeet Sen

Artificial intelligence and machine learning frameworks have served as computationally efficient mapping between inputs and outputs for engineering problems. These mappings have enabled optimization and analysis routines that have warranted…

Machine Learning · Statistics 2024-07-17 Yigitcan Comlek , Sandipp Krishnan Ravi , Piyush Pandita , Sayan Ghosh , Liping Wang , Wei Chen

Categorical covariates such as race, sex, or group are ubiquitous in regression analysis. While main-only (or ANCOVA) linear models are predominant, cat-modified linear models that include categorical-continuous or categorical-categorical…

Methodology · Statistics 2024-08-02 Daniel R. Kowal

Fine-tuning has become a popular approach to adapting large foundational models to specific tasks. As the size of models and datasets grows, parameter-efficient fine-tuning techniques are increasingly important. One of the most widely used…

Precision pathology relies on detecting fine-grained morphological abnormalities within specific Regions of Interest (ROIs), as these local, texture-rich cues - rather than global slide contexts - drive expert diagnostic reasoning. While…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chunze Yang , Wenjie Zhao , Yue Tang , Junbo Lu , Jiusong Ge , Qidong Liu , Zeyu Gao , Chen Li

Federated learning is an efficient framework designed to facilitate collaborative model training across multiple distributed devices while preserving user data privacy. A significant challenge of federated learning is data-level…

Machine Learning · Computer Science 2024-08-26 Shunxin Guo , Hongsong Wang , Shuxia Lin , Zhiqiang Kou , Xin Geng

The analysis of network data has gained considerable interest in recent years. This also includes the analysis of large, high-dimensional networks with hundreds and thousands of nodes. While exponential random graph models serve as…

Methodology · Statistics 2023-09-13 Nadja Klein , Göran Kauermann

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee