English
Related papers

Related papers: FAME: Adaptive Functional Attention with Expert Ro…

200 papers

Feature selection is essential for high-dimensional biomedical data, enabling stronger predictive performance, reduced computational cost, and improved interpretability in precision medicine applications. Existing approaches face notable…

Machine Learning · Computer Science 2026-01-07 Xiaoyan Sun , Qingyu Meng , Yalu Wen

The versatility of self-attention mechanism earned transformers great success in almost all data modalities, with limitations on the quadratic complexity and difficulty of training. To apply transformers across different data modalities,…

Machine Learning · Computer Science 2024-08-20 Viet Anh Nguyen , Minh Lenhat , Khoa Nguyen , Duong Duc Hieu , Dao Huu Hung , Truong Son Hy

Aggregation of large databases in a specific format is a frequently used process to make the data easily manageable. Interval-valued data is one of the data types that is generated by such an aggregation process. Using traditional methods…

Methodology · Statistics 2020-01-09 Ufuk Beyaztas , Han Lin Shang , Abdel-Salam G. Abdel-Salam

Data augmentation (DA) methods tailored to specific domains generate synthetic samples by applying transformations that are appropriate for the characteristics of the underlying data domain, such as rotations on images and time warping on…

Machine Learning · Computer Science 2024-06-18 Ilya Kaufman , Omri Azencot

Machine learning models achieve state-of-the-art performance across domains, yet their lack of interpretability limits safe deployment in high-stakes settings. Counterfactual explanations are widely used to provide actionable "what-if"…

Machine Learning · Computer Science 2025-11-18 Nawid Keshtmand , Roussel Desmond Nzoyem , Jeffrey Nicholas Clark

The use of multi-modal data for deep machine learning has shown promise when compared to uni-modal approaches with fusion of multi-modal features resulting in improved performance in several applications. However, most state-of-the-art…

Machine Learning · Computer Science 2020-10-26 Darshana Priyasad , Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Sequential recommendation requires capturing diverse user behaviors, which a single network often fails to capture. While ensemble methods mitigate this by leveraging multiple networks, training them all from scratch leads to high…

Information Retrieval · Computer Science 2026-04-07 WooJoo Kim , JunYoung Kim , JaeHyung Lim , SeongJin Choi , SeongKu Kang , HwanJo Yu

Mixture-of-Experts (MoE) models enable scalable neural networks through conditional computation, offering enhanced effectiveness and efficiency for next-generation wireless communications. However, deploying MoE with federated learning (FL)…

Machine Learning · Computer Science 2026-05-19 Boyang Zhang , Xiaobing Chen , Songyang Zhang , Shuai Zhang , Xiangwei Zhou , Jian Zhang , Mingxuan Sun

Federated learning allows mobile clients to jointly train a global model without sending their private data to a central server. Extensive works have studied the performance guarantee of the global model, however, it is still unclear how…

Machine Learning · Computer Science 2021-04-14 Yihao Xue , Chaoyue Niu , Zhenzhe Zheng , Shaojie Tang , Chengfei Lv , Fan Wu , Guihai Chen

Transformer-based models, even though achieving super-human performance on several downstream tasks, are often regarded as a black box and used as a whole. It is still unclear what mechanisms they have learned, especially their core module:…

Computation and Language · Computer Science 2023-10-17 Chong Li , Shaonan Wang , Yunhao Zhang , Jiajun Zhang , Chengqing Zong

In recent years, model explanation methods have been designed to interpret model decisions faithfully and intuitively so that users can easily understand them. In this paper, we propose a framework, Faithful Attention Explainer (FAE),…

Computation and Language · Computer Science 2024-05-28 Yao Rong , David Scheerer , Enkelejda Kasneci

Continual learning agents with finite capacity must balance acquiring new knowledge with retaining the old. This requires controlled forgetting of knowledge that is no longer needed, freeing up capacity to learn. Weight decay, viewed as a…

Machine Learning · Computer Science 2026-05-01 Aditya A. Ramesh , Alex Lewandowski , Jürgen Schmidhuber

Functional Data Analysis represents a field of growing interest in statistics. Despite several studies have been proposed leading to fundamental results, the problem of obtaining valid and efficient prediction sets has not been thoroughly…

Methodology · Statistics 2021-04-13 Jacopo Diquigiovanni , Matteo Fontana , Simone Vantini

Linear mixed-effects model (LMM) is a cornerstone of longitudinal data analysis, but is limited to adeptly make heterogeneous analyses predictable under both group-specific fixed effects and subject-specific random effects. To address this…

Methodology · Statistics 2026-03-10 Xinkai Yue , Xiaodong Yan , Haohui Han , Liya Fu

Electronic Health Record (EHR) data encompass diverse modalities -- text, images, and medical codes -- that are vital for clinical decision-making. To process these complex data, multimodal AI (MAI) has emerged as a powerful approach for…

Machine Learning · Computer Science 2026-03-03 Nikkie Hooman , Zhongjie Wu , Eric C. Larson , Mehak Gupta

Functional data, representing curves or trajectories, are ubiquitous in fields like biomedicine and motion analysis. A fundamental challenge is phase variability -- temporal misalignments that obscure underlying patterns and degrade model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Siyuan Jiang , Yihan Hu , Wenjie Li , Pengcheng Zeng

Deep functional maps have emerged in recent years as a prominent learning-based framework for non-rigid shape matching problems. While early methods in this domain only focused on learning in the functional domain, the latest techniques…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Robin Magnet , Maks Ovsjanikov

In federated learning (FL), accommodating clients' varied computational capacities poses a challenge, often limiting the participation of those with constrained resources in global model training. To address this issue, the concept of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Feijie Wu , Xingchen Wang , Yaqing Wang , Tianci Liu , Lu Su , Jing Gao

Continual Model Merging (CMM) sequentially integrates task-specific models into a unified architecture without intensive retraining. However, existing CMM methods are hindered by a fundamental saturation-redundancy dilemma: backbone-centric…

Machine Learning · Computer Science 2026-04-27 Haiyun Qiu , Xingyu Wu , Kay Chen Tan

Video action analysis is a foundational technology within the realm of intelligent video comprehension, particularly concerning its application in Internet of Things(IoT). However, existing methodologies overlook feature semantics in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Guiqin Wang , Peng Zhao , Cong Zhao , Jing Huang , Siyan Guo , Shusen Yang