English
Related papers

Related papers: MalMoE: Mixture-of-Experts Enhanced Encrypted Mali…

200 papers

Anomaly detection from graph data is an important data mining task in many applications such as social networks, finance, and e-commerce. Existing efforts in graph anomaly detection typically only consider the information in a single scale…

Machine Learning · Computer Science 2024-08-02 Yu Zheng , Ming Jin , Yixin Liu , Lianhua Chi , Khoa T. Phan , Yi-Ping Phoebe Chen

Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's internal structure leads to unstable routing and expert…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Anzhe Cheng , Shukai Duan , Shixuan Li , Chenzhong Yin , Mingxi Cheng , Heng Ping , Tamoghna Chattopadhyay , Sophia I Thomopoulos , Shahin Nazarian , Paul Thompson , Paul Bogdan

Accurate univariate forecasting remains a pressing need in real-world systems, such as energy markets, hydrology, retail demand, and IoT monitoring, where signals are often intermittent and horizons span both short- and long-term. While…

Machine Learning · Computer Science 2025-08-26 Kyrylo Yemets , Mykola Lukashchuk , Ivan Izonin

Mixture-of-Experts (MoE) models scale capacity by combining specialized experts, but most existing approaches assume centralized access to training data. In practice, data are distributed across clients and cannot be shared due to privacy…

Machine Learning · Computer Science 2026-05-15 Weisen Jiang , Shuhao Chen , Sinno Jialin Pan

Recent advancements in Mixture of Experts (MoE) models have significantly increased their parameter scale as well as model performance. Extensive offloading techniques have been proposed to address the GPU memory limitations of MoE…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-03 Zhibin Wang , Zhonghui Zhang , Yuhang Zhou , Zibo Wang , Mo Zhou , Peng Jiang , Weilin Cai , Chengying Huan , Rong Gu , Sheng Zhong , Chen Tian

This paper addresses the problem of traffic prediction in distributed backend systems and proposes a graph neural network based modeling approach to overcome the limitations of traditional models in capturing complex dependencies and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Zhimin Qiu , Feng Liu , Yuxiao Wang , Chenrui Hu , Ziyu Cheng , Di Wu

Achieving accurate traffic prediction is a fundamental but crucial task in the development of current intelligent transportation systems.Most of the mainstream methods that have made breakthroughs in traffic prediction rely on…

Machine Learning · Computer Science 2025-11-13 Guangyin Jin , Sicong Lai , Xiaoshuai Hao , Mingtao Zhang , Jinlei Zhang

In recent years, Mixture-of-Experts (MoE) has emerged as an effective approach for enhancing the capacity of deep neural network (DNN) with sub-linear computational costs. However, storing all experts on GPUs incurs significant memory…

Machine Learning · Computer Science 2025-03-11 Suraiya Tairin , Shohaib Mahmud , Haiying Shen , Anand Iyer

The machine learning approach is vital in Internet of Things (IoT) malware traffic detection due to its ability to keep pace with the ever-evolving nature of malware. Machine learning algorithms can quickly and accurately analyze the vast…

Cryptography and Security · Computer Science 2023-04-04 Ethan Weitkamp , Yusuke Satani , Adam Omundsen , Jingwen Wang , Peilong Li

Money laundering is the process where criminals use financial services to move massive amounts of illegal money to untraceable destinations and integrate them into legitimate financial systems. It is very crucial to identify such activities…

Artificial Intelligence · Computer Science 2023-02-27 Md. Rezaul Karim , Felix Hermsen , Sisay Adugna Chala , Paola de Perthuis , Avikarsha Mandal

The application of mixture-of-experts (MoE) is gaining popularity due to its ability to improve model's performance. In an MoE structure, the gate layer plays a significant role in distinguishing and routing input features to different…

Machine Learning · Computer Science 2024-02-05 Zhitian Xie , Yinger Zhang , Chenyi Zhuang , Qitao Shi , Zhining Liu , Jinjie Gu , Guannan Zhang

Robust network security systems are essential to prevent and mitigate the harming effects of the ever-growing occurrence of network attacks. In recent years, machine learning-based systems have gain popularity for network security…

Cryptography and Security · Computer Science 2020-03-26 Gonzalo Marín , Pedro Casas , Germán Capdehourat

Multimodal graphs are gaining increasing attention due to their rich representational power and wide applicability, yet they introduce substantial challenges arising from severe modality confusion. To address this issue, we propose NSG…

Machine Learning · Computer Science 2026-02-03 Yihan Zhang , Ercan E. Kuruoglu

Recent advancements in large artificial intelligence models (LAMs) are driving significant innovations in mobile edge computing within next-generation wireless networks. However, the substantial demands for computational resources and…

Machine Learning · Computer Science 2026-03-10 Song Gao , Songyang Zhang , Shusen Jing , Shuai Zhang , Xiangwei Zhou , Yue Wang , Zhipeng Cai

Deep neural networks (NNs) are considered a powerful tool for balancing the performance and complexity of multiple-input multiple-output (MIMO) receivers due to their accurate feature extraction, high parallelism, and excellent inference…

Information Theory · Computer Science 2024-10-28 Xingyu Zhou , Jing Zhang , Chao-Kai Wen , Shi Jin , Shuangfeng Han

The graph identification problem consists of discovering the interactions among nodes in a network given their state/feature trajectories. This problem is challenging because the behavior of a node is coupled to all the other nodes by the…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Eduardo Sebastian , Thai Duong , Nikolay Atanasov , Eduardo Montijano , Carlos Sagues

Mixture-of-experts (MoE) is becoming popular due to its success in improving the model quality, especially in Transformers. By routing tokens with a sparse gate to a few experts (i.e., a small pieces of the full model), MoE can easily…

Machine Learning · Computer Science 2022-10-11 Xiaonan Nie , Xupeng Miao , Shijie Cao , Lingxiao Ma , Qibin Liu , Jilong Xue , Youshan Miao , Yi Liu , Zhi Yang , Bin Cui

Real-world graphs have inherently complex and diverse topological patterns, known as topological heterogeneity. Most existing works learn graph representation in a single constant curvature space that is insufficient to match the complex…

Machine Learning · Computer Science 2024-12-17 Zihao Guo , Qingyun Sun , Haonan Yuan , Xingcheng Fu , Min Zhou , Yisen Gao , Jianxin Li

Graph generative models become increasingly effective for data distribution approximation and data augmentation. While they have aroused public concerns about their malicious misuses or misinformation broadcasts, just as what Deepfake…

Cryptography and Security · Computer Science 2023-06-14 Yihan Ma , Zhikun Zhang , Ning Yu , Xinlei He , Michael Backes , Yun Shen , Yang Zhang

As the availability of financial services online continues to grow, the incidence of fraud has surged correspondingly. Fraudsters continually seek new and innovative ways to circumvent the detection algorithms in place. Traditionally, fraud…

Machine Learning · Computer Science 2024-11-25 Prashank Kadam