English
Related papers

Related papers: Hierarchical Multi-Modal Threat Intelligence Fusio…

200 papers

As AI evolves, collaboration among heterogeneous models helps overcome data scarcity by enabling knowledge transfer across institutions and devices. Traditional Federated Learning (FL) only supports homogeneous models, limiting…

Machine Learning · Computer Science 2025-06-05 Jianqing Zhang , Xinghao Wu , Yanbing Zhou , Xiaoting Sun , Qiqi Cai , Yang Liu , Yang Hua , Zhenzhe Zheng , Jian Cao , Qiang Yang

Robust multimodal visual analytics remains challenging when heterogeneous modalities provide complementary but input-dependent evidence for decision-making.Existing multimodal learning methods mainly rely on fixed fusion modules or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tianyi Liu , Yiming Li , Wenqian Wang , Jiaojiao Wang , Chen Cai , Yi Wang , Kim-Hui Yap

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement. Meanwhile, federated learning (FL) addresses the data sharing problem, enabling privacy-preserved…

Machine Learning · Computer Science 2023-03-29 Rongyu Zhang , Xiaowei Chi , Guiliang Liu , Wenyi Zhang , Yuan Du , Fangxin Wang

Multimodal sentiment analysis (MSA) integrates various modalities, such as text, image, and audio, to provide a more comprehensive understanding of sentiment. However, effective MSA is challenged by alignment and fusion issues. Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yuhua Wen , Qifei Li , Yingying Zhou , Yingming Gao , Zhengqi Wen , Jianhua Tao , Ya Li

Federated learning (FL) is a promising paradigm that enables collaboratively learning a shared model across massive clients while keeping the training data locally. However, for many existing FL systems, clients need to frequently exchange…

Networking and Internet Architecture · Computer Science 2023-01-18 Qiong Wu , Xu Chen , Tao Ouyang , Zhi Zhou , Xiaoxi Zhang , Shusen Yang , Junshan Zhang

As machine learning (ML) systems expand in both scale and functionality, the security landscape has become increasingly complex, with a proliferation of attacks and defenses. However, existing studies largely treat these threats in…

Cryptography and Security · Computer Science 2026-03-27 Zhenyi Wang , Siyu Luan

The availability of handy multi-modal (i.e., RGB-D) sensors has brought about a surge of face anti-spoofing research. However, the current multi-modal face presentation attack detection (PAD) has two defects: (1) The framework based on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Ajian Liu , Zichang Tan , Zitong Yu , Chenxu Zhao , Jun Wan , Yanyan Liang , Zhen Lei , Du Zhang , Stan Z. Li , Guodong Guo

Weakly supervised violence detection refers to the technique of training models to identify violent segments in videos using only video-level labels. Among these approaches, multimodal violence detection, which integrates modalities such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenping Jin , Li Zhu , Jing Sun

Reinforcement Learning (RL) is increasingly used in autonomous driving (AD) and shows clear advantages. However, most RL-based AD methods overlook policy structure design. An RL policy that only outputs short-timescale vehicle control…

Robotics · Computer Science 2025-11-25 Guizhe Jin , Zhuoren Li , Bo Leng , Ran Yu , Lu Xiong , Chen Sun

Federated Learning (FL) has gained increasing interest in recent years as a distributed on-device learning paradigm. However, multiple challenges remain to be addressed for deploying FL in real-world Internet-of-Things (IoT) networks with…

Machine Learning · Computer Science 2023-04-12 Xiaofan Yu , Ludmila Cherkasova , Harsh Vardhan , Quanling Zhao , Emily Ekaireb , Xiyuan Zhang , Arya Mazumdar , Tajana Rosing

The rapid growth of AI-enabled Internet of Vehicles (IoV) calls for efficient Machine Learning (ML) solutions that can handle high vehicular mobility and decentralized data. This has motivated the emergence of Hierarchical Federated…

Machine Learning · Computer Science 2026-05-28 Xiaohong Yang , Minghui Liwang , Xianbin Wang , Zhipeng Cheng , Seyyedali Hosseinalipour , Huaiyu Dai , Zhenzhen Jiao

For visual tracking, most of the traditional correlation filters (CF) based methods suffer from the bottleneck of feature redundancy and lack of motion information. In this paper, we design a novel tracking framework, called…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Shuai Bai , Zhiqun He , Ting-Bing Xu , Zheng Zhu , Yuan Dong , Hongliang Bai

The development of the sixth generation (6G) of wireless networks is bound to streamline the transition of computation and learning towards the edge of the network. Hierarchical federated learning (HFL) becomes, therefore, a key paradigm to…

Information Theory · Computer Science 2024-07-11 Ruslan Zhagypar , Nour Kouzayha , Hesham ElSawy , Hayssam Dahrouj , Tareq Y. Al-Naffouri

In the last years, Federated learning (FL) has become a popular solution to train machine learning models in domains with high privacy concerns. However, FL scalability and performance face significant challenges in real-world deployments…

Machine Learning · Computer Science 2026-03-11 Davide Domini , Gianluca Aguzzi , Lukas Esterle , Mirko Viroli

Multimodal Sentiment Analysis (MSA) is critical for human-computer interaction but faces challenges when the modalities are incomplete or missing. Existing methods often assume pre-defined missing modalities or fixed missing rates, limiting…

Human-Computer Interaction · Computer Science 2025-11-24 Liling Li , Guoyang Xu , Xiongri Shen , Zhifei Xu , Yanbo Zhang , Zhiguo Zhang , Zhenxi Song

Combined visual and force feedback play an essential role in contact-rich robotic manipulation tasks. Current methods focus on developing the feedback control around a single modality while underrating the synergy of the sensors. Fusing…

Robotics · Computer Science 2022-02-18 Piaopiao Jin , Yinjie Lin , Yanchao Tan , Tiefeng Li , Wei Yang

Videos contain multi-modal content, and exploring multi-level cross-modal interactions with natural language queries can provide great prominence to text-video retrieval task (TVR). However, new trending methods applying large-scale…

Multimedia · Computer Science 2022-08-23 Shuo Liu , Weize Quan , Ming Zhou , Sihong Chen , Jian Kang , Zhe Zhao , Chen Chen , Dong-Ming Yan

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to…

Computation and Language · Computer Science 2024-07-24 Yani Huang , Xuefeng Zhang , Richong Zhang , Junfan Chen , Jaein Kim

Effectively describing features for cross-modal remote sensing image matching remains a challenging task due to the significant geometric and radiometric differences between multimodal images. Existing methods primarily extract features at…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Abu Sadat Mohammad Salehin Amit , Xiaoli Zhang , Md Masum Billa Shagar , Zhaojun Liu , Xiongfei Li , Fanlong Meng

Multimodal AI has demonstrated superior performance over unimodal approaches by leveraging diverse data sources for more comprehensive analysis. However, applying this effectiveness in healthcare is challenging due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Pranav Poudel , Prashant Shrestha , Sanskar Amgain , Yash Raj Shrestha , Prashnna Gyawali , Binod Bhattarai