English
Related papers

Related papers: MEG: Multi-Evidence GNN for Multimodal Semantic Fo…

200 papers

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song

Recently published graph neural networks (GNNs) show promising performance at social event detection tasks. However, most studies are oriented toward monolingual data in languages with abundant training samples. This has left the more…

Machine Learning · Computer Science 2023-04-03 Jiaqian Ren , Hao Peng , Lei Jiang , Jia Wu , Yongxin Tong , Lihong Wang , Xu Bai , Bo Wang , Qiang Yang

Misinformation undermines individual knowledge and affects broader societal narratives. Despite growing interest in the research community in multi-modal misinformation detection, existing methods exhibit limitations in capturing semantic…

Computation and Language · Computer Science 2024-10-22 Swarang Joshi , Siddharth Mavani , Joel Alex , Arnav Negi , Rahul Mishra , Ponnurangam Kumaraguru

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

The rapid proliferation of fake news on social media threatens social stability, creating an urgent demand for more effective detection methods. While many promising approaches have emerged, most rely on content analysis with limited…

Computation and Language · Computer Science 2025-02-10 Junwei Yin , Min Gao , Kai Shu , Wentao Li , Yinqiu Huang , Zongwei Wang

Traditional Graph Neural Network (GNN) approaches for fake news detection (FND) often depend on auxiliary, non-textual data such as user interaction histories or content dissemination patterns. However, these data sources are not always…

Machine Learning · Computer Science 2025-02-27 Anantram Patel , Vijay Kumar Sutrakar

Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains challenging as it is difficult to learn the association between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Wentian Zhao , Yao Hu , Heda Wang , Xinxiao Wu , Jiebo Luo

The amount of news being consumed online has substantially expanded in recent years. Fake news has become increasingly common, especially in regional languages like Malayalam, due to the rapid publication and lack of editorial standards on…

Computation and Language · Computer Science 2023-10-30 Adhish S. Sujan , Ajitha. V , Aleena Benny , Amiya M. P. , V. S. Anoop

Malware detection in modern computing environments demands models that are not only accurate but also interpretable and robust to evasive techniques. Graph neural networks (GNNs) have shown promise in this domain by modeling rich structural…

Cryptography and Security · Computer Science 2026-05-26 Hossein Shokouhinejad , Roozbeh Razavi-Far , Griffin Higgins , Ali A Ghorbani

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story, where the images should be realistic and keep global consistency across dynamic scenes and characters. Current works face the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Bowen Li , Thomas Lukasiewicz

Large Language Models (LLMs) can assist multimodal fake news detection by predicting pseudo labels. However, LLM-generated pseudo labels alone demonstrate poor performance compared to traditional detection methods, making their effective…

Computation and Language · Computer Science 2025-06-03 Shuguo Hu , Jun Hu , Huaiwen Zhang

The graph-based model can help to detect suspicious fraud online. Owing to the development of Graph Neural Networks~(GNNs), prior research work has proposed many GNN-based fraud detection frameworks based on either homogeneous graphs or…

Social and Information Networks · Computer Science 2020-07-03 Zhiwei Liu , Yingtong Dou , Philip S. Yu , Yutong Deng , Hao Peng

Heterogeneous graph neural networks (HeteGNNs) have demonstrated strong abilities to learn node representations by effectively extracting complex structural and semantic information in heterogeneous graphs. Most of the prevailing HeteGNNs…

Machine Learning · Computer Science 2025-05-08 Hong Jin , Kaicheng Zhou , Jie Yin , Lan You , Zhifeng Zhou

With the current shift in the mass media landscape from journalistic rigor to social media, personalized social media is becoming the new norm. Although the digitalization progress of the media brings many advantages, it also increases the…

Computation and Language · Computer Science 2023-04-18 Ciprian-Octavian Truică , Elena-Simona Apostol

Graph Neural Networks (GNNs) have achieved state-of-the-art results for semi-supervised node classification on graphs. Nevertheless, the challenge of how to effectively learn GNNs with very few labels is still under-explored. As one of the…

Machine Learning · Computer Science 2022-01-21 Yayong Li , Jie Yin , Ling Chen

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

This paper proposes a new method called Multimodal RNNs for RGB-D scene semantic segmentation. It is optimized to classify image pixels given two input sources: RGB color channels and Depth maps. It simultaneously performs training of two…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Abrar H. Abdulnabi , Bing Shuai , Zhen Zuo , Lap-Pui Chau , Gang Wang

To enhance research on multimodal knowledge base and multimodal information processing, we propose a new task called multimodal entity tagging (MET) with a multimodal knowledge base (MKB). We also develop a dataset for the problem using an…

Information Retrieval · Computer Science 2022-07-29 Hao Peng , Hang Li , Lei Hou , Juanzi Li , Chao Qiao

Higher-order features bring significant accuracy gains in semantic dependency parsing. However, modeling higher-order features with exact inference is NP-hard. Graph neural networks (GNNs) have been demonstrated to be an effective tool for…

Computation and Language · Computer Science 2022-01-28 Bin Li , Yunlong Fan , Yikemaiti Sataer , Zhiqiang Gao

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu