English
Related papers

Related papers: Analysis of Social Media Data using Multimodal Dee…

200 papers

In times of crisis, the prompt and precise classification of disaster-related information shared on social media platforms is crucial for effective disaster response and public safety. During such critical events, individuals use social…

Computers and Society · Computer Science 2025-10-21 Shahid Shafi Dar , Mohammad Zia Ur Rehman , Karan Bais , Mohammed Abdul Haseeb , Nagendra Kumara

With Deep Learning Image Classification becoming more powerful each year, it is apparent that its introduction to disaster response will increase the efficiency that responders can work with. Using several Neural Network Models, including…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Jianyu Mao , Kiana Harris , Nae-Rong Chang , Caleb Pennell , Yiming Ren

Social media has emerged as a valuable resource for disaster management, revolutionizing the way emergency response and recovery efforts are conducted during natural disasters. This review paper aims to provide a comprehensive analysis of…

Social and Information Networks · Computer Science 2025-06-10 Mohammadsepehr Karimiziarani

Responding to natural disasters, such as earthquakes, floods, and wildfires, is a laborious task performed by on-the-ground emergency responders and analysts. Social media has emerged as a low-latency data source to quickly understand…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Ethan Weber , Nuria Marzo , Dim P. Papadopoulos , Aritro Biswas , Agata Lapedriza , Ferda Ofli , Muhammad Imran , Antonio Torralba

Social networks are widely used for information consumption and dissemination, especially during time-critical events such as natural disasters. Despite its significantly large volume, social media content is often too noisy for direct use…

Computation and Language · Computer Science 2021-04-09 Firoj Alam , Umair Qazi , Muhammad Imran , Ferda Ofli

After significant earthquakes, we can see images posted on social media platforms by individuals and media agencies owing to the mass usage of smartphones these days. These images can be utilized to provide information about the shaking…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Gaurav Chachra , Qingkai Kong , Jim Huang , Srujay Korlakunta , Jennifer Grannen , Alexander Robson , Richard Allen

As climate change intensifies, the urgency for accurate global-scale disaster predictions grows. This research presents a novel multimodal disaster prediction framework, combining weather statistics, satellite imagery, and textual insights.…

Machine Learning · Computer Science 2023-10-02 Gengyin Liu , Huaiyang Zhong

Social media has become an important tool to share information about crisis events such as natural disasters and mass attacks. Detecting actionable posts that contain useful information requires rapid analysis of huge volume of data in…

Computation and Language · Computer Science 2020-11-03 Evangelia Spiliopoulou , Salvador Medina Maza , Eduard Hovy , Alexander Hauptmann

The analysis of natural disaster-related multimedia content got great attention in recent years. Being one of the most important sources of information, social media have been crawled over the years to collect and analyze disaster-related…

Information Retrieval · Computer Science 2019-01-15 Naina Said , Kashif Ahmad , Michael Regular , Konstantin Pogorelov , Laiq Hassan , Nasir Ahmad , Nicola Conci

Lack of global data inventories obstructs scientific modeling of and response to landslide hazards which are oftentimes deadly and costly. To remedy this limitation, new approaches suggest solutions based on citizen science that requires…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Ferda Ofli , Muhammad Imran , Umair Qazi , Julien Roch , Catherine Pennington , Vanessa J. Banks , Remy Bossu

Self-Supervised learning from multimodal image and text data allows deep neural networks to learn powerful features with no need of human annotated data. Web and Social Media platforms provide a virtually unlimited amount of this multimodal…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Raul Gomez , Lluis Gomez , Jaume Gibert , Dimosthenis Karatzas

People increasingly use microblogging platforms such as Twitter during natural disasters and emergencies. Research studies have revealed the usefulness of the data available on Twitter for several disaster response tasks. However, making…

Social and Information Networks · Computer Science 2018-05-16 Firoj Alam , Ferda Ofli , Muhammad Imran , Michael Aupetit

Multiple modalities represent different aspects by which information is conveyed by a data source. Modern day social media platforms are one of the primary sources of multimodal data, where users use different modes of expression by posting…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Mayank Meghawat , Satyendra Yadav , Debanjan Mahata , Yifang Yin , Rajiv Ratn Shah , Roger Zimmermann

Over the last years, there has been an unprecedented proliferation of fake news. As a consequence, we are more susceptible to the pernicious impact that misinformation and disinformation spreading can have in different segments of our…

Computation and Language · Computer Science 2021-12-10 Santiago Alonso-Bartolome , Isabel Segura-Bedmar

This technical report provides extra details of the deep multimodal similarity model (DMSM) which was proposed in (Fang et al. 2015, arXiv:1411.4952). The model is trained via maximizing global semantic similarity between images and their…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Xiaodong He , Rupesh Srivastava , Jianfeng Gao , Li Deng

The focus of this survey is on the analysis of two modalities of multimodal deep learning: image and text. Unlike classic reviews of deep learning where monomodal image classifiers such as VGG, ResNet and Inception module are central…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Weiping Wang , Li Liu , Michael S. Lew

Fake news and misinformation are a matter of concern for people around the globe. Users of the internet and social media sites encounter content with false information much frequently. Fake news detection is one of the most analyzed and…

Computation and Language · Computer Science 2021-12-03 Chahat Raj , Priyanka Meel

Multimodal sentiment analysis has attracted increasing attention with broad application prospects. The existing methods focuses on single modality, which fails to capture the social media content for multiple modalities. Moreover, in…

Multimedia · Computer Science 2022-05-11 Ashima Yadav , Dinesh Kumar Vishwakarma

Rapid, fine-grained disaster damage assessment is essential for effective emergency response, yet remains challenging due to limited ground sensors and delays in official reporting. Social media provides a rich, real-time source of…

Computation and Language · Computer Science 2025-06-05 Zihui Ma , Lingyao Li , Juan Li , Wenyue Hua , Jingxiao Liu , Qingyuan Feng , Yuki Miura

Social media has enabled people to circulate information in a timely fashion, thus motivating people to post messages seeking help during crisis situations. These messages can contribute to the situational awareness of emergency responders,…

Computation and Language · Computer Science 2021-10-18 Congcong Wang , Paul Nulty , David Lillis