English
Related papers

Related papers: Transformer-Driven Triple Fusion Framework for Enh…

200 papers

Multimodal intent recognition (MIR) seeks to accurately interpret user intentions by integrating verbal and non-verbal information across video, audio and text modalities. While existing approaches prioritize text analysis, they often…

Multimedia · Computer Science 2025-06-13 Weiyin Gong , Kai Zhang , Yanghai Zhang , Qi Liu , Xinjie Sun , Junyu Lu , Linbo Zhu

Although not all bots are malicious, the vast majority of them are responsible for spreading misinformation and manipulating the public opinion about several issues, i.e., elections and many more. Therefore, the early detection of bots is…

Computation and Language · Computer Science 2024-07-31 Loukas Ilias , Ioannis Michail Kazelidis , Dimitris Askounis

Offensive Language detection in social media platforms has been an active field of research over the past years. In non-native English spoken countries, social media users mostly use a code-mixed form of text in their posts/comments. This…

Computation and Language · Computer Science 2022-12-13 Charangan Vasantharajan , Uthayasanker Thayasivam

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of different modalities is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Junyu Lu , Dixiang Zhang , Pingjian Zhang

In an era where the silent struggle of underdiagnosed depression pervades globally, our research delves into the crucial link between mental health and social media. This work focuses on early detection of depression, particularly in…

Image description generation is essential for accessibility and AI understanding of visual content. Recent advancements in deep learning have significantly improved natural language processing and computer vision. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Lakshita Agarwal , Bindu Verma

In recent years, YouTube has become the leading platform for Bangla movies and dramas, where viewers express their opinions in comments that convey their sentiments about the content. However, not all comments are relevant for sentiment…

Computation and Language · Computer Science 2024-12-03 Usafa Akther Rifa , Pronay Debnath , Busra Kamal Rafa , Shamaun Safa Hridi , Md. Aminur Rahman

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Due to massive adoption of social media, detection of users' depression through social media analytics bears significant importance, particularly for underrepresented languages, such as Bangla. This study introduces a well-grounded approach…

Computation and Language · Computer Science 2024-07-15 Saad Ahmed Sazan , Mahdi H. Miraz , A B M Muntasir Rahman

With the bloom of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) that incorporate LLMs with pre-trained vision models have recently demonstrated impressive performance across diverse vision-language tasks. However,…

Computation and Language · Computer Science 2026-01-13 Ziyue Wang , Chi Chen , Yiqi Zhu , Fuwen Luo , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Maosong Sun , Yang Liu

This project performs multimodal sentiment analysis using the CMU-MOSEI dataset, using transformer-based models with early fusion to integrate text, audio, and visual modalities. We employ BERT-based encoders for each modality, extracting…

Computation and Language · Computer Science 2025-07-16 Jugal Gajjar , Kaustik Ranaware

Recognition of handwritten Bangla compound characters remains a challenging problem due to complex character structures, large intra-class variation, and limited availability of high-quality annotated data. Existing Bangla handwritten…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Md. Sultan Al Rayhan

In our increasingly interconnected digital world, social media platforms have emerged as powerful channels for the dissemination of hate speech and offensive content. This work delves into the domain of hate speech detection, placing…

Computation and Language · Computer Science 2023-10-04 Ananya Joshi , Raviraj Joshi

As computers have become efficient at understanding visual information and transforming it into a written representation, research interest in tasks like automatic image captioning has seen a significant leap over the last few years. While…

Computation and Language · Computer Science 2022-05-31 Mohammad Faiyaz Khan , S. M. Sadiq-Ur-Rahman Shifath , Md Saiful Islam

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin

Although research on emotion classification has significantly progressed in high-resource languages, it is still infancy for resource-constrained languages like Bengali. However, unavailability of necessary language processing tools and…

Computation and Language · Computer Science 2021-04-20 Avishek Das , Omar Sharif , Mohammed Moshiul Hoque , Iqbal H. Sarker

In our daily lives, newspapers are an essential information source that impacts how the public talks about present-day issues. However, effectively navigating the vast amount of news content from different newspapers and online news portals…

This paper describes our approach to submissions made at Shared Task 2 at BLP Workshop - Sentiment Analysis of Bangla Social Media Posts. Sentiment Analysis is an action research area in the digital age. With the rapid and constant growth…

Computation and Language · Computer Science 2023-10-24 Pratinav Seth , Rashi Goel , Komal Mathur , Swetha Vemulapalli

The spread of cyber hatred has led to communal violence, fueling aggression and conflicts between various religious, ethnic, and social groups, posing a significant threat to social harmony. Despite its critical importance, the…

Computation and Language · Computer Science 2025-06-25 Abdullah Khondoker , Enam Ahmed Taufik , Md. Iftekhar Islam Tashik , S M Ishtiak Mahmud , Farig Sadeque

This study introduces a novel multimodal food recognition framework that effectively combines visual and textual modalities to enhance classification accuracy and robustness. The proposed approach employs a dynamic multimodal fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Prateek Mittal , Puneet Goyal , Joohi Chauhan