English
Related papers

Related papers: MM-Soc: Benchmarking Multimodal Large Language Mod…

200 papers

Multimodal signals, including text, audio, image, and video, can be integrated into Semantic Communication (SC) systems to provide an immersive experience with low latency and high quality at the semantic level. However, the multimodal SC…

Artificial Intelligence · Computer Science 2024-08-06 Feibo Jiang , Li Dong , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Multimodal Misinformation Recognition has become an urgent task with the emergence of huge multimodal fake content on social media platforms. Previous studies mainly focus on complex feature extraction and fusion to learn discriminative…

Multimedia · Computer Science 2025-10-15 Hengyang Zhou , Yiwei Wei , Jian Yang , Zhenyu Zhang

Recent advancements in reasoning-reinforced Large Language Models (LLMs) have shown remarkable capabilities in complex reasoning tasks. However, the mechanism underlying their utilization of different human reasoning skills remains poorly…

Computation and Language · Computer Science 2025-08-15 Nghia Trung Ngo , Franck Dernoncourt , Thien Huu Nguyen

Multi-Object Tracking (MOT) is evolving from geometric localization to Semantic MOT (SMOT) to answer complex relational queries, yet progress is hindered by semantic data scarcity and a structural disconnect between tracking architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Yuhua Zhu , Wenhui Zhao , Dingwen Zhang

Online social media platforms are central to everyday communication and information seeking. While these platforms serve positive purposes, they also provide fertile ground for the spread of hate speech, offensive language, and bullying…

Computation and Language · Computer Science 2025-10-03 Md Arid Hasan , Firoj Alam , Md Fahad Hossain , Usman Naseem , Syed Ishtiaque Ahmed

The widespread use of microblogging platforms like X (formerly Twitter) during disasters provides real-time information to governments and response authorities. However, the data from these platforms is often noisy, requiring automated…

Computation and Language · Computer Science 2024-12-17 Muhammad Imran , Abdul Wahab Ziaullah , Kai Chen , Ferda Ofli

As large language models (LLMs) develop anthropomorphic abilities, they are increasingly being deployed as autonomous agents to interact with humans. However, evaluating their performance in realistic and complex social interactions remains…

Computation and Language · Computer Science 2025-10-28 Shuai Huang , Wenxuan Zhao , Jun Gao

The dynamic nature of language, particularly evident in the realm of slang and memes on the Internet, poses serious challenges to the adaptability of large language models (LLMs). Traditionally anchored to static datasets, these models…

Computation and Language · Computer Science 2025-02-04 Lingrui Mei , Shenghua Liu , Yiwei Wang , Baolong Bi , Xueqi Cheng

Recent research has offered insights into the extraordinary capabilities of Large Multimodal Models (LMMs) in various general vision and language tasks. There is growing interest in how LMMs perform in more specialized domains. Social media…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Hanjia Lyu , Jinfa Huang , Daoan Zhang , Yongsheng Yu , Xinyi Mou , Jinsheng Pan , Zhengyuan Yang , Zhongyu Wei , Jiebo Luo

Multimodal Sarcasm Understanding (MSU) has a wide range of applications in the news field such as public opinion analysis and forgery detection. However, existing MSU benchmarks and approaches usually focus on sentence-level MSU. In…

Computation and Language · Computer Science 2023-12-27 Hang Du , Guoshun Nan , Sicheng Zhang , Binzhu Xie , Junrui Xu , Hehe Fan , Qimei Cui , Xiaofeng Tao , Xudong Jiang

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tao Yu , Yi-Fan Zhang , Chaoyou Fu , Junkang Wu , Jinda Lu , Kun Wang , Xingyu Lu , Yunhang Shen , Guibin Zhang , Dingjie Song , Yibo Yan , Tianlong Xu , Qingsong Wen , Zhang Zhang , Yan Huang , Liang Wang , Tieniu Tan

The comprehension of text-rich visual scenes has become a focal point for evaluating Multi-modal Large Language Models (MLLMs) due to their widespread applications. Current benchmarks tailored to the scenario emphasize perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Bin Shan , Xiang Fei , Wei Shi , An-Lan Wang , Guozhi Tang , Lei Liao , Jingqun Tang , Xiang Bai , Can Huang

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

Large language models (LLMs) show strong potential for simulating human social behaviors and interactions, yet lack large-scale, systematically constructed benchmarks for evaluating their alignment with real-world social attitudes. To…

Social and Information Networks · Computer Science 2025-10-14 Jia Wang , Ziyu Zhao , Tingjuntao Ni , Zhongyu Wei

Predicting group behavior, how individuals coordinate, communicate, and interact during collaborative tasks, is essential for designing systems that can support team performance through real-time prediction and realistic simulation of…

Human-Computer Interaction · Computer Science 2026-04-13 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Social media's global reach amplifies the spread of information, highlighting the need for robust Natural Language Processing tasks like stance detection across languages and modalities. Prior research predominantly focuses on text-only…

Computation and Language · Computer Science 2025-01-30 Jake Vasilakes , Carolina Scarton , Zhixue Zhao

Short video platforms are evolving rapidly, making the identification of inappropriate content increasingly critical. Existing approaches typically train separate and small classification models for each type of issue, which requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zixuan Wang , Yu Sun , Hongwei Wang , Baoyu Jing , Xiang Shen , Xin Dong , Zhuolin Hao , Hongyu Xiong , Yang Song

The emergence of multimodal large language models (MLLMs) has triggered extensive research in model evaluation. While existing evaluation studies primarily focus on unimodal (vision-only) comprehension and reasoning capabilities, they…

Multimedia · Computer Science 2025-04-24 Xiaocui Yang , Wenfang Wu , Shi Feng , Ming Wang , Daling Wang , Yang Li , Qi Sun , Yifei Zhang , Xiaoming Fu , Soujanya Poria

Multi-modal Large Language Models (MLLMs) have exhibited impressive capability. However, recently many deficiencies of MLLMs have been found compared to human intelligence, $\textit{e.g.}$, hallucination. To drive the MLLMs study, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Hong Li , Nanxi Li , Yuanjie Chen , Jianbin Zhu , Qinlu Guo , Cewu Lu , Yong-Lu Li

The rapid advancements in the development of multimodal large language models (MLLMs) have consistently led to new breakthroughs on various benchmarks. In response, numerous challenging and comprehensive benchmarks have been proposed to…