English
Related papers

Related papers: Arabic Multimodal Machine Learning: Datasets, Appl…

200 papers

Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to extract aspect terms and their corresponding sentiment polarities from multimodal information, including text and images. While traditional supervised learning methods have shown…

Computation and Language · Computer Science 2024-11-26 Shezheng Song

Machine learning (ML) methods have been developing rapidly, but configuring and selecting proper methods to achieve a desired performance is increasingly difficult and tedious. To address this challenge, automated machine learning (AutoML)…

Artificial Intelligence · Computer Science 2024-02-28 Zhenqian Shen , Yongqi Zhang , Lanning Wei , Huan Zhao , Quanming Yao

Multimodal machine translation involves drawing information from more than one modality, based on the assumption that the additional modalities will contain useful alternative views of the input data. The most prominent tasks in this area…

Computation and Language · Computer Science 2019-12-02 Umut Sulubacak , Ozan Caglayan , Stig-Arne Grönroos , Aku Rouhe , Desmond Elliott , Lucia Specia , Jörg Tiedemann

The rapid progress of Multimodal Large Language Models(MLLMs) has transformed the AI landscape. These models combine pre-trained LLMs with various modality encoders. This integration requires a systematic understanding of how different…

Computation and Language · Computer Science 2025-06-06 Jisu An , Junseok Lee , Jeoungeun Lee , Yongseok Son

Multimodal Entity Linking (MEL) is a crucial task that aims at linking ambiguous mentions within multimodal contexts to the referent entities in a multimodal knowledge base, such as Wikipedia. Existing methods focus heavily on using complex…

Artificial Intelligence · Computer Science 2024-08-22 Liu Qi , He Yongyi , Lian Defu , Zheng Zhi , Xu Tong , Liu Che , Chen Enhong

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

In the rapidly evolving landscape of artificial intelligence, multimodal learning systems (MMLS) have gained traction for their ability to process and integrate information from diverse modality inputs. Their expanding use in vital sectors…

Computers and Society · Computer Science 2024-07-17 Tianyi Zhao , Liangliang Zhang , Yao Ma , Lu Cheng

Sentiment Analysis, a popular subtask of Natural Language Processing, employs computational methods to extract sentiment, opinions, and other subjective aspects from linguistic data. Given its crucial role in understanding human sentiment,…

Computation and Language · Computer Science 2025-02-07 Zhiqiang Shi , Ruchit Agrawal

The performance of large language models (LLMs) and large multimodal models (LMMs) depends heavily on the quality and scale of their pre-training datasets. Recent research shows that large multimodal models trained on natural documents…

Computation and Language · Computer Science 2025-11-11 Khalil Hennara , Ahmad Bastati , Muhammad Hreden , Mohamed Motasim Hamed , Zeina Aldallal , Sara Chrouf , Safwan AlModhayan

Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual information, coarse…

Computation and Language · Computer Science 2025-08-25 Fang Wang , Tianwei Yan , Zonghao Yang , Minghao Hu , Jun Zhang , Zhunchen Luo , Xiaoying Bai

In this paper, we introduce the MLM (Multiple Languages and Modalities) dataset - a new resource to train and evaluate multitask systems on samples in multiple modalities and three languages. The generation process and inclusion of semantic…

Machine Learning · Computer Science 2020-10-27 Jason Armitage , Endri Kacupaj , Golsa Tahmasebzadeh , Swati , Maria Maleshkova , Ralph Ewerth , Jens Lehmann

To tackle complex tasks in real-world scenarios, more researchers are focusing on Omni-MLLMs, which aim to achieve omni-modal understanding and generation. Beyond the constraints of any specific non-linguistic modality, Omni-MLLMs map…

Artificial Intelligence · Computer Science 2025-03-05 Shixin Jiang , Jiafeng Liang , Jiyuan Wang , Xuan Dong , Heng Chang , Weijiang Yu , Jinhua Du , Ming Liu , Bing Qin

MLLMs have recently become a focal point in the field of artificial intelligence research. Building on the strong capabilities of LLMs, MLLMs are adept at addressing complex multi-modal tasks. With the release of GPT-4, MLLMs have gained…

Machine Learning · Computer Science 2025-05-01 Jiarui Ye , Hao Tang

Amid the swift progress of large language models (LLMs) and their evolution into large multimodal models (LMMs), significant strides have been made in high-resource languages such as English and Chinese. While Arabic LLMs have seen notable…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ahmed Heakl , Sara Ghaboura , Omkar Thawkar , Fahad Shahbaz Khan , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan

Multimodal music emotion recognition (MMER) is an emerging discipline in music information retrieval that has experienced a surge in interest in recent years. This survey provides a comprehensive overview of the current state-of-the-art in…

Multimedia · Computer Science 2025-04-29 Rashini Liyanarachchi , Aditya Joshi , Erik Meijering

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilities such as generating image captions and answering…

Computation and Language · Computer Science 2025-01-09 Shezheng Song , Xiaopeng Li , Shasha Li , Shan Zhao , Jie Yu , Jun Ma , Xiaoguang Mao , Weimin Zhang

Arabic morphological analysis is one of the essential stages in Arabic Natural Language Processing. In this paper we present an approach for Arabic morphological analysis. This approach is based on Arabic morphological automaton (AMAUT).…

Computation and Language · Computer Science 2011-01-31 Mourad Gridach , Noureddine Chenfour