English
Related papers

Related papers: Bench-Marking And Improving Arabic Automatic Image…

200 papers

This paper discusses and demonstrates the outcomes from our experimentation on Image Captioning. Image captioning is a much more involved task than image recognition or classification, because of the additional challenge of recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Vikram Mullachery , Vishal Motwani

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Automatically captioning images with natural language sentences is an important research topic. State of the art models are able to produce human-like sentences. These models typically describe the depicted scene as a whole and do not…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Philipp Harzig , Stephan Brehm , Rainer Lienhart , Carolin Kaiser , René Schallner

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Carlos Rebelo , Gil Rocha , João Daniel Silva , Bruno Martins

Video captioning, the task of describing the content of a video, has seen some promising improvements in recent years with sequence-to-sequence models, but accurately learning the temporal and logical dynamics involved in the task still…

Computation and Language · Computer Science 2017-08-09 Ramakanth Pasunuru , Mohit Bansal

We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models. Constructing a large-scale labeled image captioning dataset is an expensive task in terms of labor, time, and cost. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Dong-Jin Kim , Tae-Hyun Oh , Jinsoo Choi , In So Kweon

Audio captioning is a multi-modal task, focusing on using natural language for describing the contents of general audio. Most audio captioning methods are based on deep neural networks, employing an encoder-decoder scheme and a dataset with…

Sound · Computer Science 2020-07-10 Emre Çakır , Konstantinos Drossos , Tuomas Virtanen

This study aims at investigating the effect of applying single learner machine learning approach and ensemble machine learning approach for offensive language detection on Arabic language. Classifying Arabic social media text is a very…

Computation and Language · Computer Science 2020-05-20 Fatemah Husain

Image captioning is a multimodal task involving computer vision and natural language processing, where the goal is to learn a mapping from the image to its natural language description. In general, the mapping function is learned from a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jiuxiang Gu , Shafiq Joty , Jianfei Cai , Gang Wang

Visual attention has shown usefulness in image captioning, with the goal of enabling a caption model to selectively focus on regions of interest. Existing models typically rely on top-down language information and learn attention implicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Shi Chen , Qi Zhao

We introduce a new multi-modal task for computer systems, posed as a combined vision-language comprehension challenge: identifying the most suitable text describing a scene, given several similar options. Accomplishing the task entails…

Computation and Language · Computer Science 2016-12-26 Nan Ding , Sebastian Goodman , Fei Sha , Radu Soricut

Generating a description of an image is called image captioning. Image captioning requires to recognize the important objects, their attributes and their relationships in an image. It also needs to generate syntactically and semantically…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Md. Zakir Hossain , Ferdous Sohel , Mohd Fairuz Shiratuddin , Hamid Laga

Lipreading involves using visual data to recognize spoken words by analyzing the movements of the lips and surrounding area. It is a hot research topic with many potential applications, such as human-machine interaction and enhancing audio…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Samar Daou , Achraf Ben-Hamadou , Ahmed Rekik , Abdelaziz Kallel

Neural Networks and Deep Learning have seen an upsurge of research in the past decade due to the improved results. Generates text from the given image is a crucial task that requires the combination of both sectors which are computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Abrar Hasin Kamal , Md. Asifuzzaman Jishan , Nafees Mansoor

Connecting Vision and Language plays an essential role in Generative Intelligence. For this reason, large research efforts have been devoted to image captioning, i.e. describing images with syntactically and semantically meaningful…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Matteo Stefanini , Marcella Cornia , Lorenzo Baraldi , Silvia Cascianelli , Giuseppe Fiameni , Rita Cucchiara

Large Language Models (LLMs) have demonstrated significant promise for various applications in healthcare. However, their efficacy in the Arabic medical domain remains unexplored due to the lack of high-quality domain-specific datasets and…

Computation and Language · Computer Science 2025-08-25 Mouath Abu Daoud , Chaimae Abouzahir , Leen Kharouf , Walid Al-Eisawi , Nizar Habash , Farah E. Shamout

The rapid growth of the internet has increased the number of online texts. This led to the rapid growth of the number of online texts in the Arabic language. The enormous amount of text must be organized into classes to make the analysis…

Information Retrieval · Computer Science 2022-11-08 Sumaia Mohammed AL-Ghuribi , Shahrul Azman Mohd Noah

In multi-label emotion classification, particularly for low-resource languages like Arabic, the challenges of class imbalance and label correlation hinder model performance, especially in accurately predicting minority emotions. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Muhammad Azeem Aslam , Wang Jun , Nisar Ahmed , Muhammad Imran Zaman , Li Yanan , Hu Hongfei , Wang Shiyu , Xin Liu

Humans have an incredible ability to process and understand information from multiple sources such as images, video, text, and speech. Recent success of deep neural networks has enabled us to develop algorithms which give machines the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Dheeraj Peri , Shagan Sah , Raymond Ptucha

This work is an attempt to introduce a comprehensive benchmark for Arabic speech recognition, specifically tailored to address the challenges of telephone conversations in Arabic language. Arabic, characterized by its rich dialectal…

Artificial Intelligence · Computer Science 2024-05-31 Qusai Abo Obaidah , Muhy Eddin Za'ter , Adnan Jaljuli , Ali Mahboub , Asma Hakouz , Bashar Al-Rfooh , Yazan Estaitia