English
Related papers

Related papers: Effects of Stop Words Elimination for Arabic Infor…

200 papers

Large Language Models (LLMs) often struggle with hallucinations and outdated information. To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge. However, existing IR techniques contain…

Computation and Language · Computer Science 2024-11-26 Danupat Khamnuansin , Tawunrat Chalothorn , Ekapol Chuangsuwanich

The main objective of this paper is to compare and evaluate the performances of three open Arabic NER tools: CAMeL, Hatmi, and Stanza. We collected a corpus consisting of 30 articles written in MSA and manually annotated all the entities of…

Computation and Language · Computer Science 2022-05-13 Abdullah Aldumaykhi , Saad Otai , Abdulkareem Alsudais

Hate speech identification in social media has become an increasingly important issue in recent years. In this research, we address two problems: 1) to detect hate speech in Arabic text, 2) to clean a given text from hate speech. The…

Computation and Language · Computer Science 2025-08-01 Salam Thabet Doghmash , Motaz Saad

Code-switching (CSW) text generation has been receiving increasing attention as a solution to address data scarcity. In light of this growing interest, we need more comprehensive studies comparing different augmentation approaches. In this…

Computation and Language · Computer Science 2023-10-25 Injy Hamed , Nizar Habash , Ngoc Thang Vu

A lot of natural language processing problems need to encode the text sequence as a fix-length vector, which usually involves aggregation process of combining the representations of all the words, such as pooling or self-attention. However,…

Computation and Language · Computer Science 2020-11-17 Jingjing Gong , Hang Yan , Yining Zheng , Xipeng Qiu , Xuanjing Huang

We present RLStop, a novel Technology Assisted Review (TAR) stopping rule based on reinforcement learning that helps minimise the number of documents that need to be manually reviewed within TAR applications. RLStop is trained on example…

Information Retrieval · Computer Science 2024-06-10 Reem Bin-Hezam , Mark Stevenson

Multilingual dense retrieval aims to retrieve relevant documents across different languages based on a unified retriever model. The challenge lies in aligning representations of different languages in a shared vector space. The common…

Information Retrieval · Computer Science 2025-09-12 Chao Huang , Fengran Mo , Yufeng Chen , Changhao Guan , Zhenrui Yue , Xinyu Wang , Jinan Xu , Kaiyu Huang

In NLP, text classification is one of the primary problems we try to solve and its uses in language analyses are indisputable. The lack of labeled training data made it harder to do these tasks in low resource languages like Amharic. The…

Computation and Language · Computer Science 2021-03-11 Israel Abebe Azime , Nebil Mohammed

Large Language Models (LLMs) have shown impressive zero-shot performance across a variety of Natural Language Processing tasks, including document re-ranking. However, their effectiveness degrades on unseen tasks and domains, largely due to…

Information Retrieval · Computer Science 2025-05-02 Marco Braga , Pranav Kasela , Alessandro Raganato , Gabriella Pasi

Grammatical Error Correction (GEC) is an important aspect of natural language processing. Arabic has a complicated morphological and syntactic structure, posing a greater challenge than other languages. Even though modern neural models have…

Computation and Language · Computer Science 2025-11-19 Ahlam Alrehili , Areej Alhothali

Example weighting algorithm is an effective solution to the training bias problem, however, most previous typical methods are usually limited to human knowledge and require laborious tuning of hyperparameters. In this paper, we propose a…

Machine Learning · Computer Science 2019-11-27 Zhenmao Li , Yichao Wu , Ken Chen , Yudong Wu , Shunfeng Zhou , Jiaheng Liu , Junjie Yan

Text embedding models play a crucial role in natural language processing, particularly in information retrieval, and their importance is further highlighted with the recent utilization of RAG (Retrieval- Augmented Generation). This study…

Information Retrieval · Computer Science 2024-12-24 Jeongsu Yu

Retrieve-and-rerank is a popular retrieval pipeline because of its ability to make slow but effective rerankers efficient enough at query time by reducing the number of comparisons. Recent works in neural rerankers take advantage of large…

Information Retrieval · Computer Science 2025-05-21 Eugene Yang , Andrew Yates , Kathryn Ricci , Orion Weller , Vivek Chari , Benjamin Van Durme , Dawn Lawrie

The continuous information explosion through the Internet and all information sources makes it necessary to perform all information processing activities automatically in quick and reliable manners. In this paper, we proposed and…

Information Retrieval · Computer Science 2012-05-09 Abdulrahman Al Molijy , Ismail Hmeidi , Izzat Alsmadi

This paper explores the use of a learned classifier for post-OCR text correction. Experiments with the Arabic language show that this approach, which integrates a weighted confusion matrix and a shallow language model, improves the vast…

Information Retrieval · Computer Science 2020-06-11 Ido Kissos , Nachum Dershowitz

Stopwords are commonly used words in a language that are often considered to be of little value in determining the meaning or significance of a document. These words occur frequently in most texts and don't provide much useful information…

Computation and Language · Computer Science 2024-06-18 Rohan Chavan , Gaurav Patil , Vishal Madle , Raviraj Joshi

In the stance detection task, a text is classified as either favorable, opposing, or neutral towards a target. Prior work suggests that the use of external information, e.g., excerpts from Wikipedia, improves stance detection performance.…

Computation and Language · Computer Science 2025-07-03 Quang Minh Nguyen , Taegyoon Kim

The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression. While these contents can be humorous and informative, they are also increasingly being…

Computation and Language · Computer Science 2025-08-25 Nouar AlDahoul , Yasir Zaki

The strong capabilities of recent Large Language Models (LLMs) have made them highly effective for zero-shot re-ranking task. Attention-based re-ranking methods, which derive relevance scores directly from attention weights, offer an…

Computation and Language · Computer Science 2026-02-24 Yuxing Tian , Fengran Mo , Weixu Zhang , Yiyan Qi , Jian-Yun Nie

Local explanation methods highlight the input tokens that have a considerable impact on the outcome of classifying the document at hand. For example, the Anchor algorithm applies a statistical analysis of the sensitivity of the classifier…

Machine Learning · Computer Science 2024-01-15 Alon Mor , Yonatan Belinkov , Benny Kimelfeld