English
Related papers

Related papers: FaMTEB: Massive Text Embedding Benchmark in Persia…

200 papers

Automatic spelling correction stands as a pivotal challenge within the ambit of natural language processing (NLP), demanding nuanced solutions. Traditional spelling correction techniques are typically only capable of detecting and…

Computation and Language · Computer Science 2024-07-23 Seyed Mohammad Sadegh Dashti , Amid Khatibi Bardsiri , Mehdi Jafari Shahbazzadeh

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

Computation and Language · Computer Science 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Creating globally inclusive AI systems demands datasets reflecting diverse social norms. Iran, with its unique cultural blend, offers an ideal case study, with Farsi adding linguistic complexity. In this work, we introduce the Iranian…

Social and Information Networks · Computer Science 2025-03-19 Hamidreza Saffari , Mohammadamin Shafiei , Donya Rooein , Francesco Pierri , Debora Nozza

We introduce Multi-SimLex, a large-scale lexical resource and evaluation benchmark covering datasets for 12 typologically diverse languages, including major languages (e.g., Mandarin Chinese, Spanish, Russian) as well as less-resourced ones…

In the recent decade, with the enormous growth of digital content in internet and databases, sentiment analysis has received more and more attention between information retrieval and natural language processing researchers. Sentiment…

Computation and Language · Computer Science 2014-12-30 Ayoub Bagheri , Mohamad Saraee

This paper introduces the Persian Abstract Meaning Representation (AMR) guidelines, a detailed guide for annotating Persian sentences with AMR, focusing on the necessary adaptations to fit Persian's unique syntactic structures. We discuss…

Computation and Language · Computer Science 2025-04-22 Reza Takhshid , Tara Azin , Razieh Shojaei , Mohammad Bahrani

Accurate mapping of the built asset information to established data classification systems and taxonomies is crucial for effective asset management, whether for compliance at project handover or ad-hoc data integration scenarios. Due to the…

Computation and Language · Computer Science 2024-11-20 Mehrzad Shahinmoghadam , Ali Motamedi

The rapid advancement of language models has demonstrated the potential of artificial intelligence in the healthcare industry. However, small language models struggle with specialized domains in low-resource languages like Persian. While…

Computation and Language · Computer Science 2025-11-18 Mehrdad Ghassabi , Pedram Rostami , Hamidreza Baradaran Kashani , Amirhossein Poursina , Zahra Kazemi , Milad Tavakoli

This paper introduces TurkEmbed, a novel Turkish language embedding model designed to outperform existing models, particularly in Natural Language Inference (NLI) and Semantic Textual Similarity (STS) tasks. Current Turkish embedding models…

Computation and Language · Computer Science 2025-11-12 Özay Ezerceli , Gizem Gümüşçekiçci , Tuğba Erkoç , Berke Özenç

Large Language Models (LLMs) have shown remarkable capabilities, not only in generating human-like text, but also in acquiring knowledge. This highlights the need to go beyond the typical Natural Language Processing downstream benchmarks…

Computation and Language · Computer Science 2025-01-03 Ahmad Mustapha , Hadi Al-Khansa , Hadi Al-Mubasher , Aya Mourad , Ranam Hamoud , Hasan El-Husseini , Marwah Al-Sakkaf , Mariette Awad

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

Computation and Language · Computer Science 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

Detection of semantic contradictory sentences is one of the most challenging and fundamental issues for NLP applications such as recognition of textual entailments. Contradiction in this study includes different types of semantic…

Computation and Language · Computer Science 2021-07-06 Zeinab Rahimi , Mehrnoush ShamsFard

In text processing, deep neural networks mostly use word embeddings as an input. Embeddings have to ensure that relations between words are reflected through distances in a high-dimensional numeric space. To compare the quality of different…

Computation and Language · Computer Science 2022-06-01 Matej Ulčar , Kristiina Vaik , Jessica Lindström , Milda Dailidėnaitė , Marko Robnik-Šikonja

This paper introduces the hmBlogs corpus for Persian, as a low resource language. This corpus has been prepared based on a collection of nearly 20 million blog posts over a period of about 15 years from a space of Persian blogs and includes…

Computation and Language · Computer Science 2021-11-04 Hamzeh Motahari Khansari , Mehrnoush Shamsfard

The Persian language is an inflectional subject-object-verb language. This fact makes Persian a more uncertain language. However, using techniques such as Zero-Width Non-Joiner (ZWNJ) recognition, punctuation restoration, and Persian Ezafe…

Computation and Language · Computer Science 2021-11-23 Narges Farokhshad , Milad Molazadeh , Saman Jamalabbasi , Hamed Babaei Giglou , Saeed Bibak

Over the past years, interest in discourse analysis and discourse parsing has steadily grown, and many discourse-annotated corpora and, as a result, discourse parsers have been built. In this paper, we present a discourse-annotated corpus…

Computation and Language · Computer Science 2021-06-29 Sara Shahmohammadi , Hadi Veisi , Ali Darzi

Text classification has become a crucial task in various fields, leading to a significant amount of research on developing automated text classification systems for national and international languages. However, there is a growing need for…

Computation and Language · Computer Science 2023-05-08 Mursal Dawodi , Jawid Ahmad Baktash

Modern translation workflows demand more than semantic equivalence. Users routinely require models to preserve JSON or HTML schemas, honor curated glossaries, disambiguate with provided context, and match prescribed registers, often several…

Computation and Language · Computer Science 2026-05-28 Mingrui Sun , Mao Zheng , Zheng Li , Mingyang Song

We present a comprehensive evaluation of large language models for multilingual readability assessment. Existing evaluation resources lack domain and language diversity, limiting the ability for cross-domain and cross-lingual analyses. This…

Computation and Language · Computer Science 2024-10-17 Tarek Naous , Michael J. Ryan , Anton Lavrouk , Mohit Chandra , Wei Xu

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to…

Computation and Language · Computer Science 2017-01-10 Mohaddeseh Bastan , Shahram Khadivi , Mohammad Mehdi Homayounpour