中文
相关论文

相关论文: AfriMTEB and AfriE5: Benchmarking and Adapting Tex…

200 篇论文

With hundreds of multilingual embedding models available, practitioners lack clear guidance on which provide genuine cross-lingual semantic alignment versus task performance through language-specific patterns. Task-driven benchmarks (MTEB)…

计算与语言 · 计算机科学 2026-01-16 Wen G. Gong

In this paper, we introduce the first publicly available English-Kpelle dataset for machine translation, comprising over 2000 sentence pairs drawn from everyday communication, religious texts, and educational materials. By fine-tuning…

计算与语言 · 计算机科学 2025-05-27 Kweku Andoh Yamoah , Jackson Weako , Emmanuel J. Dorley

Embedding models play a crucial role in Natural Language Processing (NLP) by creating text embeddings used in various tasks such as information retrieval and assessing semantic text similarity. This paper focuses on research related to…

计算与语言 · 计算机科学 2025-02-04 Artem Snegirev , Maria Tikhonova , Anna Maksimova , Alena Fenogenova , Alexander Abramov

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

计算与语言 · 计算机科学 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Universal multimodal embedding models play a critical role in tasks such as interleaved image-text retrieval, multimodal RAG, and multimodal clustering. However, our empirical results indicate that existing LMM-based embedding models…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Zhibin Lan , Liqiang Niu , Fandong Meng , Jie Zhou , Jinsong Su

Exploring and quantifying semantic relatedness is central to representing language and holds significant implications across various NLP tasks. While earlier NLP research primarily focused on semantic similarity, often within the English…

Language is an essential factor of emancipation. Unfortunately, most of the more than 2,000 African languages are low-resourced. The community has recently used machine translation to revive and strengthen several African languages.…

计算与语言 · 计算机科学 2021-12-23 Gilles Hacheme

Our contribution to the 2023 AfriSenti-SemEval shared task 12: Sentiment Analysis for African Languages, provides insight into how a multilingual large language model can be a resource for sentiment analysis in languages not seen during…

计算与语言 · 计算机科学 2023-04-28 Egil Rønningstad

In recent years, sentiment analysis has gained significant importance in natural language processing. However, most existing models and datasets for sentiment analysis are developed for high-resource languages, such as English and Chinese,…

计算与语言 · 计算机科学 2023-09-19 Daniil Homskiy , Narek Maloyan

In multi-label emotion classification, particularly for low-resource languages like Arabic, the challenges of class imbalance and label correlation hinder model performance, especially in accurately predicting minority emotions. To address…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Muhammad Azeem Aslam , Wang Jun , Nisar Ahmed , Muhammad Imran Zaman , Li Yanan , Hu Hongfei , Wang Shiyu , Xin Liu

This paper introduces AfriHG -- a news headline generation dataset created by combining from XLSum and MasakhaNEWS datasets focusing on 16 languages widely spoken by Africa. We experimented with two seq2eq models (mT5-base and AfriTeVa V2),…

计算与语言 · 计算机科学 2024-12-31 Toyib Ogunremi , Serah Akojenu , Anthony Soronnadi , Olubayo Adekanmbi , David Ifeoluwa Adelani

The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression. While these contents can be humorous and informative, they are also increasingly being…

计算与语言 · 计算机科学 2025-08-25 Nouar AlDahoul , Yasir Zaki

Multimodal AI research has overwhelmingly focused on high-resource languages, hindering the democratization of advancements in the field. To address this, we present AfriCaption, a comprehensive framework for multilingual image captioning…

We describe our contribution to the SemEVAl 2023 AfriSenti-SemEval shared task, where we tackle the task of sentiment analysis in 14 different African languages. We develop both monolingual and multilingual models under a full supervised…

计算与语言 · 计算机科学 2023-04-26 Gagan Bhatia , Ife Adebara , AbdelRahim Elmadany , Muhammad Abdul-Mageed

In this work, we present AfriHuBERT, an extension of mHuBERT-147, a compact self-supervised learning (SSL) model pretrained on 147 languages. While mHuBERT-147 covered 16 African languages, we expand this to 1,226 through continued…

计算与语言 · 计算机科学 2025-06-03 Jesujoba O. Alabi , Xuechen Liu , Dietrich Klakow , Junichi Yamagishi

Word embeddings are a core component of modern natural language processing systems, making the ability to thoroughly evaluate them a vital task. We describe DiaLex, a benchmark for intrinsic evaluation of dialectal Arabic word embedding.…

Vietnam ranks among the top countries in terms of both internet traffic and online toxicity. As a result, implementing embedding models for recommendation and content control duties in applications is crucial. However, a lack of large-scale…

计算与语言 · 计算机科学 2025-07-30 Loc Pham , Tung Luu , Thu Vo , Minh Nguyen , Viet Hoang

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

计算与语言 · 计算机科学 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

Embedding models play a pivot role in modern NLP applications such as IR and RAG. While the context limit of LLMs has been pushed beyond 1 million tokens, embedding models are still confined to a narrow context window not exceeding 8k…

计算与语言 · 计算机科学 2024-11-08 Dawei Zhu , Liang Wang , Nan Yang , Yifan Song , Wenhao Wu , Furu Wei , Sujian Li