English
Related papers

Related papers: VN-MTEB: Vietnamese Massive Text Embedding Benchma…

200 papers

Multimodal embedding models have been crucial in enabling various downstream tasks such as semantic similarity, information retrieval, and clustering over different modalities. However, existing multimodal embeddings like VLM2Vec, E5-V, GME…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Rui Meng , Ziyan Jiang , Ye Liu , Mingyi Su , Xinyi Yang , Yuepeng Fu , Can Qin , Zeyuan Chen , Ran Xu , Caiming Xiong , Yingbo Zhou , Wenhu Chen , Semih Yavuz

Named entity recognition (NER) plays an important role in text-based information retrieval. In this paper, we combine Bidirectional Long Short-Term Memory (Bi-LSTM) \cite{hochreiter1997,schuster1997} with Conditional Random Field (CRF)…

Computation and Language · Computer Science 2019-12-04 Ngoc C. Lê , Ngoc-Yen Nguyen , Anh-Duong Trinh

In this report, we introduce Vintern-1B, a reliable 1-billion-parameters multimodal large language model (MLLM) for Vietnamese language tasks. By integrating the Qwen2-0.5B-Instruct language model with the InternViT-300M-448px visual model,…

Machine Learning · Computer Science 2024-08-26 Khang T. Doan , Bao G. Huynh , Dung T. Hoang , Thuc D. Pham , Nhat H. Pham , Quan T. M. Nguyen , Bang Q. Vo , Suong N. Hoang

Multimodal embedding models aim to map heterogeneous inputs, such as text, images, videos, and audio, into a shared semantic space. However, existing methods and benchmarks remain largely limited to partial modality coverage, making it…

Information Retrieval · Computer Science 2026-04-28 Haohang Huang , Xuan Lu , Mingyi Su , Xuan Zhang , Ziyan Jiang , Ping Nie , Kai Zou , Tomas Pfister , Wenhu Chen , Wei Zhang , Xiaoyu Shen , Rui Meng

This paper demonstrates end-to-end neural network architectures for Vietnamese named entity recognition. Our best model is a combination of bidirectional Long Short-Term Memory (Bi-LSTM), Convolutional Neural Network (CNN), Conditional…

Computation and Language · Computer Science 2017-07-24 Thai-Hoang Pham , Phuong Le-Hong

Code-switching (CS), which is when Vietnamese speech uses English words like drug names or procedures, is a common phenomenon in Vietnamese medical communication. This creates challenges for Automatic Speech Recognition (ASR) systems,…

Computation and Language · Computer Science 2026-02-16 Tung X. Nguyen , Nhu Vo , Giang-Son Nguyen , Duy Mai Hoang , Chien Dinh Huynh , Inigo Jauregi Unanue , Massimo Piccardi , Wray Buntine , Dung D. Le

Comparing human and model performance offers a valuable perspective for understanding the strengths and limitations of embedding models, highlighting where they succeed and where they fail to capture meaning and nuance. However, such…

Computation and Language · Computer Science 2025-12-05 Adnan El Assadi , Isaac Chung , Roman Solomatin , Niklas Muennighoff , Kenneth Enevoldsen

The rapid advancement of information and communication technology has facilitated easier access to information. However, this progress has also necessitated more stringent verification measures to ensure the accuracy of information,…

Computation and Language · Computer Science 2025-03-04 Bao Tran , T. N. Khanh , Khang Nguyen Tuong , Thien Dang , Quang Nguyen , Nguyen T. Thinh , Vo T. Hung

Large Language Models (LLMs) have shown remarkable proficiency in Machine Reading Comprehension (MRC) tasks; however, their effectiveness for low-resource languages like Vietnamese remains largely unexplored. In this paper, we fine-tune and…

Computation and Language · Computer Science 2025-03-25 Anh Duc Nguyen , Hieu Minh Phi , Anh Viet Ngo , Long Hai Trieu , Thai Phuong Nguyen

In the field of education, understanding students' opinions through their comments is crucial, especially in the Vietnamese language, where resources remain limited. Existing educational datasets often lack domain relevance and student…

Computation and Language · Computer Science 2025-07-01 Phan Quoc Hung Mai , Quang Hung Nguyen , Phuong Giang Duong , Hong Hanh Nguyen , Nguyen Tuan Long

We introduce a high-quality and large-scale Vietnamese-English parallel dataset of 3.02M sentence pairs, which is 2.9M pairs larger than the benchmark Vietnamese-English machine translation corpus IWSLT15. We conduct experiments comparing…

Computation and Language · Computer Science 2021-10-26 Long Doan , Linh The Nguyen , Nguyen Luong Tran , Thai Hoang , Dat Quoc Nguyen

Traditional text embedding benchmarks primarily evaluate embedding models' capabilities to capture semantic similarity. However, more advanced NLP tasks require a deeper understanding of text, such as safety and factuality. These tasks…

Computation and Language · Computer Science 2025-03-05 Simeng Han , Frank Palma Gomez , Tu Vu , Zefei Li , Daniel Cer , Hansi Zeng , Chris Tar , Arman Cohan , Gustavo Hernandez Abrego

Patent text embeddings enable prior art search, technology landscaping, and patent analysis, yet existing benchmarks inadequately capture patent-specific challenges. We introduce PatenTEB, a comprehensive benchmark comprising 15 tasks…

Computation and Language · Computer Science 2025-10-28 Iliass Ayaou , Denis Cavallucci

In the field of legal information retrieval, effective embedding-based models are essential for accurate question-answering systems. However, the scarcity of large annotated datasets poses a significant challenge, particularly for…

Information Retrieval · Computer Science 2024-12-03 Son Pham Tien , Hieu Nguyen Doan , An Nguyen Dai , Sang Dinh Viet

We introduce C-Pack, a package of resources that significantly advance the field of general Chinese embeddings. C-Pack includes three critical resources. 1) C-MTEB is a comprehensive benchmark for Chinese text embeddings covering 6 tasks…

Computation and Language · Computer Science 2024-09-25 Shitao Xiao , Zheng Liu , Peitian Zhang , Niklas Muennighoff , Defu Lian , Jian-Yun Nie

Decoder-only LLM-based embedding models are beginning to outperform BERT or T5-based embedding models in general-purpose text embedding tasks, including dense vector-based retrieval. In this work, we introduce NV-Embed, incorporating…

Computation and Language · Computer Science 2025-02-26 Chankyu Lee , Rajarshi Roy , Mengyao Xu , Jonathan Raiman , Mohammad Shoeybi , Bryan Catanzaro , Wei Ping

Machine translation is shifting to an end-to-end approach based on deep neural networks. The state of the art achieves impressive results for popular language pairs such as English - French or English - Chinese. However for English -…

Computation and Language · Computer Science 2018-10-31 Hong-Hai Phan-Vu , Viet-Trung Tran , Van-Nam Nguyen , Hoang-Vu Dang , Phan-Thuan Do

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

Computation and Language · Computer Science 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

Over 97 million people speak Vietnamese as their native language in the world. However, there are few research studies on machine reading comprehension (MRC) for Vietnamese, the task of understanding a text and answering questions related…

Computation and Language · Computer Science 2020-11-10 Kiet Van Nguyen , Duc-Vu Nguyen , Anh Gia-Tuan Nguyen , Ngan Luu-Thuy Nguyen

Visual Question Answering (VQA) is a fundamental multimodal task that requires models to jointly understand visual and textual information. Early VQA systems relied heavily on language biases, motivating subsequent work to emphasize visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Nguyen Anh Tuong , Phan Ba Duc , Nguyen Trung Quoc , Tran Dac Thinh , Dang Duy Lan , Nguyen Quoc Thinh , Tung Le