English
Related papers

Related papers: FinMTEB: Finance Massive Text Embedding Benchmark

200 papers

The evaluation of English text embeddings has transitioned from evaluating a handful of datasets to broad coverage across many tasks through benchmarks such as MTEB. However, this is not the case for multilingual text embeddings due to a…

Computation and Language · Computer Science 2024-06-05 Kenneth Enevoldsen , Márton Kardos , Niklas Muennighoff , Kristoffer Laigaard Nielbo

Recently, embedding resources, including models, benchmarks, and datasets, have been widely released to support a variety of languages. However, the Dutch language remains underrepresented, typically comprising only a small fraction of the…

Computation and Language · Computer Science 2025-09-17 Nikolay Banar , Ehsan Lotfi , Jens Van Nooten , Cristina Arhiliuc , Marija Kliocaite , Walter Daelemans

Comparing human and model performance offers a valuable perspective for understanding the strengths and limitations of embedding models, highlighting where they succeed and where they fail to capture meaning and nuance. However, such…

Computation and Language · Computer Science 2025-12-05 Adnan El Assadi , Isaac Chung , Roman Solomatin , Niklas Muennighoff , Kenneth Enevoldsen

Domain specificity of embedding models is critical for effective performance. However, existing benchmarks, such as FinMTEB, are primarily designed for high-resource languages, leaving low-resource settings, such as Korean, under-explored.…

Computation and Language · Computer Science 2025-04-02 Yewon Hwang , Sungbum Jung , Hanwool Lee , Sara Yu

Accurate mapping of the built asset information to established data classification systems and taxonomies is crucial for effective asset management, whether for compliance at project handover or ad-hoc data integration scenarios. Due to the…

Computation and Language · Computer Science 2024-11-20 Mehrzad Shahinmoghadam , Ali Motamedi

Text embedding models are widely used in natural language processing applications. However, their capability is often benchmarked on tasks that do not require understanding nuanced numerical information in text. As a result, it remains…

Computation and Language · Computer Science 2025-09-09 Ningyuan Deng , Hanyu Duan , Yixuan Tang , Yi Yang

General-purpose sentence embedding models often struggle to capture specialized financial semantics, especially in low-resource languages like Korean, due to domain-specific jargon, temporal meaning shifts, and misaligned bilingual…

Computation and Language · Computer Science 2025-11-10 Hanwool Lee , Sara Yu , Yewon Hwang , Jonghyun Choi , Heejae Ahn , Sungbum Jung , Youngjae Yu

Financial documents are filled with specialized terminology, arcane jargon, and curious acronyms that pose challenges for general-purpose text embeddings. Yet, few text embeddings specialized for finance have been reported in the…

Computation and Language · Computer Science 2024-11-12 Peter Anderson , Mano Vikash Janardhanan , Jason He , Wei Cheng , Charlie Flanagan

Current sentence embedding evaluations typically rely on static test beds like the Massive Text Embedding Benchmark (MTEB). While invaluable, repeated tuning on a fixed suite can inflate reported scores and obscure real-world robustness. We…

Computation and Language · Computer Science 2026-03-02 Manuel Frank , Haithem Afli

Multimodal Large Language Models (MLLMs) have experienced rapid development in recent years. However, in the financial domain, there is a notable lack of effective and specialized multimodal evaluation datasets. To advance the development…

Computation and Language · Computer Science 2025-06-02 Junyu Luo , Zhizhuo Kou , Liming Yang , Xiao Luo , Jinsheng Huang , Zhiping Xiao , Jingshu Peng , Chengzhong Liu , Jiaming Ji , Xuanzhe Liu , Sirui Han , Ming Zhang , Yike Guo

Real-world financial analysis involves information across multiple languages and modalities, from reports and news to scanned filings and meeting recordings. Yet most existing evaluations of LLMs in finance remain text-only, monolingual,…

We introduce a novel suite of state-of-the-art bilingual text embedding models that are designed to support English and another target language. These models are capable of processing lengthy text inputs with up to 8192 tokens, making them…

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

Computation and Language · Computer Science 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

We introduce a new language representation model in finance called Financial Embedding Analysis of Sentiment (FinEAS). In financial markets, news and investor sentiment are significant drivers of security prices. Thus, leveraging the…

Computation and Language · Computer Science 2021-11-22 Asier Gutiérrez-Fandiño , Miquel Noguer i Alonso , Petter Kolm , Jordi Armengol-Estapé

Embedding models have demonstrated strong performance in tasks like clustering, retrieval, and feature extraction while offering computational advantages over generative models and cross-encoders. Benchmarks such as MTEB have shown that…

Software Engineering · Computer Science 2025-08-28 Zhuohao Li , Wenqing Chen , Jianxing Yu , Zhichao Lu

Embedding models play a crucial role in Natural Language Processing (NLP) by creating text embeddings used in various tasks such as information retrieval and assessing semantic text similarity. This paper focuses on research related to…

Computation and Language · Computer Science 2025-02-04 Artem Snegirev , Maria Tikhonova , Anna Maksimova , Alena Fenogenova , Alexander Abramov

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Computation and Language · Computer Science 2025-06-12 Yanzhao Zhang , Mingxin Li , Dingkun Long , Xin Zhang , Huan Lin , Baosong Yang , Pengjun Xie , An Yang , Dayiheng Liu , Junyang Lin , Fei Huang , Jingren Zhou

Accurate classification of multi-modal financial documents, containing text, tables, charts, and images, is crucial but challenging. Traditional text-based approaches often fail to capture the complex multi-modal nature of these documents.…

Information Retrieval · Computer Science 2024-06-05 Anjanava Biswas , Wrick Talukdar

The integration of Large Language Models (LLMs) into financial analysis has garnered significant attention in the NLP community. This paper presents our solution to IJCAI-2024 FinLLM challenge, investigating the capabilities of LLMs within…

Computational Engineering, Finance, and Science · Computer Science 2024-07-03 Yupeng Cao , Zhiyuan Yao , Zhi Chen , Zhiyang Deng

We present QZhou-Embedding, a general-purpose contextual text embedding model with exceptional text representation capabilities. Built upon the Qwen2.5-7B-Instruct foundation model, we designed a unified multi-task framework comprising…

Computation and Language · Computer Science 2025-09-01 Peng Yu , En Xu , Bin Chen , Haibiao Chen , Yinfei Xu