中文
相关论文

相关论文: The Harder Text Embedding Benchmark (HTEB): Beyond…

200 篇论文

Large language models and deep learning models designed for code intelligence have revolutionized the software engineering field due to their ability to perform various code-related tasks. These models can process source code and software…

软件工程 · 计算机科学 2025-07-31 Ali Asgari , Milan de Koning , Pouria Derakhshanfar , Annibale Panichella

Large language models (LLMs) are increasingly deployed in the telecommunications domain for critical tasks, relying heavily on Retrieval-Augmented Generation (RAG) to adapt general-purpose models to continuously evolving standards. However,…

机器学习 · 计算机科学 2026-04-21 Pranshav Gajjar , Vijay K Shah

The majority of data in businesses and industries is stored in tables, databases, and data warehouses. Reasoning with table-structured data poses significant challenges for large language models (LLMs) due to its hidden semantics, inherent…

计算与语言 · 计算机科学 2025-07-15 Ce Li , Xiaofan Liu , Zhiyan Song , Ce Chi , Chen Zhao , Jingjing Yang , Zhendong Wang , Kexin Yang , Boshen Shi , Xing Wang , Chao Deng , Junlan Feng

Deep Learning NLP domain lacks procedures for the analysis of model robustness. In this paper we propose a framework which validates robustness of any Question Answering model through model explainers. We propose that a robust model should…

计算与语言 · 计算机科学 2018-12-07 Barbara Rychalska , Dominika Basaj , Przemyslaw Biecek

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Foundation models have established unified representations for natural language processing, yet this paradigm remains largely unexplored for tabular data. Existing methods face fundamental limitations: LLM-based approaches lack…

计算与语言 · 计算机科学 2026-05-07 Minjie Qiang , Mingming Zhang , Xiaoyi Bao , Xing Fu , Yu Cheng , Weiqiang Wang , Zhongqing Wang , Ningtao Wang

Evaluating large language models (LLMs) today rests on fixed benchmarks that apply the same set of items to any model, producing ceiling and floor effects that mask capability gaps. We argue that the most informative evaluation signal lies…

人工智能 · 计算机科学 2026-05-27 Haoxiang Wang , Da Yu , Huishuai Zhang

Universal multimodal embedding models play a critical role in tasks such as interleaved image-text retrieval, multimodal RAG, and multimodal clustering. However, our empirical results indicate that existing LMM-based embedding models…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Zhibin Lan , Liqiang Niu , Fandong Meng , Jie Zhou , Jinsong Su

In this paper, we introduce a comprehensive benchmark for Persian (Farsi) text embeddings, built upon the Massive Text Embedding Benchmark (MTEB). Our benchmark includes 63 datasets spanning seven different tasks: classification,…

计算与语言 · 计算机科学 2025-05-20 Erfan Zinvandi , Morteza Alikhani , Mehran Sarmadi , Zahra Pourbahman , Sepehr Arvin , Reza Kazemi , Arash Amini

Benchmarks that reflect the diversity and complexity of real-world documents are essential for accurately evaluating Automatic Text Recognition (ATR) systems, especially Vision-Large Language Models (vLLMs). Although recent models…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Mélodie Boillet , Solène Tarride , Christopher Kermorvant

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

计算与语言 · 计算机科学 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Recent large language models (LLMs) have demonstrated exceptional performance on general-purpose text embedding tasks. While dense embeddings have dominated related research, we introduce the first lexicon-based embeddings (LENS) leveraging…

计算与语言 · 计算机科学 2026-03-20 Yibin Lei , Tao Shen , Yu Cao , Andrew Yates

With the increasing use of large language models (LLMs), ensuring reliable performance in diverse, real-world environments is essential. Despite their remarkable achievements, LLMs often struggle with adversarial inputs, significantly…

计算与语言 · 计算机科学 2024-06-18 Yuqing Wang , Yun Zhao

Substantial increase in the use of Electronic Health Records (EHRs) has opened new frontiers for predictive healthcare. However, while EHR systems are nearly ubiquitous, they lack a unified code system for representing medical concepts.…

机器学习 · 计算机科学 2022-03-21 Kyunghoon Hur , Jiyoung Lee , Jungwoo Oh , Wesley Price , Young-Hak Kim , Edward Choi

The Massive Sound Embedding Benchmark (MSEB) has emerged as a standard for evaluating the functional breadth of audio models. While initial baselines focused on specialized encoders, the shift toward "audio-native" Large Language Models…

声音 · 计算机科学 2026-05-07 Cyril Allauzen , Tom Bagby , Georg Heigold , Ehsan Variani , Ke Wu

Structured embedding transformations offer a promising approach for enhancing the efficiency and coherence of language model inference. The introduction of Structural Embedding Projection (SEP) provides a mechanism for refining token…

计算与语言 · 计算机科学 2025-08-11 Vincent Enoasmo , Cedric Featherstonehaugh , Xavier Konstantinopoulos , Zacharias Huntington

The integration of structured hierarchical embeddings into transformer-based architectures introduces a refined approach to lexical representation, ensuring that multi-scale semantic relationships are preserved without compromising…

As Large Language Models (LLMs) are increasingly deployed to handle various natural language processing (NLP) tasks, concerns regarding the potential negative societal impacts of LLM-generated content have also arisen. To evaluate the…

计算与语言 · 计算机科学 2025-02-25 Song Wang , Peng Wang , Tong Zhou , Yushun Dong , Zhen Tan , Jundong Li

Large language models (LLMs) call for extension of context to handle many critical applications. However, the existing approaches are prone to expensive costs and inferior quality of context extension. In this work, we proposeExtensible…

计算与语言 · 计算机科学 2024-02-20 Kun Luo , Zheng Liu , Shitao Xiao , Kang Liu