English
Related papers

Related papers: Qwen3 Embedding: Advancing Text Embedding and Rera…

200 papers

As the construction industry advances toward digital transformation, BIM (Building Information Modeling)-based design has become a key driver supporting intelligent construction. Despite Large Language Models (LLMs) have shown potential in…

Artificial Intelligence · Computer Science 2026-02-25 Jia-Rui Lin , Yun-Hong Cai , Xiang-Rui Ni , Shaojie Zhou , Peng Pan

Modern day Language Models see extensive use in text classification, yet this comes at significant computational cost. Compute-effective classification models are needed for low-resource environments, most notably on edge devices. We…

Machine Learning · Computer Science 2024-11-22 Stan Loosmore , Alexander Titus

In this paper, we introduce a comprehensive benchmark for Persian (Farsi) text embeddings, built upon the Massive Text Embedding Benchmark (MTEB). Our benchmark includes 63 datasets spanning seven different tasks: classification,…

Computation and Language · Computer Science 2025-05-20 Erfan Zinvandi , Morteza Alikhani , Mehran Sarmadi , Zahra Pourbahman , Sepehr Arvin , Reza Kazemi , Arash Amini

Text anomaly detection is a critical task in natural language processing (NLP), with applications spanning fraud detection, misinformation identification, spam detection and content moderation, etc. Despite significant advances in large…

Computation and Language · Computer Science 2025-07-17 Feng Xiao , Jicong Fan

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin

Alignment between image and text has shown promising improvements on patch-level pre-trained document image models. However, investigating more effective or finer-grained alignment techniques during pre-training requires a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Lei Wang , Jiabang He , Xing Xu , Ning Liu , Hui Liu

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

Semantically meaningful sentence embeddings are important for numerous tasks in natural language processing. To obtain such embeddings, recent studies explored the idea of utilizing synthetically generated data from pretrained language…

Computation and Language · Computer Science 2022-08-31 Taehee Kim , ChaeHun Park , Jimin Hong , Radhika Dua , Edward Choi , Jaegul Choo

Large decoder-only language models (LLMs) are the state-of-the-art models on most of today's NLP tasks and benchmarks. Yet, the community is only slowly adopting these models for text embedding tasks, which require rich contextualized…

Computation and Language · Computer Science 2024-08-23 Parishad BehnamGhader , Vaibhav Adlakha , Marius Mosbach , Dzmitry Bahdanau , Nicolas Chapados , Siva Reddy

Recent advances in large language model (LLM) embeddings have enabled powerful representations for biological data, but most applications to date focus on gene-level information. We present one of the first systematic frameworks to generate…

Applications · Statistics 2026-04-01 Hongqian Niu , Jordan Bryan , Jacob Williams , Hufeng Zhou , Haoyu Zhang , Xihao Li , Didong Li

Multimodal embedding models have gained significant attention for their ability to map data from different modalities, such as text and images, into a unified representation space. However, the limited labeled multimodal data often hinders…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Haonan Chen , Liang Wang , Nan Yang , Yutao Zhu , Ziliang Zhao , Furu Wei , Zhicheng Dou

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

This report explores the enhancement of text retrieval performance using advanced data refinement techniques. We develop Linq-Embed-Mistral\footnote{\url{https://huggingface.co/Linq-AI-Research/Linq-Embed-Mistral}} by building on the…

Computation and Language · Computer Science 2024-12-05 Chanyeol Choi , Junseong Kim , Seolhwa Lee , Jihoon Kwon , Sangmo Gu , Yejin Kim , Minkyung Cho , Jy-yong Sohn

Patent text embeddings enable prior art search, technology landscaping, and patent analysis, yet existing benchmarks inadequately capture patent-specific challenges. We introduce PatenTEB, a comprehensive benchmark comprising 15 tasks…

Computation and Language · Computer Science 2025-10-28 Iliass Ayaou , Denis Cavallucci

Producing outputs that satisfy both semantic intent and format constraints is essential for deploying large language models in user-facing and system-integrated workflows. In this work, we focus on Markdown formatting, which is ubiquitous…

Computation and Language · Computer Science 2026-02-09 Yaoting Wang , Yun Zhou , Henghui Ding

Dense retrieval calls for discriminative embeddings to represent the semantic relationship between query and document. It may benefit from the using of large language models (LLMs), given LLMs' strong capability on semantic understanding.…

Computation and Language · Computer Science 2025-11-25 Zheng Liu , Chaofan Li , Shitao Xiao , Yingxia Shao , Defu Lian

The rapid expansion of modern wide-area networks (WANs) has made traffic engineering (TE) increasingly challenging, as traditional solvers struggle to keep pace. Although existing offline ML-driven approaches accelerate TE optimization with…

Networking and Internet Architecture · Computer Science 2026-02-03 Xinyu Yuan , Yan Qiao , Zonghui Wang , Meng Li , Wenzhi Chen

Entities are essential elements of natural language. In this paper, we present methods for learning multi-level representations of entities on three complementary levels: character (character patterns in entity names extracted, e.g., by…

Computation and Language · Computer Science 2017-01-18 Yadollah Yaghoobzadeh , Hinrich Schütze

Recent advancements in Large Language Models (LLMs) have sparked interest in their potential applications across various fields. This paper embarked on a pivotal inquiry: Can existing LLMs effectively serve as "water expert models" for…

Computation and Language · Computer Science 2024-08-01 Boyan Xu , Liang Wen , Zihao Li , Yuxing Yang , Guanlan Wu , Xiongpeng Tang , Yu Li , Zihao Wu , Qingxian Su , Xueqing Shi , Yue Yang , Rui Tong , How Yong Ng

Large language models (LLMs) have revolutionized natural language processing by achieving state-of-the-art performance across various tasks. Recently, their effectiveness as embedding models has gained attention, marking a paradigm shift…

Computation and Language · Computer Science 2025-07-28 Chongyang Tao , Tao Shen , Shen Gao , Junshuo Zhang , Zhen Li , Kai Hua , Wenpeng Hu , Zhengwei Tao , Shuai Ma