English
Related papers

Related papers: PatenTEB: A Comprehensive Benchmark and Model Fami…

200 papers

Tabular foundation models aim to learn universal representations of tabular data that transfer across tasks and domains, enabling applications such as table retrieval, semantic search and table-based prediction. Despite the growing number…

Machine Learning · Computer Science 2026-04-24 Liane Vogel , Kavitha Srinivas , Niharika D'Souza , Sola Shirai , Oktie Hassanzadeh , Horst Samulowitz

The Patent Trial and Appeal Board (PTAB) of the USPTO adjudicates thousands of ex parte appeals each year, requiring the integration of technical understanding and legal reasoning. While large language models (LLMs) are increasingly applied…

Computation and Language · Computer Science 2026-01-09 Yehoon Jang , Chaewon Lee , Hyun-seok Min , Sungchul Choi

Many thousands of patent applications arrive at patent offices around the world every day. One important subtask when a patent application is submitted is to assign one or more classification codes from the complex and hierarchical patent…

Information Retrieval · Computer Science 2022-03-08 Eleni Kamateri , Vasileios Stamatis , Konstantinos Diamantaras , Michail Salampasis

Patent classification is the task that assigns each input patent into several codes (classes). Due to its high demand, several datasets and methods have been introduced. However, the lack of both systematic performance comparison of…

Computation and Language · Computer Science 2024-03-18 Minh-Tien Nguyen , Nhung Bui , Manh Tran-Tien , Linh Le , Huy-The Vu

Text anomaly detection is crucial for identifying spam, misinformation, and offensive language in natural language processing tasks. Despite the growing adoption of embedding-based methods, their effectiveness and generalizability across…

Computation and Language · Computer Science 2025-05-26 Yang Cao , Sikun Yang , Chen Li , Haolong Xiang , Lianyong Qi , Bo Liu , Rongsheng Li , Ming Liu

This study provides an efficient approach for using text data to calculate patent-to-patent (p2p) technological similarity, and presents a hybrid framework for leveraging the resulting p2p similarity for applications such as semantic search…

Machine Learning · Computer Science 2021-10-19 Hamid Bekamiri , Daniel S. Hain , Roman Jurowetzki

Patent examination is a complex, multi-stage process requiring both technical expertise and legal reasoning, increasingly challenged by rising application volumes. Prior benchmarks predominantly view patent examination as discriminative…

Computation and Language · Computer Science 2026-05-06 Qiyao Wang , Xinyi Chen , Longze Chen , Hongbo Wang , Hamid Alinejad-Rokny , Yuan Lin , Min Yang

We introduce C-Pack, a package of resources that significantly advance the field of general Chinese embeddings. C-Pack includes three critical resources. 1) C-MTEB is a comprehensive benchmark for Chinese text embeddings covering 6 tasks…

Computation and Language · Computer Science 2024-09-25 Shitao Xiao , Zheng Liu , Peitian Zhang , Niklas Muennighoff , Defu Lian , Jian-Yun Nie

Patent landscaping is the process of identifying all patents related to a particular technological area, and is important for assessing various aspects of the intellectual property context. Traditionally, constructing patent landscapes is…

Computation and Language · Computer Science 2024-07-12 Tisa Islam Erana , Mark A. Finlayson

Code search has usually been evaluated as first-stage retrieval, even though production systems rely on broader pipelines with reranking and developer-style queries. Existing benchmarks also suffer from data contamination, label noise, and…

Software Engineering · Computer Science 2026-05-11 Siqiao Xue , Zihan Liao , Jin Qin , Ziyin Zhang , Yixiang Mu , Fan Zhou , Hang Yu

Effectively modeling text-rich fresh content such as news articles at document-level is a challenging problem. To ensure a content-based model generalize well to a broad range of applications, it is critical to have a training dataset that…

Computation and Language · Computer Science 2021-06-08 Jialu Liu , Tianqi Liu , Cong Yu

Text embedding methods have become increasingly popular in both industrial and academic fields due to their critical role in a variety of natural language processing tasks. The significance of universal text embeddings has been further…

Information Retrieval · Computer Science 2024-06-21 Hongliu Cao

Embedding models play a pivot role in modern NLP applications such as IR and RAG. While the context limit of LLMs has been pushed beyond 1 million tokens, embedding models are still confined to a narrow context window not exceeding 8k…

Computation and Language · Computer Science 2024-11-08 Dawei Zhu , Liang Wang , Nan Yang , Yifan Song , Wenhao Wu , Furu Wei , Sujian Li

This paper presents a simple yet effective contrastive learning framework for learning patent embeddings by leveraging multiple views from within the same document. We first identify a patent-specific failure mode of SimCSE style dropout…

Computation and Language · Computer Science 2025-11-17 You Zuo , Kim Gerdes , Eric Villemonte de La Clergerie , Benoît Sagot

We propose a new application of embedding techniques for problem retrieval in adaptive tutoring. The objective is to retrieve problems whose mathematical concepts are similar. There are two challenges: First, like sentences, problems…

Computers and Society · Computer Science 2020-03-25 Du Su , Ali Yekkehkhany , Yi Lu , Wenmiao Lu

This work introduces a benchmark assessing the performance of clustering German text embeddings in different domains. This benchmark is driven by the increasing use of clustering neural text embeddings in tasks that require the grouping of…

Computation and Language · Computer Science 2024-01-08 Silvan Wehrli , Bert Arnrich , Christopher Irrgang

With hundreds of multilingual embedding models available, practitioners lack clear guidance on which provide genuine cross-lingual semantic alignment versus task performance through language-specific patterns. Task-driven benchmarks (MTEB)…

Computation and Language · Computer Science 2026-01-16 Wen G. Gong

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

Computation and Language · Computer Science 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

Retrieval augmentation has become an effective solution to empower large language models (LLMs) with external and verified knowledge sources from the database, which overcomes the limitations and hallucinations of LLMs in handling…

Information Retrieval · Computer Science 2023-11-21 Tong Wu , Yulei Qin , Enwei Zhang , Zihan Xu , Yuting Gao , Ke Li , Xing Sun

Given a patent document, identifying distinct semantic annotations is an interesting research aspect. Text annotation helps the patent practitioners such as examiners and patent attorneys to quickly identify the key arguments of any…

Machine Learning · Computer Science 2021-11-19 Renukswamy Chikkamath , Vishvapalsinhji Ramsinh Parmar , Christoph Hewel , Markus Endres