English
Related papers

Related papers: Multiple Retrieval Models and Regression Models fo…

200 papers

Tree search-based methods have made significant progress in enhancing the code generation capabilities of large language models. However, due to the difficulty in effectively evaluating intermediate algorithmic steps and the inability to…

Artificial Intelligence · Computer Science 2025-12-18 Yuanyuan Lin , Xiangyu Ouyang , Teng Zhang , Kaixin Sui

Multilingual vision-language models have made significant strides in image captioning, yet they still lag behind their English counterparts due to limited multilingual training data and costly large-scale model parameterization.…

Computation and Language · Computer Science 2025-07-29 George Ibrahim , Rita Ramos , Yova Kementchedjhieva

Patent classification aims to assign multiple International Patent Classification (IPC) codes to a given patent. Recent methods for automatically classifying patents mainly focus on analyzing the text descriptions of patents. However, apart…

Artificial Intelligence · Computer Science 2024-06-21 Tao Zou , Le Yu , Junchen Ye , Leilei Sun , Bowen Du , Deqing Wang

In this work we focus on fine-tuning a pre-trained BERT model and applying it to patent classification. When applied to large datasets of over two millions patents, our approach outperforms the state of the art by an approach using CNN with…

Computation and Language · Computer Science 2019-07-02 Jieh-Sheng Lee , Jieh Hsiang

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

Multi-stage ranking pipelines have been a practical solution in modern search systems, where the first-stage retrieval is to return a subset of candidate documents, and latter stages attempt to re-rank those candidates. Unlike re-ranking…

Information Retrieval · Computer Science 2021-09-20 Jiafeng Guo , Yinqiong Cai , Yixing Fan , Fei Sun , Ruqing Zhang , Xueqi Cheng

Recent advances in deep forecasting models have achieved remarkable performance, yet most approaches still struggle to provide both accurate predictions and interpretable insights into temporal dynamics. This paper proposes CaReTS, a novel…

Machine Learning · Computer Science 2025-11-14 Fulong Yao , Wanqing Zhao , Chao Zheng , Xiaofei Han

Effectively managing intellectual property is a significant challenge. Traditional methods for patent analysis depend on labor-intensive manual searches and rigid keyword matching. These approaches are often inefficient and struggle to…

Information Retrieval · Computer Science 2025-09-10 Guanzhi Deng , Yi Xie , Yu-Keung Ng , Mingyang Liu , Peijun Zheng , Jie Liu , Dapeng Wu , Yinqiao Li , Linqi Song

Retrieval-augmented language models can better adapt to changes in world state and incorporate long-tail knowledge. However, most existing methods retrieve only short contiguous chunks from a retrieval corpus, limiting holistic…

Computation and Language · Computer Science 2024-02-01 Parth Sarthi , Salman Abdullah , Aditi Tuli , Shubh Khanna , Anna Goldie , Christopher D. Manning

Modeling and forecasting forward citations to a patent is a central task for the discovery of emerging technologies and for measuring the pulse of inventive progress. Conventional methods for forecasting these forward citations cast the…

Digital Libraries · Computer Science 2019-05-30 Taoran Ji , Zhiqian Chen , Nathan Self , Kaiqun Fu , Chang-Tien Lu , Naren Ramakrishnan

In this paper, we extend some usual techniques of classification resulting from a large-scale data-mining and network approach. This new technology, which in particular is designed to be suitable to big data, is used to construct an open…

Physics and Society · Physics 2017-07-05 Antonin Bergeaud , Yoann Potiron , Juste Raimbault

Patent analysis highly relies on concise and interpretable document representations, referred to as patent portraits. Keyphrases, both present and absent, are ideal candidates for patent portraits due to their brevity, representativeness,…

Computation and Language · Computer Science 2025-02-19 Xin Xia , Yujin Wang , Jun Zhou , Guisheng Zhong , Linning Cai , Chen Zhang

While language models (LMs) have shown potential across a range of decision-making tasks, their reliance on simple acting processes limits their broad deployment as autonomous agents. In this paper, we introduce Language Agent Tree Search…

Artificial Intelligence · Computer Science 2024-06-07 Andy Zhou , Kai Yan , Michal Shlapentokh-Rothman , Haohan Wang , Yu-Xiong Wang

Language models (LMs) now excel at many tasks such as few-shot learning, question answering, reasoning, and dialog. However, they sometimes generate unsupported or misleading content. A user cannot easily determine whether their outputs are…

PaECTER is an open-source document-level encoder specific for patents. We fine-tune BERT for Patents with examiner-added citation information to generate numerical representations for patent documents. PaECTER performs better in similarity…

Information Retrieval · Computer Science 2025-10-02 Mainak Ghosh , Michael E. Rose , Sebastian Erhardt , Erik Buunk , Dietmar Harhoff

Patent text embeddings enable prior art search, technology landscaping, and patent analysis, yet existing benchmarks inadequately capture patent-specific challenges. We introduce PatenTEB, a comprehensive benchmark comprising 15 tasks…

Computation and Language · Computer Science 2025-10-28 Iliass Ayaou , Denis Cavallucci

Retrieving mathematical knowledge is a central task in both human-driven research, such as determining whether a result already exists, finding related results, and identifying historical origins, and in emerging AI systems for mathematics,…

Information Retrieval · Computer Science 2026-04-21 Haocheng Ju , Leheng Chen , Peihao Wu , Bryan Dai , Bin Dong

Due to the swift growth of patent applications each year, information and multimedia retrieval approaches that facilitate patent exploration and retrieval are of utmost importance. Different types of visualizations (e.g., graphs, technical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Junaid Ahmed Ghauri , Eric Müller-Budack , Ralph Ewerth

This paper describes a new method to extract relevant keywords from patent claims, as part of the task of retrieving other patents with similar claims (search for prior art). The method combines a qualitative analysis of the writing style…

Information Retrieval · Computer Science 2019-06-19 Julien Rossi , Matthias Wirth , Evangelos Kanoulas

Comparative text mining extends from genre analysis and political bias detection to the revelation of cultural and geographic differences, through to the search for prior art across patents and scientific papers. These applications use…

Information Retrieval · Computer Science 2019-11-27 Julian Risch , Ralf Krestel