English
Related papers

Related papers: BMX: Entropy-weighted Similarity and Semantic-enha…

200 papers

Mainframe operating systems, despite their inception in the 1940s, continue to support critical sectors like finance and government. However, these systems are often viewed as outdated, requiring extensive maintenance and modernization.…

Computation and Language · Computer Science 2024-08-27 Anh T. V. Dau , Hieu Trung Dao , Anh Tuan Nguyen , Hieu Trung Tran , Phong X. Nguyen , Nghi D. Q. Bui

In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for…

We present a new approach for benchmarking Large Language Model (LLM) capabilities on research-level mathematics. Existing benchmarks largely rely on static, hand-curated sets of contest or textbook-style problems as proxies for…

Artificial Intelligence · Computer Science 2026-03-02 Antoine Peyronnet , Fabian Gloeckle , Amaury Hayat

Large Language Models (LLMs) have long held sway in the realms of artificial intelligence research. Numerous efficient techniques, including weight pruning, quantization, and distillation, have been embraced to compress LLMs, targeting…

Artificial Intelligence · Computer Science 2024-11-01 Xuan Shen , Pu Zhao , Yifan Gong , Zhenglun Kong , Zheng Zhan , Yushu Wu , Ming Lin , Chao Wu , Xue Lin , Yanzhi Wang

Large language models (LLMs) encode a large amount of world knowledge. However, as such knowledge is frozen at the time of model training, the models become static and limited by the training data at that time. In order to further improve…

Computation and Language · Computer Science 2023-05-25 Junyi Li , Tianyi Tang , Wayne Xin Zhao , Jingyuan Wang , Jian-Yun Nie , Ji-Rong Wen

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Large Language Models (LLMs) are now widely used for query reformulation and expansion in Information Retrieval, with many studies reporting substantial effectiveness gains. However, these results are typically obtained under heterogeneous…

Information Retrieval · Computer Science 2026-05-01 Amin Bigdeli , Radin Hamidi Rad , Hai Son Le , Mert Incesu , Negar Arabzadeh , Charles L. A. Clarke , Ebrahim Bagheri

Text embedding has become a foundational technology in natural language processing (NLP) during the deep learning era, driving advancements across a wide array of downstream tasks. While many natural language understanding challenges can…

Computation and Language · Computer Science 2025-10-22 Zhijie Nie , Zhangchi Feng , Mingxin Li , Cunwang Zhang , Yanzhao Zhang , Dingkun Long , Richong Zhang

Extreme Classification (XC) aims to map a query to the most relevant documents from a very large document set. XC algorithms used in real-world applications learn this mapping from datasets curated from implicit feedback, such as user…

Knowledge Bases (KBs) are easy to query, verifiable, and interpretable. They however scale with man-hours and high-quality data. Masked Language Models (MLMs), such as BERT, scale with computing power as well as unstructured raw text data.…

Computation and Language · Computer Science 2020-09-16 Louis Clouatre , Philippe Trempe , Amal Zouaq , Sarath Chandar

Learned sparse retrieval systems aim to combine the effectiveness of contextualized language models with the scalability of conventional data structures such as inverted indexes. Nevertheless, the indexes generated by these systems exhibit…

Information Retrieval · Computer Science 2024-05-03 Antonio Mallia , Torten Suel , Nicola Tonellotto

Recently, InPars introduced a method to efficiently use large language models (LLMs) in information retrieval tasks: via few-shot examples, an LLM is induced to generate relevant queries for documents. These synthetic query-document pairs…

Information Retrieval · Computer Science 2023-05-30 Vitor Jeronymo , Luiz Bonifacio , Hugo Abonizio , Marzieh Fadaee , Roberto Lotufo , Jakub Zavrel , Rodrigo Nogueira

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

High-quality datasets are typically required for accomplishing data-driven tasks, such as training medical diagnosis models, predicting real-time traffic conditions, or conducting experiments to validate research hypotheses. Consequently,…

Information Retrieval · Computer Science 2025-09-03 Pengyue Li , Sheng Wang , Hua Dai , Zhiyu Chen , Zhifeng Bao , Brian D. Davison

While dense retrieval models, which embed queries and documents into a shared low-dimensional space, have gained widespread popularity, they were shown to exhibit important theoretical limitations and considerably lag behind traditional…

Information Retrieval · Computer Science 2026-04-09 Adrian Bracher , Svitlana Vakulenko

In this paper we propose a novel approach for combining first-stage lexical retrieval models and Transformer-based re-rankers: we inject the relevance score of the lexical model as a token in the middle of the input of the cross-encoder…

Information Retrieval · Computer Science 2023-01-25 Arian Askari , Amin Abolghasemi , Gabriella Pasi , Wessel Kraaij , Suzan Verberne

Large Language Models (LLMs) are gearing up to surpass human creativity. The veracity of the statement needs careful consideration. In recent developments, critical questions arise regarding the authenticity of human work and the…

Computation and Language · Computer Science 2025-09-29 Sai Teja Lekkala , Yadagiri Annepaka , Arun Kumar Challa , Samatha Reddy Machireddy , Partha Pakray , Chukhu Chunka

The conventional natural language processing approaches are not accustomed to the social media text due to colloquial discourse and non-homogeneous characteristics. Significantly, the language identification in a multilingual document is…

Computation and Language · Computer Science 2021-06-30 M Zeeshan Ansari , Tanvir Ahmad , M M Sufyan Beg , Asma Ikram

Retrieving code functions, classes or files that are relevant in order to solve a given user query, bug report or feature request from large codebases is a fundamental challenge for Large Language Model (LLM)-based coding agents. Agentic…

Software Engineering · Computer Science 2026-02-09 Shravan Chaudhari , Rahul Thomas Jacob , Mononito Goswami , Jiajun Cao , Shihab Rashid , Christian Bock

Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in…

Computation and Language · Computer Science 2024-06-24 Yue Huang , Chenrui Fan , Yuan Li , Siyuan Wu , Tianyi Zhou , Xiangliang Zhang , Lichao Sun