English
Related papers

Related papers: NeuralSearchX: Serving a Multi-billion-parameter R…

200 papers

Neural Networks have become one of the most successful universal machine learning algorithms. They play a key role in enabling machine vision and speech recognition for example. Their computational complexity is enormous and comes along…

Hardware Architecture · Computer Science 2019-11-19 Michaela Blott , Lisa Halder , Miriam Leeser , Linda Doyle

Re-ranking plays a crucial role in modern information search systems by refining the ranking of initial search results to better satisfy user information needs. However, existing methods show two notable limitations in improving user search…

Information Retrieval · Computer Science 2026-05-14 Zihao Guo , Ligang Zhou , Zeyang Tang , Feicheng Li , Ying Nie , Zhiming Peng , Qingyun Sun , Jianxin Li

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

Information Retrieval · Computer Science 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

We study the behavior of several black-box search algorithms used for generating adversarial examples for natural language processing (NLP) tasks. We perform a fine-grained analysis of three elements relevant to search: search algorithm,…

Computation and Language · Computer Science 2020-10-14 Jin Yong Yoo , John X. Morris , Eli Lifland , Yanjun Qi

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

Recently, differentiable search methods have made major progress in reducing the computational costs of neural architecture search. However, these approaches often report lower accuracy in evaluating the searched architecture or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Xin Chen , Lingxi Xie , Jun Wu , Qi Tian

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Deep search agents powered by large language models have demonstrated strong capabilities in multi-step retrieval, reasoning, and long-horizon task execution. However, their practical failures often stem from the lack of mechanisms to…

Computation and Language · Computer Science 2026-02-02 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Jingxuan Yang , Haolang Lu , Jun Xu

This paper reviews, analyzes, and proposes a new perspective on the bi-encoder architecture for neural search. While the bi-encoder architecture is widely used due to its simplicity and scalability at test time, it has some notable issues…

Machine Learning · Computer Science 2025-12-29 Hung-Nghiep Tran , Akiko Aizawa , Atsuhiro Takasu

Although some recent works show potential complementarity among different state-of-the-art systems, few works try to investigate this problem in text summarization. Researchers in other areas commonly refer to the techniques of reranking or…

Computation and Language · Computer Science 2021-04-16 Yixin Liu , Zi-Yi Dou , Pengfei Liu

As the volume of electronically available information grows, relevant items become harder to find. This work presents an approach to personalizing search results in scientific publication databases. This work focuses on re-ranking search…

Information Retrieval · Computer Science 2015-09-09 Fredrik Nygård Carlsen

Conversational search systems enable information retrieval via natural language interactions, with the goal of maximizing users' information gain over multiple dialogue turns. The increasing prevalence of conversational interfaces adopting…

Computation and Language · Computer Science 2024-07-02 Phillip Schneider , Wessel Poelman , Michael Rovatsos , Florian Matthes

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

Machine Learning · Computer Science 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Inverted indexing has traditionally been a cornerstone of modern search systems, leveraging exact term matches to determine relevance between queries and documents. However, this term-based approach often emphasizes surface-level token…

Information Retrieval · Computer Science 2025-09-30 Zan Li , Jiahui Chen , Yuan Chai , Xiaoze Jiang , Xiaohua Qi , Zhiheng Qin , Runbin Zhou , Shun Zuo , Guangchao Hao , Kefeng Wang , Jingshan Lv , Yupeng Huang , Xiao Liang , Han Li

Major winning Convolutional Neural Networks (CNNs), such as AlexNet, VGGNet, ResNet, GoogleNet, include tens to hundreds of millions of parameters, which impose considerable computation and memory overhead. This limits their practical use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Seyyed Hossein Hasanpour , Mohammad Rouhani , Mohsen Fayyaz , Mohammad Sabokrou

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

Machine Learning · Computer Science 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Rank fusion is a powerful technique that allows multiple sources of information to be combined into a single result set. However, to date fusion has not been regarded as being cost-effective in cases where strict per-query efficiency…

Information Retrieval · Computer Science 2020-11-11 Rodger Benham , Joel Mackenzie , Alistair Moffat , J. Shane Culpepper

Existing neural relevance models do not give enough consideration for query and item context information which diversifies the search results to adapt for personal preference. To bridge this gap, this paper presents a neural learning…

Information Retrieval · Computer Science 2023-09-12 Deguang Kong , Daniel Zhou , Zhiheng Huang , Steph Sigalas