English
Related papers

Related papers: Efficient Retrieval Scaling with Hierarchical Inde…

200 papers

Embedding models have become essential tools in both natural language processing and computer vision, enabling efficient semantic search, recommendation, clustering, and more. However, the high memory and computational demands of…

Computation and Language · Computer Science 2024-11-26 Jiayi Chen , Chen Wu , Shaoqun Zhang , Nan Li , Liangjie Zhang , Qi Zhang

We propose a novel model for learned query optimization which provides query hints leading to better execution plans. The model addresses the three key challenges in learned hint-based query optimization: reliable hint recommendation…

Databases · Computer Science 2024-12-06 Sergey Zinchenko , Sergey Iazov

In this uncertain world, data uncertainty is inherent in many applications and its importance is growing drastically due to the rapid development of modern technologies. Nowadays, researchers have paid more attention to mine patterns in…

In order to learn quickly with few samples, meta-learning utilizes prior knowledge learned from previous tasks. However, a critical challenge in meta-learning is task uncertainty and heterogeneity, which can not be handled via globally…

Machine Learning · Computer Science 2019-11-19 Huaxiu Yao , Ying Wei , Junzhou Huang , Zhenhui Li

With the rapid growth of internet technologies, Web has become a huge repository of information and keeps growing exponentially under no editorial control. However the human capability to read, access and understand Web content remains…

Databases · Computer Science 2011-11-11 C. Ramesh , K. V. Chalapati Rao , A. Govardhan

The availability of large idea repositories (e.g., the U.S. patent database) could significantly accelerate innovation and discovery by providing people with inspiration from solutions to analogous problems. However, finding useful…

Computation and Language · Computer Science 2017-06-20 Tom Hope , Joel Chan , Aniket Kittur , Dafna Shahaf

Graph-based Retrieval-Augmented Generation (RAG) methods have significantly enhanced the performance of large language models (LLMs) in domain-specific tasks. However, existing RAG methods do not adequately utilize the naturally inherent…

Computation and Language · Computer Science 2025-09-29 Haoyu Huang , Yongfeng Huang , Junjie Yang , Zhenyu Pan , Yongqiang Chen , Kaili Ma , Hongzhi Chen , James Cheng

Hierarchical models are utilized in a wide variety of problems which are characterized by task hierarchies, where predictions on smaller subtasks are useful for trying to predict a final task. Typically, neural networks are first trained…

The ever-increasing size of language models curtails their widespread availability to the community, thereby galvanizing many companies into offering access to large language models through APIs. One particular type, suitable for dense…

Information Retrieval · Computer Science 2023-07-10 Ehsan Kamalloo , Xinyu Zhang , Odunayo Ogundepo , Nandan Thakur , David Alfonso-Hermelo , Mehdi Rezagholizadeh , Jimmy Lin

Model-based methods for recommender systems have been studied extensively in recent years. In systems with large corpus, however, the calculation cost for the learnt model to predict all user-item preferences is tremendous, which makes full…

Machine Learning · Statistics 2018-12-24 Han Zhu , Xiang Li , Pengye Zhang , Guozheng Li , Jie He , Han Li , Kun Gai

Effective training of deep neural networks can be challenging, and there remain many open questions on how to best learn these models. Recently developed methods to improve neural network training examine teaching: providing learned…

Machine Learning · Computer Science 2021-03-15 Aniruddh Raghu , Maithra Raghu , Simon Kornblith , David Duvenaud , Geoffrey Hinton

Neural models that independently project questions and answers into a shared embedding space allow for efficient continuous space retrieval from large corpora. Independently computing embeddings for questions and answers results in late…

Computation and Language · Computer Science 2020-09-30 Yinfei Yang , Ning Jin , Kuo Lin , Mandy Guo , Daniel Cer

We investigate the scalable image classification problem with a large number of categories. Hierarchical visual data structures are helpful for improving the efficiency and performance of large-scale multi-class classification. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Yanyun Qu , Li Lin , Fumin Shen , Chang Lu , Yang Wu , Yuan Xie , Dacheng Tao

Collaborative Filtering (CF) methods dominate real-world recommender systems given their ability to learn high-quality, sparse ID-embedding tables that effectively capture user preferences. These tables scale linearly with the number of…

Information Retrieval · Computer Science 2025-09-03 Donald Loveland , Xinyi Wu , Tong Zhao , Danai Koutra , Neil Shah , Mingxuan Ju

Classical search algorithms have long underpinned modern artificial intelligence. In this work, we tackle the challenge of inference-time control in diffusion models -- adapting generated outputs to meet diverse test-time objectives --…

Machine Learning · Computer Science 2025-10-07 Xiangcheng Zhang , Haowei Lin , Haotian Ye , James Zou , Jianzhu Ma , Yitao Liang , Yilun Du

Generative recommendation has recently emerged as a promising paradigm in information retrieval. However, generative ranking systems are still understudied, particularly with respect to their effectiveness and feasibility in large-scale…

Hierarchical reinforcement learning (RL) has the potential to enable effective decision-making over long timescales. Existing approaches, while promising, have yet to realize the benefits of large-scale training. In this work, we identify…

Machine Learning · Computer Science 2026-05-11 Mikael Henaff , Scott Fujimoto , Michael Matthews , Michael Rabbat

Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based…

Information Retrieval · Computer Science 2024-12-16 Hansa Meghwani

With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with…

Machine Learning · Computer Science 2020-12-14 Yang Yu , Zhenhao Gu , Rong Tao , Jingtian Ge , Kenglun Chang

Modern listwise recommendation systems need to consider both long-term user perceptions and short-term interest shifts. Reinforcement learning can be applied on recommendation to study such a problem but is also subject to large search…

Information Retrieval · Computer Science 2025-07-22 Luo Ji , Gao Liu , Mingyang Yin , Hongxia Yang , Jingren Zhou