English
Related papers

Related papers: COPR -- Efficient, large-scale log storage and ret…

200 papers

Dense Retrieval (DR) has achieved state-of-the-art first-stage ranking effectiveness. However, the efficiency of most existing DR models is limited by the large memory cost of storing dense vectors and the time-consuming nearest neighbor…

Information Retrieval · Computer Science 2021-10-13 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

The goal of high-utility sequential pattern mining (HUSPM) is to efficiently discover profitable or useful sequential patterns in a large number of sequences. However, simply being aware of utility-eligible patterns is insufficient for…

Artificial Intelligence · Computer Science 2022-10-28 Lili Chen , Wensheng Gan , Chien-Ming Chen

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

This work addresses the problem of billion-scale nearest neighbor search. The state-of-the-art retrieval systems for billion-scale databases are currently based on the inverted multi-index, the recently proposed generalization of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Dmitry Baranchuk , Artem Babenko , Yury Malkov

Tasks critical to enterprise profitability, such as customer churn prediction, fraudulent account detection or customer lifetime value estimation, are often tackled by models trained on features engineered from customer data in tabular…

Machine Learning · Computer Science 2022-11-30 Pin-Jung Chen , Sahil Bhatnagar , Sagar Goyal , Damian Konrad Kowalczyk , Mayank Shrivastava

Learned sparse retrieval (LSR) is a family of neural methods that encode queries and documents into sparse lexical vectors that can be indexed and retrieved efficiently with an inverted index. We explore the application of LSR to the…

Information Retrieval · Computer Science 2024-02-28 Thong Nguyen , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

Retrieval-augmented language models can better adapt to changes in world state and incorporate long-tail knowledge. However, most existing methods retrieve only short contiguous chunks from a retrieval corpus, limiting holistic…

Computation and Language · Computer Science 2024-02-01 Parth Sarthi , Salman Abdullah , Aditi Tuli , Shubh Khanna , Anna Goldie , Christopher D. Manning

Large Language Model agents often retrieve context from knowledge bases that lack structural consistency with the agent's current reasoning state, leading to incoherent reasoning chains. We introduce Path-Constrained Retrieval (PCR), a…

Computation and Language · Computer Science 2025-11-25 Joseph Oladokun

Modern very large-scale integration (VLSI) design requires the implementation of integrated circuits using electronic design automation (EDA) tools. Due to the complexity of EDA algorithms, the vast parameter space poses a huge challenge to…

Machine Learning · Computer Science 2025-08-25 Jingyu Pan , Isaac Jacobson , Zheng Zhao , Tung-Chieh Chen , Guanglei Zhou , Chen-Chia Chang , Vineet Rashingkar , Yiran Chen

A common problem in large-scale data analysis is to approximate a matrix using a combination of specifically sampled rows and columns, known as CUR decomposition. Unfortunately, in many real-world environments, the ability to sample…

Machine Learning · Statistics 2018-07-10 Urvashi Oswal , Swayambhoo Jain , Kevin S. Xu , Brian Eriksson

Compressive learning is an emerging approach to drastically reduce the memory footprint of large-scale learning, by first summarizing a large dataset into a low-dimensional sketch vector, and then decoding from this sketch the latent…

Machine Learning · Computer Science 2024-06-18 Ayoub Belhadji , Rémi Gribonval

Erasure codes are an integral part of many distributed storage systems aimed at Big Data, since they provide high fault-tolerance for low overheads. However, traditional erasure codes are inefficient on reading stored data in degraded…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-27 Kyumars Sheykh Esmaili , Lluis Pamies-Juarez , Anwitaman Datta

The paper proposes and optimizes a partial recovery training system, CPR, for recommendation models. CPR relaxes the consistency requirement by enabling non-failed nodes to proceed without loading checkpoints when a node fails during…

We propose an information-theoretic private information retrieval (PIR) scheme for distributed storage systems where data is stored using a linear systematic code of rate $R > 1/2$. The proposed scheme generalizes the PIR scheme for data…

Information Theory · Computer Science 2017-05-31 Siddhartha Kumar , Eirik Rosnes , Alexandre Graell i Amat

The CUR decomposition is a technique for low-rank approximation that selects small subsets of the columns and rows of a given matrix to use as bases for its column and rowspaces. It has recently attracted much interest, as it has several…

Numerical Analysis · Mathematics 2022-06-06 Yijun Dong , Per-Gunnar Martinsson

Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of automated log analysis. However, existing log parsers are…

Software Engineering · Computer Science 2026-03-16 Yifan Wu , Bingxu Chai , Siyu Yu , Ying Li , Pinjia He , Wei Jiang , Jianguo Li

Composed Image Retrieval (CoIR) has recently gained popularity as a task that considers both text and image queries together, to search for relevant images in a database. Most CoIR approaches require manually annotated datasets, comprising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lucas Ventura , Antoine Yang , Cordelia Schmid , Gül Varol

In the era of extensive data growth, robust and efficient mechanisms are needed to store and manage vast amounts of digital information, such as Data Storage Systems (DSSs). Concurrently, privacy concerns have arisen, leading to the…

Quantum Physics · Physics 2023-12-14 Matteo Allaix

Learned sparse retrieval (LSR) is a popular method for first-stage retrieval because it combines the semantic matching of language models with efficient CPU-friendly algorithms. Previous work aggregates blocks into "superblocks" to quickly…

Information Retrieval · Computer Science 2026-02-04 Parker Carlson , Wentai Xie , Rohil Shah , Tao Yang

Multi-message private information retrieval (MPIR) is an interesting variation of PIR which allows a user to download multiple messages from the database without revealing the identity of the desired messages. Obviously, the user can…

Information Theory · Computer Science 2018-08-08 Chatdanai Dorkson , Siaw-Lynn Ng