English
Related papers

Related papers: Beyond Two-Tower Matching: Learning Sparse Retriev…

200 papers

Related video recommendations commonly use collaborative filtering (CF) driven by co-engagement signals, often resulting in recommendations lacking semantic coherence and exhibiting strong popularity bias. This paper introduces a novel…

Information Retrieval · Computer Science 2025-07-15 Amit Jaspal , Feng Zhang , Wei Chang , Sumit Kumar , Yubo Wang , Roni Mittleman , Qifan Wang , Weize Mao

Work on retrieval-based chatbots, like most sequence pair matching tasks, can be divided into Cross-encoders that perform word matching over the pair, and Bi-encoders that encode the pair separately. The latter has better performance,…

Computation and Language · Computer Science 2019-11-07 Amir Vakili Tahami , Azadeh Shakery

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is performed by solving an L1-regularized linear regression problem, commonly referred to as Lasso or Basis Pursuit. In this…

Machine Learning · Statistics 2015-05-19 Pablo Sprechmann , Ignacio Ramírez , Guillermo Sapiro , Yonina Eldar

Sparse training is often adopted in cross-device federated learning (FL) environments where constrained devices collaboratively train a machine learning model on private data by exchanging pseudo-gradients across heterogeneous networks.…

Machine Learning · Computer Science 2025-04-08 Adriano Guastella , Lorenzo Sani , Alex Iacob , Alessio Mora , Paolo Bellavista , Nicholas D. Lane

Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are very computationally intensive and reach the hardware limit…

Machine Learning · Computer Science 2020-04-28 Fei Sun , Minghai Qin , Tianyun Zhang , Liu Liu , Yen-Kuang Chen , Yuan Xie

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

In this paper, we propose a new unsupervised feature learning framework, namely Deep Sparse Coding (DeepSC), that extends sparse coding to a multi-layer architecture for visual object recognition tasks. The main innovation of the framework…

Machine Learning · Computer Science 2013-12-23 Yunlong He , Koray Kavukcuoglu , Yun Wang , Arthur Szlam , Yanjun Qi

The inference process for large language models is slow and memory-intensive, with one of the most critical bottlenecks being excessive Key-Value (KV) cache accesses. This paper introduces "Double Sparsity," a novel post-training sparse…

Machine Learning · Computer Science 2024-08-20 Shuo Yang , Ying Sheng , Joseph E. Gonzalez , Ion Stoica , Lianmin Zheng

Given its effectiveness on knowledge-intensive natural language processing tasks, dense retrieval models have become increasingly popular. Specifically, the de-facto architecture for open-domain question answering uses two isomorphic…

Computation and Language · Computer Science 2023-05-24 Hao Cheng , Hao Fang , Xiaodong Liu , Jianfeng Gao

Software designers and developers are increasingly relying on application frameworks as first-class design concepts. They instantiate the services that frameworks provide to implement various architectural tactics and patterns. One of the…

Software Engineering · Computer Science 2021-05-18 Ali Shokri , Joanna C. S. Santos , Mehdi Mirakhorli

We consider the problem of recovering two-dimensional (2-D) block-sparse signals with \emph{unknown} cluster patterns. Two-dimensional block-sparse patterns arise naturally in many practical applications such as foreground detection and…

Information Theory · Computer Science 2016-05-25 Jun Fang , Lizao Zhang , Hongbin Li

To achieve greater accuracy, hypergraph matching algorithms require exponential increases in computational resources. Recent kd-tree-based approximate nearest neighbor (ANN) methods, despite the sparsity of their compatibility tensor, still…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Qixuan Zheng , Ming Zhang , Hong Yan

In this paper, we present Wandercode, a novel interaction design for recommender systems that recommend code locations to aid programmers in software development tasks. In particular, our design aims to improve upon prior designs by…

Human-Computer Interaction · Computer Science 2024-08-28 Austin Z. Henley , David Shepherd , Scott D. Fleming

High-entropy alloys have attracted attention for their exceptional mechanical properties and thermal stability. However, the combinatorial explosion in the number of possible elemental compositions renders traditional trial-and-error…

Materials Science · Physics 2025-04-30 Ryo Murakami , Seiji Miura , Akihiro Endo , Satoshi Minamoto

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately.…

Methodology · Statistics 2023-08-11 Snigdha Panigrahi , Natasha Stewart , Chandra Sekhar Sripada , Elizaveta Levina

In recent years, a lot of attention has been devoted to efficient nearest neighbor search by means of similarity-preserving hashing. One of the plights of existing hashing techniques is the intrinsic trade-off between performance and…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Jonathan Masci , Alex M. Bronstein , Michael M. Bronstein , Pablo Sprechmann , Guillermo Sapiro

Text relevance or text matching of query and product is an essential technique for the e-commerce search system to ensure that the displayed products can match the intent of the query. Many studies focus on improving the performance of the…

Information Retrieval · Computer Science 2024-07-15 Zhe Lin , Jiwei Tan , Dan Ou , Xi Chen , Shaowei Yao , Bo Zheng

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Interactions between search and recommendation have recently attracted significant attention, and several studies have shown that many potential applications involve with a joint problem of producing recommendations to users with respect to…

Information Retrieval · Computer Science 2014-12-15 Lu Yu , Junming Huang , Chuang Liu , Zike Zhang