English
Related papers

Related papers: Beyond Matryoshka: Revisiting Sparse Coding for Ad…

200 papers

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

Recent breakthrough results in compressed sensing (CS) have established that many high dimensional objects can be accurately recovered from a relatively small number of non- adaptive linear projection observations, provided that the objects…

Machine Learning · Statistics 2011-11-30 Akshay Soni , Jarvis Haupt

Pre-trained large models attract widespread attention in recent years, but they face challenges in applications that require high interpretability or have limited resources, such as physical sensing, medical imaging, and bioinformatics.…

Machine Learning · Computer Science 2025-01-24 Chaoqing Tang , Huanze Zhuang , Guiyun Tian , Zhenli Zeng , Yi Ding , Wenzhong Liu , Xiang Bai

Multimodal Large Language Models (MLLMs) have shown remarkable success in comprehension tasks such as visual description and visual question answering. However, their direct application to embedding-based tasks like retrieval remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lihao Liu , Yan Wang , Biao Yang , Da Li , Jiangxia Cao , Yuxiao Luo , Xiang Chen , Xiangyu Wu , Wei Yuan , Fan Yang , Guiguang Ding , Tingting Gao , Guorui Zhou

Subspace clustering and feature extraction are two of the most commonly used unsupervised learning techniques in computer vision and pattern recognition. State-of-the-art techniques for subspace clustering make use of recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2012-04-18 Risheng Liu , Zhouchen Lin , Fernando De la Torre , Zhixun Su

Recently, large language models (LLMs) have emerged as a groundbreaking technology and their unparalleled text generation capabilities have sparked interest in their application to the fundamental sentence representation learning task.…

Computation and Language · Computer Science 2024-05-20 Huiming Wang , Zhaodonghui Li , Liying Cheng , Soh De Wen , Lidong Bing

Sparse matrix-vector multiplication (SpMV) is a fundamental building block for numerous applications. In this paper, we propose CSR5 (Compressed Sparse Row 5), a new storage format, which offers high-throughput SpMV on various platforms…

Mathematical Software · Computer Science 2015-04-13 Weifeng Liu , Brian Vinter

Recent progress in scaling large models has motivated recommender systems to increase model depth and capacity to better leverage massive behavioral data. However, recommendation inputs are high-dimensional and extremely sparse, and simply…

Information Retrieval · Computer Science 2026-04-23 Yantao Yu , Sen Qiao , Lei Shen , Bing Wang , Xiaoyi Zeng

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{MCR}^2$), an information-theoretic measure that maximizes the…

Machine Learning · Computer Science 2020-06-16 Yaodong Yu , Kwan Ho Ryan Chan , Chong You , Chaobing Song , Yi Ma

Speaker adaptation, which involves cloning voices from unseen speakers in the Text-to-Speech task, has garnered significant interest due to its numerous applications in multi-media fields. Despite recent advancements, existing methods often…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Ruibo Fu , Xin Qi , Zhengqi Wen , Jianhua Tao , Tao Wang , Chunyu Qiang , Zhiyong Wang , Yi Lu , Xiaopeng Wang , Shuchen Shi , Yukun Liu , Xuefei Liu , Shuai Zhang

The use of episodic memory in continual learning has demonstrated effectiveness for alleviating catastrophic forgetting. In recent studies, gradient-based approaches have been developed to make more efficient use of compact episodic memory.…

Machine Learning · Statistics 2022-04-15 Yu Chen , Tom Diethe , Peter Flach

Classification methods based on sparse estimation have drawn much attention recently, due to their effectiveness in processing high-dimensional data such as images. In this paper, a method to improve the performance of a sparse…

Machine Learning · Statistics 2018-10-24 Babak Barazandeh , Mohammadhussein Rafieisakhaei , Sunwook Kim , Zhenyu , Kong , Maury A. Nussbaum

Classifiers based on sparse representations have recently been shown to provide excellent results in many visual recognition and classification tasks. However, the high cost of computing sparse representations at test time is a major…

Computer Vision and Pattern Recognition · Computer Science 2014-10-03 Alhussein Fawzi , Mike Davies , Pascal Frossard

Sparse learning has been shown to be effective in solving many real-world problems. Finding sparse representations is a fundamentally important topic in many fields of science including signal processing, computer vision, genome study and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jun Cheng

Over the past decade, the celebrated sparse representation model has achieved impressive results in various signal and image processing tasks. A convolutional version of this model, termed convolutional sparse coding (CSC), has been…

Signal Processing · Electrical Eng. & Systems 2018-10-03 Ives Rey-Otero , Jeremias Sulam , Michael Elad

To better select the correct training sample and obtain the robust representation of the query sample, this paper proposes a discriminant-based sparse optimization learning model. This learning model integrates discriminant and sparsity…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Qingxiang Feng , Yicong Zhou

Sparse representation-based classification (SRC), proposed by Wright et al., seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class. Because it assumes…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Chelsea Weaver , Naoki Saito

As a result of several successful applications in computer vision and image processing, sparse representation (SR) has attracted significant attention in multi-sensor image fusion. Unlike the traditional multiscale transforms (MSTs) that…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Qiang Zhang , Yi Liu , Rick S. Blum , Jungong Han , Dacheng Tao

Face recognition (FR) is an important task in pattern recognition and computer vision. Sparse representation (SR) has been demonstrated to be a powerful framework for FR. In general, an SR algorithm treats each face in a training dataset as…

Computer Vision and Pattern Recognition · Computer Science 2013-09-19 Taiyong Li , Zhilin Zhang

Similarity analysis is one of the crucial steps in most fMRI studies. Representational Similarity Analysis (RSA) can measure similarities of neural signatures generated by different cognitive states. This paper develops Deep…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Muhammad Yousefnezhad , Jeffrey Sawalha , Alessandro Selvitella , Daoqiang Zhang