English
Related papers

Related papers: CoSpaDi: Compressing LLMs via Calibration-Guided S…

200 papers

Large Language Models (LLMs), with billions of parameters, present significant challenges for full finetuning due to the high computational demands, memory requirements, and impracticality of many real-world applications. When faced with…

Machine Learning · Computer Science 2024-12-18 Jonathan Svirsky , Yehonathan Refael , Ofir Lindenbaum

Large language models (LLMs) can now solve complex problems through long chain-of-thought (CoT) reasoning, but the trade-off between performance and token cost remains a central challenge. To address this issue, supervised fine-tuning (SFT)…

Artificial Intelligence · Computer Science 2026-05-28 Kohsei Matsutani , Gouki Minegishi , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

In recent years, compression of large language models (LLMs) has emerged as an important problem to enable language model deployment on resource-constrained devices, reduce computational costs, and mitigate the environmental footprint of…

Machine Learning · Computer Science 2024-10-04 Sean I. Young

Dictionary learning and sparse representation (DLSR) is a recent and successful mathematical model for data representation that achieves state-of-the-art performance in various fields such as pattern recognition, machine learning, computer…

Computer Vision and Pattern Recognition · Computer Science 2015-02-23 Mehrdad J. Gangeh , Ahmed K. Farahat , Ali Ghodsi , Mohamed S. Kamel

Learned sparse retrieval (LSR) is a family of neural methods that encode queries and documents into sparse lexical vectors that can be indexed and retrieved efficiently with an inverted index. We explore the application of LSR to the…

Information Retrieval · Computer Science 2024-02-28 Thong Nguyen , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

Modern large-scale Pre-trained Language Models (PLMs) have achieved tremendous success on a wide range of downstream tasks. However, most of the LM pre-training objectives only focus on text reconstruction, but have not sought to learn…

Computation and Language · Computer Science 2022-10-28 Liliang Ren , Zixuan Zhang , Han Wang , Clare R. Voss , Chengxiang Zhai , Heng Ji

We propose SPARC, a lightweight continual learning framework for large language models (LLMs) that enables efficient task adaptation through prompt tuning in a lower-dimensional space. By leveraging principal component analysis (PCA), we…

Machine Learning · Computer Science 2025-02-06 Dinithi Jayasuriya , Sina Tayebati , Davide Ettori , Ranganath Krishnan , Amit Ranjan Trivedi

Deep learning models have become state of the art for natural language processing (NLP) tasks, however deploying these models in production system poses significant memory constraints. Existing compression methods are either lossy or…

Machine Learning · Computer Science 2018-11-05 Anish Acharya , Rahul Goel , Angeliki Metallinou , Inderjit Dhillon

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

In this paper, we investigate the impact of compression on stochastic gradient algorithms for machine learning, a technique widely used in distributed and federated learning. We underline differences in terms of convergence rates between…

Machine Learning · Computer Science 2025-07-25 Constantin Philippenko , Aymeric Dieuleveut

Generalization abilities of well-trained large language models (LLMs) are known to scale predictably as a function of model size. In contrast to the existence of practical scaling laws governing pre-training, the quality of LLMs after…

Machine Learning · Computer Science 2024-12-09 Zifei Xu , Alexander Lan , Wanzin Yazar , Tristan Webb , Sayeh Sharify , Xin Wang

As large language models (LLMs) continue to grow in size and complexity, efficient checkpoint saving\&loading has become crucial for managing storage, memory usage, and fault tolerance in LLM training. The current works do not…

Machine Learning · Computer Science 2025-11-19 Yanxin Peng , Qingping Li , Baodong Wu , Shigang Li , Guohao Dai , Shengen Yan , Yu Wang

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

Pre-trained Language Models (PLMs) have achieved great success in various Natural Language Processing (NLP) tasks under the pre-training and fine-tuning paradigm. With large quantities of parameters, PLMs are computation-intensive and…

Computation and Language · Computer Science 2021-12-15 Runxin Xu , Fuli Luo , Chengyu Wang , Baobao Chang , Jun Huang , Songfang Huang , Fei Huang

Large language models (LLMs) excel at reasoning tasks but are expensive to deploy. Thus small language models (SLMs) are fine-tuned on CoT data generated by LLMs to copy LLMs' abilities. However, these CoT data may include noisy rationales…

Computation and Language · Computer Science 2025-09-10 Hongyan Xie , Yitong Yao , Yikun Ban , Zixuan Huang , Deqing Wang , Zhenhe Wu , Haoxiang Su , Chao Wang , Shuangyong Song

Large Language Models' (LLMs) weight matrices can often be expressed in low-rank form with potential to relax memory and compute resource requirements. Unlike prior efforts that focus on developing novel matrix decompositions, in this work…

Machine Learning · Computer Science 2025-06-10 Ajay Jaiswal , Yifan Wang , Lu Yin , Shiwei Liu , Runjin Chen , Jiawei Zhao , Ananth Grama , Yuandong Tian , Zhangyang Wang

Large language models (LLMs) show excellent performance in difficult tasks, but they often require massive memories and computational resources. How to reduce the parameter scale of LLMs has become research hotspots. In this study, we make…

Machine Learning · Computer Science 2024-04-16 Guangyan Li , Yongqiang Tang , Wensheng Zhang

Data Parallelism (DP), Tensor Parallelism (TP), and Pipeline Parallelism (PP) are the three strategies widely adopted to enable fast and efficient Large Language Model (LLM) training. However, these approaches rely on data-intensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-05 Lang Xu , Quentin Anthony , Qinghua Zhou , Nawras Alnaasan , Radha R. Gulhane , Aamir Shafi , Hari Subramoni , Dhabaleswar K. Panda

Deep-learning (DL)-based precoding in multi-user multiple-input single-output (MU-MISO) systems involves training DL models to map features derived from channel coefficients to labels derived from precoding weights. Traditionally,…

Machine Learning · Computer Science 2026-03-10 Zaid Abdullah , Merouane Debbah , Symeon Chatzinotas , Bjorn Ottersten

Despite the increasing prevalence of large language models (LLMs), we still have a limited understanding of how their representational spaces are structured. This limits our ability to interpret how and what they learn or relate them to…