English
Related papers

Related papers: Reversing Large Language Models for Efficient Trai…

200 papers

Training data plays a pivotal role in AI models. Large language models (LLMs) are trained with massive amounts of documents, and their parameters hold document-related contents. Recently, several studies identified content-specific…

Computation and Language · Computer Science 2024-06-25 Bumjin Park , Jaesik Choi

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

Large Language Models are growing in size, and we expect them to continue to do so, as larger models train quicker. However, this increase in size will severely impact inference costs. Therefore model compression is important, to retain the…

Machine Learning · Computer Science 2024-04-10 Georgy Tyukin

Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from…

Artificial Intelligence · Computer Science 2024-05-31 Ke Yi , Yuhui Xu , Heng Chang , Chen Tang , Yuan Meng , Tong Zhang , Jia Li

Pruning is a widely used technique to reduce the size and inference cost of large language models (LLMs), but it often causes performance degradation. To mitigate this, existing restoration methods typically employ parameter-efficient…

Machine Learning · Computer Science 2025-10-28 Zijian Feng , Hanzhang Zhou , Zixiao Zhu , Tianjiao Li , Jia Jim Deryl Chua , Lee Onn Mak , Gee Wah Ng , Kezhi Mao

The rapid expansion of Large Language Models (LLMs) has posed significant challenges regarding the computational resources required for fine-tuning and deployment. Recent advancements in low-rank adapters have demonstrated their efficacy in…

Machine Learning · Computer Science 2025-01-29 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

Computation and Language · Computer Science 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

Despite the impressive performance of large language models (LLMs), they often lag behind specialized models in various tasks. LLMs only use a fraction of the existing training data for in-context learning, while task-specific models…

Computation and Language · Computer Science 2024-02-02 Giorgos Vernikos , Arthur Bražinskas , Jakub Adamek , Jonathan Mallinson , Aliaksei Severyn , Eric Malmi

Large Language Models (LLMs) are now widely used for query reformulation and expansion in Information Retrieval, with many studies reporting substantial effectiveness gains. However, these results are typically obtained under heterogeneous…

Information Retrieval · Computer Science 2026-05-01 Amin Bigdeli , Radin Hamidi Rad , Hai Son Le , Mert Incesu , Negar Arabzadeh , Charles L. A. Clarke , Ebrahim Bagheri

Large language models (LLMs) have significantly advanced the field of natural language processing (NLP) through their extensive parameters and comprehensive data utilization. However, existing LLMs lack a dedicated memory unit, limiting…

Computation and Language · Computer Science 2024-10-25 Ali Modarressi , Ayyoob Imani , Mohsen Fayyaz , Hinrich Schütze

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models…

Computation and Language · Computer Science 2024-10-29 Zheng Zhao , Yftah Ziser , Shay B. Cohen

Large language models (LLM) are advanced AI systems trained on extensive textual data, leveraging deep learning techniques to understand and generate human-like language. Today's LLMs with billions of parameters are so huge that hardly any…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Sheikh Azizul Hakim , Saem Hasan

Recent studies have demonstrated that the performance of transformers on the task of language modeling obeys a power-law relationship with model size over six orders of magnitude. While transformers exhibit impressive scaling, their…

Machine Learning · Computer Science 2021-10-07 Narsimha Chilkuri , Eric Hunsberger , Aaron Voelker , Gurshaant Malik , Chris Eliasmith

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

Computation and Language · Computer Science 2026-04-08 Alexandros Christoforos

While Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities, their substantial computational and memory requirements pose significant barriers to practical deployment. Current parameter reduction techniques primarily…

Computation and Language · Computer Science 2025-07-29 Yiran Huang , Lukas Thede , Massimiliano Mancini , Wenjia Xu , Zeynep Akata

Fine-tuning with Reinforcement Learning with Human Feedback (RLHF) is essential for aligning large language models (LLMs). However, RLHF often encounters significant memory challenges. This study is the first to examine memory usage in the…

Machine Learning · Computer Science 2024-10-22 Jin Zhou , Hanmei Yang , Steven , Tang , Mingcan Xiang , Hui Guan , Tongping Liu

Hierarchical Multiscale LSTM (Chung et al., 2016a) is a state-of-the-art language model that learns interpretable structure from character-level input. Such models can provide fertile ground for (cognitive) computational linguistics…

Computation and Language · Computer Science 2018-07-11 Ákos Kádár , Marc-Alexandre Côté , Grzegorz Chrupała , Afra Alishahi

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Large language models (LLMs) have achieved remarkable advancements in natural language processing, showcasing exceptional performance across various tasks. However, the expensive memory and computational requirements present significant…

Artificial Intelligence · Computer Science 2025-11-13 Ruihao Gong , Yifu Ding , Zining Wang , Chengtao Lv , Xingyu Zheng , Jinyang Du , Haotong Qin , Jinyang Guo , Michele Magno , Xianglong Liu