English
Related papers

Related papers: Resource Consumption Threats in Large Language Mod…

200 papers

Large language models (LLMs), based on transformer architectures, have revolutionized numerous domains within artificial intelligence, science, and engineering due to their exceptional scalability and adaptability. However, the exponential…

Hardware Architecture · Computer Science 2025-07-04 Wenzhe Guo , Joyjit Kundu , Uras Tos , Weijiang Kong , Giuliano Sisto , Timon Evenblij , Manu Perumkunnil

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

Software Engineering · Computer Science 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

Large Language Models (LLMs) as chatbots have drawn remarkable attention thanks to their versatile capability in natural language processing as well as in a wide range of tasks. While there has been great enthusiasm towards adopting such…

Systems and Control · Electrical Eng. & Systems 2024-06-24 Subir Majumder , Lin Dong , Fatemeh Doudi , Yuting Cai , Chao Tian , Dileep Kalathi , Kevin Ding , Anupam A. Thatte , Na Li , Le Xie

Large language models (LLMs) are central to modern natural language processing, delivering exceptional performance in various tasks. However, their substantial computational and memory requirements present challenges, especially for devices…

In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high performance. As models grow into the trillion-parameter range,…

Computation and Language · Computer Science 2024-09-10 Zhyar Rzgar K Rostam , Sándor Szénási , Gábor Kertész

Large language models (LLMs) represent significant breakthroughs in artificial intelligence and hold potential for applications within smart grids. However, as demonstrated in previous literature, AI technologies are susceptible to various…

Cryptography and Security · Computer Science 2025-04-22 Jiangnan Li , Yingyuan Yang , Jinyuan Sun

Large language models (LLMs) have achieved remarkable performance in language understanding and generation tasks by leveraging vast amounts of online texts. Unlike conventional models, LLMs can adapt to new domains through prompt…

Artificial Intelligence · Computer Science 2024-06-18 Ming Cheung

Large language models (LLMs) have demonstrated emergent abilities in text generation, question answering, and reasoning, facilitating various tasks and domains. Despite their proficiency in various tasks, LLMs like PaLM 540B and Llama-3.1…

Computation and Language · Computer Science 2024-12-31 Fali Wang , Zhiwei Zhang , Xianren Zhang , Zongyu Wu , Tzuhao Mo , Qiuhao Lu , Wanjing Wang , Rui Li , Junjie Xu , Xianfeng Tang , Qi He , Yao Ma , Ming Huang , Suhang Wang

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Large Language Model (LLM)-based systems, i.e. interconnected elements that include an LLM as a central component, such as conversational agents, are usually designed with monolithic, static architectures that rely on a single,…

Artificial Intelligence · Computer Science 2025-07-22 Clovis Varangot-Reille , Christophe Bouvard , Antoine Gourru , Mathieu Ciancone , Marion Schaeffer , François Jacquenet

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread…

Machine Learning · Computer Science 2023-08-31 Wentao Ye , Mingfeng Ou , Tianyi Li , Yipeng chen , Xuetao Ma , Yifan Yanggong , Sai Wu , Jie Fu , Gang Chen , Haobo Wang , Junbo Zhao

The increasing deployment of large language models (LLMs) in natural language processing (NLP) tasks raises concerns about energy efficiency and sustainability. While prior research has largely focused on energy consumption during model…

Computation and Language · Computer Science 2026-04-22 Johannes Zschache , Tilman Hartwig

Large Language Models (LLMs), due to substantial computational requirements, are vulnerable to resource consumption attacks, which can severely degrade server performance or even cause crashes, as demonstrated by denial-of-service (DoS)…

Cryptography and Security · Computer Science 2025-05-27 Yuanhe Zhang , Xinyue Wang , Haoran Gao , Zhenhong Zhou , Fanyu Meng , Yuyao Zhang , Sen Su

Large language models (LLMs) have advanced rapidly, emerging as versatile tools across fields thanks to their exceptional language understanding, generation, and reasoning capabilities. However, performing LLM inference at the network edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Zhixiong Chen , Bingjie Zhu , Jiangzhou Wang , Hyundong Shin , Arumugam Nallanathan , Dusit Niyato

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen

Large Language Models (LLMs) have gained considerable traction within the Software Engineering (SE) community, impacting various SE tasks from code completion to test generation, from program repair to code summarization. Despite their…

Software Engineering · Computer Science 2024-01-09 June Sallou , Thomas Durieux , Annibale Panichella

Accurate estimation of project costs and durations remains a pivotal challenge in software engineering, directly impacting budgeting and resource management. Traditional estimation techniques, although widely utilized, often fall short due…

Software Engineering · Computer Science 2024-09-17 Justin Carpenter , Chia-Ying Wu , Nasir U. Eisty

The rapid advancement of large language models (LLMs) has revolutionized artificial intelligence, introducing unprecedented capabilities in natural language processing and multimodal content generation. However, the increasing complexity…

Software Engineering · Computer Science 2024-11-27 Shenao Wang , Yanjie Zhao , Xinyi Hou , Haoyu Wang

Large language models (LLMs) have revolutionized the state-of-the-art of many different natural language processing tasks. Although serving LLMs is computationally and memory demanding, the rise of Small Language Models (SLMs) offers new…

Computation and Language · Computer Science 2025-08-11 Pol G. Recasens , Yue Zhu , Chen Wang , Eun Kyung Lee , Olivier Tardieu , Alaa Youssef , Jordi Torres , Josep Ll. Berral