中文
相关论文

相关论文: The Price of Prompting: Profiling Energy Use in La…

200 篇论文

Large language models (LLMs) are increasingly recognized for their exceptional generative capabilities and versatility across various tasks. However, the high inference costs associated with these models have not received adequate…

计算与语言 · 计算机科学 2025-03-18 Soham Poddar , Paramita Koley , Janardan Misra , Sanjay Podder , Niloy Ganguly , Saptarshi Ghosh

The rapid expansion of Large Language Models (LLMs) has introduced unprecedented energy demands, extending beyond training to large-scale inference workloads that often dominate total lifecycle consumption. Deploying these models requires…

人工智能 · 计算机科学 2025-11-11 Francisco Caravaca , Ángel Cuevas , Rubén Cuevas

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

软件工程 · 计算机科学 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos

Large Language Models (LLMs) have become widely used across various domains spanning search engines, code generation, and text creation. However, a major concern associated with their adoption is the high cost of inference, impacting both…

计算与语言 · 计算机科学 2026-04-28 Marta Adamska , Daria Smirnova , Hamid Nasiri , Zhengxin Yu , Peter Garraghan

The prevalence of Large Language Models (LLMs) is having an growing impact on the climate due to the substantial energy required for their deployment and use. To create awareness for developers who are implementing LLMs in their products,…

软件工程 · 计算机科学 2025-09-12 K. Pronk , Q. Zhao

Non-intrusive load monitoring (NILM) aims to disaggregate total electricity consumption into individual appliance usage, thus enabling more effective energy management. While deep learning has advanced NILM, it remains limited by its…

机器学习 · 计算机科学 2025-08-05 Junyu Xue , Xudong Wang , Xiaoling He , Shicheng Liu , Yi Wang , Guoming Tang

As large language models (LLMs) scale in size and adoption, their computational and environmental costs continue to rise. Prior benchmarking efforts have primarily focused on latency reduction in idealized settings, often overlooking the…

计算与语言 · 计算机科学 2025-04-25 Jared Fernandez , Clara Na , Vashisth Tiwari , Yonatan Bisk , Sasha Luccioni , Emma Strubell

The shift from cloud-hosted Large Language Models (LLMs) to locally deployed open-source Small Language Models (SLMs) has democratized AI-assisted coding; however, it has also decentralized the environmental footprint of AI. While prompting…

软件工程 · 计算机科学 2026-04-06 Md Afif Al Mamun , Sayan Nath , Gias Uddin , Novarun Deb

Reducing the environmental impact of AI-based software systems has become critical. The intensive use of large language models (LLMs) in software engineering poses severe challenges regarding computational resources, data centers, and…

软件工程 · 计算机科学 2025-10-13 Riccardo Rubei , Aicha Moussaid , Claudio di Sipio , Davide di Ruscio

Large language models (LLMs) have exhibited impressive abilities for multimodal content comprehension and reasoning with proper prompting in zero- or few-shot settings. Despite the proliferation of interactive systems developed to support…

人机交互 · 计算机科学 2024-10-01 Jianben He , Xingbo Wang , Shiyi Liu , Guande Wu , Claudio Silva , Huamin Qu

Recently, large language models (LLMs) have been successfully applied to many fields, showing outstanding comprehension and reasoning capabilities. Despite their great potential, LLMs usually require dedicated pre-training and fine-tuning…

网络与互联网体系结构 · 计算机科学 2024-12-31 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xi Chen , Hina Tabassum , Xue Liu

The increasing deployment of large language models (LLMs) in natural language processing (NLP) tasks raises concerns about energy efficiency and sustainability. While prior research has largely focused on energy consumption during model…

计算与语言 · 计算机科学 2026-04-22 Johannes Zschache , Tilman Hartwig

Machine learning (ML) is increasingly vital for smart-grid research, yet restricted access to realistic, diverse data - often due to privacy concerns - slows progress and fuels doubts within the energy sector about adopting ML-based…

计算与语言 · 计算机科学 2025-02-06 Mohannad Takrouri , Nicolás M. Cuadrado , Martin Takáč

Large language models (LLMs) have exploded in popularity due to their new generative capabilities that go far beyond prior state-of-the-art. These technologies are increasingly being leveraged in various domains such as law, finance, and…

The rapid adoption of large language models (LLMs) has led to significant advances in natural language processing and text generation. However, the energy consumed through LLM model inference remains a major challenge for sustainable AI…

分布式、并行与集群计算 · 计算机科学 2024-07-08 Grant Wilkins , Srinivasan Keshav , Richard Mortier

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

计算与语言 · 计算机科学 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

This study presents an empirical investigation into the energy consumption of Discriminative and Generative AI models within real-world MLOps pipelines. For Discriminative models, we examine various architectures and hyperparameters during…

机器学习 · 计算机科学 2025-04-01 Adrián Sánchez-Mompó , Ioannis Mavromatis , Peizheng Li , Konstantinos Katsaros , Aftab Khan

A significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is crucial. While several techniques exist for inference…

计算与语言 · 计算机科学 2025-07-01 Soham Poddar , Paramita Koley , Janardan Misra , Sanjay Podder , Navveen Balani , Niloy Ganguly , Saptarshi Ghosh

Language Models are increasingly applied in software engineering, yet their inference raises growing environmental concerns. Prior work has examined hardware choices and prompt length, but little attention has been paid to linguistic…

软件工程 · 计算机科学 2025-09-29 Vincenzo De Martino , Mohammad Amin Zadenoori , Xavier Franch , Alessio Ferrari

The widespread adoption of large language models (LLMs) such as ChatGPT, Gemini, and DeepSeek has significantly changed how people approach tasks in education, professional work, and creative domains. This paper investigates how the…

人机交互 · 计算机科学 2025-08-29 Rizal Khoirul Anam
‹ 上一页 1 2 3 10 下一页 ›