English
Related papers

Related papers: Hardware Acceleration of LLMs: A comprehensive sur…

200 papers

Since the advent of GPT, large language models (LLMs) have brought about revolutionary advancements in all walks of life. As a superior natural language processing (NLP) technology, LLMs have consistently achieved state-of-the-art…

Networking and Internet Architecture · Computer Science 2024-06-26 Danshi Wang , Yidi Wang , Xiaotian Jiang , Yao Zhang , Yue Pang , Min Zhang

This paper investigates integrating large language models (LLMs) with advanced hardware, focusing on developing a general-purpose device designed for enhanced interaction with LLMs. Initially, we analyze the current landscape, where virtual…

Hardware Architecture · Computer Science 2024-08-21 Jiajun Xu , Qun Wang , Yuhang Cao , Baitao Zeng , Sicheng Liu

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

With the widespread adoption of Large Language Models (LLMs), the demand for high-performance LLM inference services continues to grow. To meet this demand, a growing number of AI accelerators have been proposed, such as Google TPU, Huawei…

Hardware Architecture · Computer Science 2025-10-08 Tianhao Zhu , Dahu Feng , Erhu Feng , Yubin Xia

Recent advances in code generation have illuminated the potential of employing large language models (LLMs) for general-purpose programming languages such as Python and C++, opening new opportunities for automating software development and…

Machine Learning · Computer Science 2025-03-06 Jiahao Gai , Hao Mark Chen , Zhican Wang , Hongyu Zhou , Wanru Zhao , Nicholas Lane , Hongxiang Fan

Large Language Models (LLMs) offer transformative potential for Modeling & Simulation (M&S) through natural language interfaces that simplify workflows. However, over-reliance risks compromising quality due to ambiguities, logical…

Software Engineering · Computer Science 2025-06-16 Philippe J. Giabbanelli , John Beverley , Istvan David , Andreas Tolk

Recent advancements in Large Language Models (LLMs) have transformed many fields including scientific discovery, content generation, biomedical text mining, and educational technology. However, the substantial requirements for training…

Machine Learning · Computer Science 2025-08-05 Yigit Turkmen , Baturalp Buyukates , Melih Bastopcu

Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster. However, training or…

Machine Learning · Computer Science 2024-05-03 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and…

The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.

Computation and Language · Computer Science 2025-02-25 Javier Conde , Miguel González , Pedro Reviriego , Zhen Gao , Shanshan Liu , Fabrizio Lombardi

Large Language Models (LLMs) have garnered considerable interest due to their impressive natural language capabilities, which in conjunction with various emergent properties make them versatile tools in workflows ranging from complex code…

Materials Science · Physics 2024-10-22 Ge Lei , Ronan Docherty , Samuel J. Cooper

Large Language Models (LLMs) are starting to be profiled as one of the most significant disruptions in the Software Testing field. Specifically, they have been successfully applied in software testing tasks such as generating test code, or…

Software Engineering · Computer Science 2025-09-30 Cristian Augusto , Antonia Bertolino , Guglielmo De Angelis , Francesca Lonetti , Jesús Morán

Large language models (LLMs) are powerful artificial intelligence (AI) tools transforming how research is conducted. However, their use in research has been met with skepticism, due to concerns about hallucinations, biases and potential…

Artificial Intelligence · Computer Science 2025-07-08 Ruian Ke , Ruy M. Ribeiro

Large language models (LLMs) have demonstrated remarkable potential in handling multilingual machine translation (MMT). In this paper, we systematically investigate the advantages and challenges of LLMs for MMT by answering two questions:…

Computation and Language · Computer Science 2024-06-17 Wenhao Zhu , Hongyi Liu , Qingxiu Dong , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Xingyu Wu , Sheng-hao Wu , Jibin Wu , Liang Feng , Kay Chen Tan

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

This paper provides a primer on Large Language Models (LLMs) and identifies their strengths, limitations, applications and research directions. It is intended to be useful to those in academia and industry who are interested in gaining an…

Computation and Language · Computer Science 2024-12-09 Sandra Johnson , David Hyland-Wood

The large set of technical documentation of legacy accelerator systems, coupled with the retirement of experienced personnel, underscores the urgent need for efficient methods to preserve and transfer specialized knowledge. This paper…

Information Retrieval · Computer Science 2025-09-03 Qing Dai , Rasmus Ischebeck , Maruisz Sapinski , Adam Grycner

Transformers have revolutionized the machine learning landscape, gradually making their way into everyday tasks and equipping our computers with "sparks of intelligence". However, their runtime requirements have prevented them from being…

Machine Learning · Computer Science 2024-07-29 Stefanos Laskaridis , Kleomenis Katevas , Lorenzo Minto , Hamed Haddadi

Academic paper review typically requires substantial time, expertise, and human resources. Large Language Models (LLMs) present a promising method for automating the review process due to their extensive training data, broad knowledge base,…

Computers and Society · Computer Science 2025-06-24 Chuanlei Li , Xu Hu , Minghui Xu , Kun Li , Yue Zhang , Xiuzhen Cheng