English
Related papers

Related papers: Comparative Study of Large Language Model Architec…

200 papers

Large Language Models (LLMs) have the potential to revolutionize the Sixth Generation (6G) communication networks. However, current mainstream LLMs generally lack the specialized knowledge in telecom domain. In this paper, for the first…

Signal Processing · Electrical Eng. & Systems 2024-07-15 Hang Zou , Qiyang Zhao , Yu Tian , Lina Bariah , Faouzi Bader , Thierry Lestable , Merouane Debbah

The use of large language models (LLMs) is expanding rapidly, and open-source versions are becoming available, offering users safer and more adaptable options. These models enable users to protect data privacy by eliminating the need to…

Machine Learning · Computer Science 2024-08-06 Hui Yin , Amir Aryani , Nakul Nambiar

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

The rapid advancement of large language models (LLMs) has led to significant breakthroughs in automated mathematical reasoning and scientific discovery. Georgiev, G${\'o}$mez-Serrano, Tao, and Wagner [GGSTW+25] demonstrate that AI systems…

Artificial Intelligence · Computer Science 2025-12-17 Yang Cao , Yubin Chen , Xuyang Guo , Zhao Song , Song Yue , Jiahao Zhang , Jiale Zhao

Large language models (LLMs) such as generative pretrained transformers (GPTs) have shown potential for various commercial applications, but their applicability for materials design remains underexplored. In this article, we introduce…

Materials Science · Physics 2024-07-02 Kamal Choudhary

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

In recent years, widespread internet adoption and the growth in userbase of various social media platforms have led to an increase in the proliferation of extreme speech online. While traditional language models have demonstrated…

Computation and Language · Computer Science 2025-02-24 Sarthak Mahajan , Nimmi Rangaswamy

In recent years, groundbreaking advancements in natural language processing have culminated in the emergence of powerful large language models (LLMs), which have showcased remarkable capabilities across a vast array of domains, including…

Computation and Language · Computer Science 2023-12-11 Microsoft Research AI4Science , Microsoft Azure Quantum

Large language models (LLMs) are rapidly transforming materials science. This review examines recent LLM applications across the materials discovery pipeline, focusing on three key areas: mining scientific literature , predictive modelling,…

Computation and Language · Computer Science 2025-11-17 Fengxu Yang , Weitong Chen , Jack D. Evans

Pre-trained large-scale language models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. However, the limited weight storage and computational speed on hardware platforms have impeded the…

Computation and Language · Computer Science 2020-10-23 Wei Niu , Zhenglun Kong , Geng Yuan , Weiwen Jiang , Jiexiong Guan , Caiwen Ding , Pu Zhao , Sijia Liu , Bin Ren , Yanzhi Wang

Large Language Models (LLMs) and, more specifically, the Generative Pre-Trained Transformers (GPT) can help stakeholders in climate action explore digital knowledge bases and extract and utilize climate action knowledge in a sustainable…

Computers and Society · Computer Science 2024-02-02 Denis Havlik , Marcelo Pias

High-quality textual training data is essential for the success of multimodal data processing tasks, yet outputs from image captioning models like BLIP and GIT often contain errors and anomalies that are difficult to rectify using…

Computation and Language · Computer Science 2025-02-25 Elyas Meguellati , Nardiena Pratama , Shazia Sadiq , Gianluca Demartini

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

The rapid development of large language models (LLM) has greatly enhanced everyday applications. While many FPGA-based accelerators, with flexibility for fine-grained data control, exhibit superior speed and energy efficiency compared to…

Hardware Architecture · Computer Science 2026-03-24 Zifan He , Shengyu Ye , Rui Ma , Yang Wang , Jason Cong

This paper examines the comparative effectiveness of a specialized compiled language model and a general-purpose model like OpenAI's GPT-3.5 in detecting SDGs within text data. It presents a critical review of Large Language Models (LLMs),…

Computation and Language · Computer Science 2023-07-31 Arash Hajikhani , Carolyn Cole

Even though large language models are becoming increasingly capable, it is still unreasonable to expect them to excel at tasks that are under-represented on the Internet. Leveraging LLMs for specialized applications, particularly in niche…

Machine Learning · Computer Science 2025-08-18 Brendan R. Hogan , Will Brown , Adel Boyarsky , Anderson Schneider , Yuriy Nevmyvaka

The integration of pretrained language models (PLMs) like BERT and GPT has revolutionized NLP, particularly for English, but it has also created linguistic imbalances. This paper strategically identifies the need for linguistic equity by…

Computation and Language · Computer Science 2025-03-19 Somnath Banerjee , Avik Halder , Rajarshi Mandal , Sayan Layek , Ian Soboroff , Rima Hazra , Animesh Mukherjee

The advent of ChatGPT and GPT-4 has captivated the world with large language models (LLMs), demonstrating exceptional performance in question-answering, summarization, and content generation. The aviation industry is characterized by an…

Computation and Language · Computer Science 2023-11-30 Liya Wang , Jason Chou , Xin Zhou , Alex Tien , Diane M Baumgartner

The integration of experiment technologies with large language models (LLMs) is transforming scientific research, offering AI capabilities beyond specialized problem-solving to becoming research assistants for human scientists. In power…

Systems and Control · Electrical Eng. & Systems 2024-11-21 Mengshuo Jia , Zeyu Cui , Gabriela Hug