English
Related papers

Related papers: A Survey on Large Language Models from Concept to …

200 papers

Significant advancements have been made in one of the most critical branches of artificial intelligence: natural language processing (NLP). These advancements are exemplified by the remarkable success of OpenAI's GPT-3.5/4 and the recent…

Materials Science · Physics 2025-04-22 Zongrui Pei , Junqi Yin , Jiaxin Zhang

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by automating traditional labor-intensive tasks and consequently accelerated the development of computer-aided applications. As researchers…

Computation and Language · Computer Science 2025-06-24 Summra Saleem , Muhammad Nabeel Asim , Shaista Zulfiqar , Andreas Dengel

Language modeling has seen impressive progress over the last years, mainly prompted by the invention of the Transformer architecture, sparking a revolution in many fields of machine learning, with breakthroughs in chemistry and biology. In…

Machine Learning · Computer Science 2023-10-11 Andres M Bran , Philippe Schwaller

Recent advancements in Large Language Models (LLMs), such as ChatGPT and LLaMA, have significantly transformed Natural Language Processing (NLP) with their outstanding abilities in text generation, summarization, and classification.…

Computation and Language · Computer Science 2024-08-12 Md Nazmus Sakib , Md Athikul Islam , Royal Pathak , Md Mashrur Arifin

This paper explores the use of Large Language Models (LLMs) and in particular ChatGPT in programming, source code analysis, and code generation. LLMs and ChatGPT are built using machine learning and artificial intelligence techniques, and…

Software Engineering · Computer Science 2023-06-12 Ahmed R. Sadik , Antonello Ceravola , Frank Joublin , Jibesh Patra

Recent advances in large language models (LLMs) have substantially improved single-turn task performance, yet real-world applications increasingly demand sophisticated multi-turn interactions. This survey provides a comprehensive review of…

Computation and Language · Computer Science 2026-04-21 Yubo Li , Xiaobin Shen , Yidi Miao , Xinyu Yao , Xueying Ding , Ramayya Krishnan , Rema Padman

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

Computation and Language · Computer Science 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

This survey paper explores the transformative influence of frontier AI, foundation models, and Large Language Models (LLMs) in the realm of Intelligent Transportation Systems (ITS), emphasizing their integral role in advancing…

Computation and Language · Computer Science 2024-01-17 Mohamed R. Shoaib , Heba M. Emara , Jun Zhao

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based…

Computation and Language · Computer Science 2025-08-08 Wenqian Cui , Dianzhi Yu , Xiaoqi Jiao , Ziqiao Meng , Guangyan Zhang , Qichao Wang , Yiwen Guo , Irwin King

The usefulness of Large Language Models (LLM) is being continuously tested in various fields. However, their intrinsic linguistic characteristic is still one of the limiting factors when applying these models to exact sciences. In this…

Artificial Intelligence · Computer Science 2024-09-24 Jonathan Paul Driemeyer Brown , Tiago Oliveira Weber

The past few decades have witnessed an upsurge in data, forming the foundation for data-hungry, learning-based AI technology. Conversational agents, often referred to as AI chatbots, rely heavily on such data to train large language models…

Computation and Language · Computer Science 2024-11-19 Sumit Kumar Dam , Choong Seon Hong , Yu Qiao , Chaoning Zhang

Large Language Models (LLMs) as chatbots have drawn remarkable attention thanks to their versatile capability in natural language processing as well as in a wide range of tasks. While there has been great enthusiasm towards adopting such…

Systems and Control · Electrical Eng. & Systems 2024-06-24 Subir Majumder , Lin Dong , Fatemeh Doudi , Yuting Cai , Chao Tian , Dileep Kalathi , Kevin Ding , Anupam A. Thatte , Na Li , Le Xie

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

Artificial Intelligence · Computer Science 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

Large-scale language models (LLMs) have emerged as a groundbreaking innovation in the realm of question-answering and conversational agents. These models, leveraging different deep learning architectures such as Transformers, are trained on…

Software Engineering · Computer Science 2023-07-18 Fardin Ahsan Sakib , Saadat Hasan Khan , A. H. M. Rezaul Karim

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language tasks, marking significant strides towards general artificial intelligence. While general artificial intelligence is leveraged by…

Computation and Language · Computer Science 2023-10-31 Yizhe Yang , Huashan Sun , Jiawei Li , Runheng Liu , Yinghao Li , Yuhang Liu , Heyan Huang , Yang Gao

This paper introduces the idea of applying signal processing inside a Large Language Model (LLM). With the recent explosion of generative AI, our work can help bridge two fields together, namely the field of signal processing and large…

Computation and Language · Computer Science 2024-09-19 Prateek Verma , Mert Pilanci

In recent years, advancements in natural language processing (NLP) have been fueled by deep learning techniques, particularly through the utilization of powerful computing resources like GPUs and TPUs. Models such as BERT and GPT-3, trained…

Computation and Language · Computer Science 2024-02-27 Shuning Huo , Yafei Xiang , Hanyi Yu , Mengran Zhu , Yulu Gong

The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and…

Human-Computer Interaction · Computer Science 2023-06-27 Philippe J. Giabbanelli

Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and human-AI…

Computation and Language · Computer Science 2025-09-18 Tianshi Zheng , Zheye Deng , Hong Ting Tsang , Weiqi Wang , Jiaxin Bai , Zihao Wang , Yangqiu Song