English
Related papers

Related papers: Evolution through Large Models

200 papers

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Successful application of large language models (LLMs) to robotic planning and execution may pave the way to automate numerous real-world tasks. Promising recent research has been conducted showing that the knowledge contained in LLMs can…

Robotics · Computer Science 2024-07-23 Ateeq Sharfuddin , Travis Breaux

This paper analyzes Large Language Models (LLMs) with regard to their programming exercise generation capabilities. Through a survey study, we defined the state of the art, extracted their strengths and weaknesses and finally proposed an…

Artificial Intelligence · Computer Science 2024-05-31 Eduard Frankford , Ingo Höhn , Clemens Sauerwein , Ruth Breu

Recently, computer scientists have developed large language models (LLMs) by training prediction models with large-scale language corpora and human reinforcements. The LLMs have become one promising way to implement artificial intelligence…

Computers and Society · Computer Science 2023-08-22 Hyemin Han

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

In recent years, large pre-trained language models (LLMs) have demonstrated the ability to follow instructions and perform novel tasks from a few examples. The possibility to parameterise an LLM through such in-context examples widens their…

Machine Learning · Computer Science 2023-05-10 Imanol Schlag , Sainbayar Sukhbaatar , Asli Celikyilmaz , Wen-tau Yih , Jason Weston , Jürgen Schmidhuber , Xian Li

Generative large language models (LLMs) are a promising alternative to pre-trained language models for entity matching due to their high zero-shot performance and ability to generalize to unseen entities. Existing research on using LLMs for…

Computation and Language · Computer Science 2025-05-22 Aaron Steiner , Ralph Peeters , Christian Bizer

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

Computation and Language · Computer Science 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

Large Language Models (LLMs) like GPT-3 and GPT-4 have emerged as groundbreaking innovations with capabilities that extend far beyond traditional AI applications. These sophisticated models, trained on massive datasets, can generate…

Software Engineering · Computer Science 2025-05-21 Md Asraful Haque

The human ability to learn, generalize, and control complex manipulation tasks through multi-modality feedback suggests a unique capability, which we refer to as dexterity intelligence. Understanding and assessing this intelligence is a…

Robotics · Computer Science 2025-12-03 Fanlong Zeng , Wensheng Gan , Zezheng Huai , Lichao Sun , Hechang Chen , Yongheng Wang , Ning Liu , Philip S. Yu

Modeling structure and behavior of software systems plays a crucial role, in various areas of software engineering. As with other software engineering artifacts, software models are subject to evolution. Supporting modelers in evolving…

Software Engineering · Computer Science 2023-12-20 Christof Tinnes , Thomas Fuchß , Uwe Hohenstein , Sven Apel

Large language models (LLMs) have become increasingly capable, but their development often requires substantial computational resources. While model merging has emerged as a cost-effective promising approach for creating new models by…

Neural and Evolutionary Computing · Computer Science 2025-01-28 Takuya Akiba , Makoto Shing , Yujin Tang , Qi Sun , David Ha

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Large language models (LLMs) are beginning to reshape how chemists plan and run reactions in organic synthesis. Trained on millions of reported transformations, these text-based models can propose synthetic routes, forecast reaction…

Artificial Intelligence · Computer Science 2025-08-08 Kartar Kumar Lohana Tharwani , Rajesh Kumar , Sumita , Numan Ahmed , Yong Tang

Large Language Models (LLMs) are transforming programming practices, offering significant capabilities for code generation activities. While researchers have explored the potential of LLMs in various domains, this paper focuses on their use…

Software Engineering · Computer Science 2026-05-04 Deborah Etsenake , Meiyappan Nagappan

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now…

Computation and Language · Computer Science 2025-02-11 Andrea Matarazzo , Riccardo Torlone

While Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, fine-tuning these models on downstream, domain-specific datasets is often necessary to yield superior performance on test sets compared to their…

Computation and Language · Computer Science 2024-03-15 Haoran Yang , Yumeng Zhang , Jiaqi Xu , Hongyuan Lu , Pheng Ann Heng , Wai Lam