English
Related papers

Related papers: Can Small GenAI Language Models Rival Large Langua…

200 papers

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard

Large Language Models (LLMs) have demonstrated their remarkable capabilities in numerous fields. This survey focuses on how LLMs empower users, regardless of their technical background, to use human languages to automatically generate…

Software Engineering · Computer Science 2025-04-03 Nam Huynh , Beiyu Lin

The rise of Generative AI (GAI) and Large Language Models (LLMs) has transformed industrial landscapes, offering unprecedented opportunities for efficiency and innovation while raising critical ethical, regulatory, and operational…

Computers and Society · Computer Science 2026-03-11 Junfeng Jiao , Saleh Afroogh , Kevin Chen , David Atkinson , Amit Dhurandhar

This article explores the potential of generative AI (GenAI) to support actuarial practice through four implemented case studies. It situates these case studies within the broader evolution of artificial intelligence in actuarial science,…

Computers and Society · Computer Science 2026-04-21 Simon Hatzesberger , Iris Nonneman

The ability of machines to comprehend and produce language that is similar to that of humans has revolutionized sectors like customer service, healthcare, and finance thanks to the quick advances in Natural Language Processing (NLP), which…

Cryptography and Security · Computer Science 2025-04-22 Swetha S , Ram Sundhar K Shaju , Rakshana M , Ganesh R , Balavedhaa S , Thiruvaazhi U

Large language models (LLMs) have demonstrated remarkable capabilities, but they require vast amounts of data and computational resources. In contrast, smaller models (SMs), while less powerful, can be more efficient and tailored to…

Generative Artificial Intelligence (GenAI) rapidly transforms software engineering, yet existing research remains fragmented across individual tasks in the Software Development Lifecycle. This study integrates a systematic literature review…

Software Engineering · Computer Science 2026-03-19 Vincent Gurgul , Robin Gubela , Stefan Lessmann

Large Language Models (LLMs) have revolutionized both general natural language processing and domain-specific applications such as code synthesis, legal reasoning, and finance. However, while prior studies have explored individual model…

Software Engineering · Computer Science 2025-12-05 Gunjan Das , Paheli Bhattacharya , Rishabh Gupta

Generative AI (GenAI) has enormous potential for improving two critical areas in investing, namely portfolio optimization (choosing the best combination of assets) and risk management (protecting those investments). Our study works at this…

Computational Engineering, Finance, and Science · Computer Science 2025-12-16 Abrar Hossain , Mufakir Qamar Ansari , Haziq Jeelani , Monia Digra , Fayeq Jeelani Syed

Large language models (LLMs) show promise for supporting clinical decision-making in complex fields such as rheumatology. Our evaluation shows that smaller language models (SLMs), combined with retrieval-augmented generation (RAG), achieve…

Computation and Language · Computer Science 2025-07-11 Sabine Felde , Rüdiger Buchkremer , Gamal Chehab , Christian Thielscher , Jörg HW Distler , Matthias Schneider , Jutta G. Richter

In an era dominated by Large Language Models (LLMs), understanding their capabilities and limitations, especially in high-stakes fields like law, is crucial. While LLMs such as Meta's LLaMA, OpenAI's ChatGPT, Google's Gemini, DeepSeek, and…

Computation and Language · Computer Science 2025-09-29 Antreas Ioannou , Andreas Shiamishis , Nora Hollenstein , Nezihe Merve Gürel

Using AI to create autonomous researchers has the potential to accelerate scientific discovery. A prerequisite for this vision is understanding how well an AI model can identify the underlying structure of a black-box system from its…

Machine Learning · Computer Science 2025-05-26 Jiayi Geng , Howard Chen , Dilip Arumugam , Thomas L. Griffiths

A prominent achievement of natural language processing (NLP) is its ability to understand and generate meaningful human language. This capability relies on complex feedforward transformer block architectures pre-trained on large language…

Computation and Language · Computer Science 2025-11-11 Ronit D. Gross , Yarden Tzach , Tal Halevi , Ella Koresh , Ido Kanter

Generative artificial intelligence (AI) systems based on large-scale pretrained foundation models (PFMs) such as vision-language models, large language models (LLMs), diffusion models and vision-language-action (VLA) models have…

Artificial Intelligence · Computer Science 2025-01-07 Alhassan Mumuni , Fuseini Mumuni

This paper provides a comprehensive review of the future of cybersecurity through Generative AI and Large Language Models (LLMs). We explore LLM applications across various domains, including hardware design security, intrusion detection,…

With the ongoing rapid adoption of Artificial Intelligence (AI)-based systems in high-stakes domains, ensuring the trustworthiness, safety, and observability of these systems has become crucial. It is essential to evaluate and monitor AI…

Computation and Language · Computer Science 2024-07-19 Krishnaram Kenthapadi , Mehrnoosh Sameki , Ankur Taly

While automated vulnerability detection techniques have made promising progress in detecting security vulnerabilities, their scalability and applicability remain challenging. The remarkable performance of Large Language Models (LLMs), such…

Cryptography and Security · Computer Science 2024-10-24 Avishree Khare , Saikat Dutta , Ziyang Li , Alaia Solko-Breslin , Rajeev Alur , Mayur Naik

Machine learning-based supervised classifiers are widely used for security tasks, and their improvement has been largely focused on algorithmic advancements. We argue that data challenges that negatively impact the performance of these…

Cryptography and Security · Computer Science 2026-05-29 Shravya Kanchi , Neal Mangaokar , Aravind Cheruvu , Sifat Muhammad Abdullah , Shirin Nilizadeh , Atul Prakash , Bimal Viswanath

This paper provides a comprehensive review of the current methods and metrics used to evaluate the performance of Large Language Models (LLMs) in code generation tasks. With the rapid growth in demand for automated software development,…

Software Engineering · Computer Science 2025-03-05 Liguo Chen , Qi Guo , Hongrui Jia , Zhengran Zeng , Xin Wang , Yijiang Xu , Jian Wu , Yidong Wang , Qing Gao , Jindong Wang , Wei Ye , Shikun Zhang

Predicting the future trajectory of complex and rapidly evolving systems remains a significant challenge, particularly in domains where data is scarce or unreliable. This study introduces a novel approach to qualitative forecasting by…

Artificial Intelligence · Computer Science 2025-03-03 Francesco Bertolotti , Luca Mari