English
Related papers

Related papers: Laboratory-Scale AI: Open-Weight Models are Compet…

200 papers

Large Language Models (LLMs) have become central in academia and industry, raising concerns about privacy, transparency, and misuse. A key issue is the trustworthiness of proprietary models, with open-sourcing often proposed as a solution.…

Software Engineering · Computer Science 2025-01-29 Domen Vake , Bogdan Šinik , Jernej Vičič , Aleksandar Tošić

This study evaluates the performance of general-purpose AI, like ChatGPT, in legal question-answering tasks, highlighting significant risks to legal professionals and clients. It suggests leveraging foundational models enhanced by…

Artificial Intelligence · Computer Science 2024-04-19 Rohan Bhambhoria , Samuel Dahan , Jonathan Li , Xiaodan Zhu

This paper presents a comprehensive analysis of explainable fact-checking through a series of experiments, focusing on the ability of large language models to verify public health claims and provide explanations or justifications for their…

Computation and Language · Computer Science 2024-12-19 Majid Zarharan , Pascal Wullschleger , Babak Behkam Kia , Mohammad Taher Pilehvar , Jennifer Foster

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

With increasing scale, large language models demonstrate both quantitative improvement and new qualitative capabilities, especially as zero-shot learners, like GPT-3. However, these results rely heavily on delicate prompt design and large…

Computation and Language · Computer Science 2022-12-21 Jingjing Xu , Qingxiu Dong , Hongyi Liu , Lei Li

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

Many companies use large language models (LLMs) offered as a service, like OpenAI's GPT-4, to create AI-enabled product experiences. Along with the benefits of ease-of-use and shortened time-to-solution, this reliance on proprietary…

In August 2025, OpenAI released GPT-OSS models, its first open weight large language models since GPT-2 in 2019, comprising two mixture of experts architectures with 120B and 20B parameters. We evaluated both variants against six…

Computation and Language · Computer Science 2025-12-16 Ziqian Bi , Keyu Chen , Chiung-Yi Tseng , Danyang Zhang , Tianyang Wang , Hongying Luo , Lu Chen , Junming Huang , Jibin Guan , Junfeng Hao , Xinyuan Song , Junhao Song

We propose the use of conversational GPT models for easy and quick few-shot text classification in the financial domain using the Banking77 dataset. Our approach involves in-context learning with GPT-3.5 and GPT-4, which minimizes the…

Computation and Language · Computer Science 2023-08-29 Lefteris Loukas , Ilias Stogiannidis , Prodromos Malakasiotis , Stavros Vassos

As large language models become integral to agentic artificial intelligence systems, their energy demands during inference may pose significant sustainability challenges. This study investigates whether deploying smaller-scale language…

Artificial Intelligence · Computer Science 2026-02-09 Anh Khoa Ngo Ho , Martin Chauvin , Simon Gosset , Philippe Cordier , Boris Gamazaychikov

Robots are expected to play a major role in the future construction industry but face challenges due to high costs and difficulty adapting to dynamic tasks. This study explores the potential of foundation models to enhance the adaptability…

Robotics · Computer Science 2026-01-21 Hossein Naderi , Alireza Shojaei , Lifu Huang , Philip Agee , Kereshmeh Afsari , Abiola Akanmu

Generative Artificial Intelligence (AI) models such as OpenAI's ChatGPT have the potential to revolutionize Statistical Process Control (SPC) practice, learning, and research. However, these tools are in the early stages of development and…

Machine Learning · Computer Science 2023-06-19 Fadel M. Megahed , Ying-Ju Chen , Joshua A. Ferris , Sven Knoth , L. Allison Jones-Farmer

With the blowout development of pre-trained models (PTMs), the efficient tuning of these models for diverse downstream applications has emerged as a pivotal research concern. Although recent investigations into prompt tuning have provided…

Machine Learning · Computer Science 2023-10-06 Zihao Lin , Yan Sun , Yifan Shi , Xueqian Wang , Lifu Huang , Li Shen , Dacheng Tao

We assess whether AI systems can credibly evaluate investment risk appetite-a task that must be thoroughly validated before automation. Our analysis was conducted on proprietary systems (GPT, Claude, Gemini) and open-weight models (LLaMA,…

With the growing attention and investment in recent AI approaches such as large language models, the narrative that the larger the AI system the more valuable, powerful and interesting it is is increasingly seen as common sense. But what is…

Computers and Society · Computer Science 2025-03-04 Gaël Varoquaux , Alexandra Sasha Luccioni , Meredith Whittaker

Currently, there is uncertainty surrounding the merits of open-source versus proprietary algorithm development. Though justification in favor of each exists, we argue that open-source algorithm development should be the standard in highly…

Applications · Statistics 2020-11-13 Philip D. Waggoner , Alec Macmillen

We evaluated the performance of OpenFOAMGPT incorporating multiple large-language models. Some of the present models efficiently manage different CFD tasks such as adjusting boundary conditions, turbulence models, and solver configurations,…

Computation and Language · Computer Science 2025-09-23 Wenkang Wang , Ran Xu , Jingsen Feng , Qingfu Zhang , Xu Chu

Many believe that use of generative AI as a private tutor has the potential to shrink access and achievement gaps between students and schools with abundant resources versus those with fewer resources. Shrinking the gap is possible only if…

Other Statistics · Statistics 2025-06-12 Monnie McGee , Bivin Sadler

A proliferation of Large Language Models (the GPT series, BLOOM, LLaMA, and more) are driving forward novel development of multipurpose AI for a variety of tasks, particularly natural language processing (NLP) tasks. These models…

Computation and Language · Computer Science 2024-11-07 Anurag Acharya , Shivam Sharma , Robin Cosbey , Megha Subramanian , Scott Howland , Maria Glenski

Recent proposals for regulating frontier AI models have sparked concerns about the cost of safety regulation, and most such regulations have been shelved due to the safety-innovation tradeoff. This paper argues for an alternative regulatory…

Artificial Intelligence · Computer Science 2025-10-17 Shriyash Upadhyay , Chaithanya Bandi , Narmeen Oozeer , Philip Quirke