English
Related papers

Related papers: Utilizing Pre-trained and Large Language Models fo…

200 papers

Automated scoring of open-ended student responses has the potential to significantly reduce human grader effort. Recent advances in automated scoring often leverage textual representations based on pre-trained language models such as BERT…

Machine Learning · Computer Science 2023-06-16 Nigel Fernandez , Aritra Ghosh , Naiming Liu , Zichao Wang , Benoît Choffin , Richard Baraniuk , Andrew Lan

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

Computation and Language · Computer Science 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak

Recently, pre-trained Transformer based language models such as BERT and GPT, have shown great improvement in many Natural Language Processing (NLP) tasks. However, these models contain a large amount of parameters. The emergence of even…

Computation and Language · Computer Science 2021-12-20 Ofir Zafrir , Guy Boudoukh , Peter Izsak , Moshe Wasserblat

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

Computation and Language · Computer Science 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Labeling data is essential for training text classifiers but is often difficult to accomplish accurately, especially for complex and abstract concepts. Seeking an improved method, this paper employs a novel approach using a generative…

Computation and Language · Computer Science 2024-12-31 Sergio Pelaez , Gaurav Verma , Barbara Ribeiro , Philip Shapira

Prompting is used to guide or steer a language model in generating an appropriate response that is consistent with the desired outcome. Chaining is a strategy used to decompose complex tasks into smaller, manageable components. In this…

Computation and Language · Computer Science 2023-08-09 Dietrich Trautmann

Prior research notes that BERT's computational cost grows quadratically with sequence length thus leading to longer training times, higher GPU memory constraints and carbon emissions. While recent work seeks to address these scalability…

Computation and Language · Computer Science 2020-11-02 Yatin Chaudhary , Pankaj Gupta , Khushbu Saxena , Vivek Kulkarni , Thomas Runkler , Hinrich Schütze

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Given a document in a source language, cross-lingual summarization (CLS) aims to generate a summary in a different target language. Recently, the emergence of Large Language Models (LLMs), such as GPT-3.5, ChatGPT and GPT-4, has attracted…

Computation and Language · Computer Science 2023-10-25 Jiaan Wang , Yunlong Liang , Fandong Meng , Beiqi Zou , Zhixu Li , Jianfeng Qu , Jie Zhou

The use of propagandistic techniques in online content has increased in recent years aiming to manipulate online audiences. Fine-grained propaganda detection and extraction of textual spans where propaganda techniques are used, are…

Computation and Language · Computer Science 2024-10-08 Maram Hasanain , Fatema Ahmad , Firoj Alam

Objective: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on…

Computation and Language · Computer Science 2024-01-26 Yan Hu , Qingyu Chen , Jingcheng Du , Xueqing Peng , Vipina Kuttichi Keloth , Xu Zuo , Yujia Zhou , Zehan Li , Xiaoqian Jiang , Zhiyong Lu , Kirk Roberts , Hua Xu

Large Language Models (LLM) continue to demonstrate their utility in a variety of emergent capabilities in different fields. An area that could benefit from effective language understanding in cybersecurity is the analysis of log files.…

Networking and Internet Architecture · Computer Science 2023-11-27 Egil Karlsen , Xiao Luo , Nur Zincir-Heywood , Malcolm Heywood

The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and…

Human-Computer Interaction · Computer Science 2023-06-27 Philippe J. Giabbanelli

Named Entity Recognition (NER) in the rare disease domain poses unique challenges due to limited labeled data, semantic ambiguity between entity types, and long-tail distributions. In this study, we evaluate the capabilities of GPT-4o for…

Computation and Language · Computer Science 2025-12-30 Nan Miles Xi , Yu Deng , Lin Wang

Sequential recommendation plays a critical role in modern online platforms such as e-commerce, advertising, and content streaming, where accurately predicting users' next interactions is essential for personalization. Recent…

Information Retrieval · Computer Science 2026-03-04 Haofeng Huang , Ling Gai

Large language models (LLMs) such as GPT-4o and Claude Sonnet 4.5 have demonstrated strong capabilities in open-ended reasoning and generative language tasks, leading to their widespread adoption across a broad range of NLP applications.…

Computation and Language · Computer Science 2026-02-09 Alberto Andres Valdes Gonzalez

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Understanding human instructions to identify the target objects is vital for perception systems. In recent years, the advancements of Large Language Models (LLMs) have introduced new possibilities for image segmentation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Junchi Wang , Lei Ke

The primary objective of this study is to demonstrate the impact of data augmentation using ChatGPT-4o-mini on food hazard and product analysis. The augmented data is generated using ChatGPT-4o-mini and subsequently used to train two large…

Computation and Language · Computer Science 2025-02-14 Areeg Fahad Rasheed , M. Zarkoosh , Shimam Amer Chasib , Safa F. Abbas