English
Related papers

Related papers: Exploring the Latest LLMs for Leaderboard Extracti…

200 papers

As researchers increasingly adopt LLMs as writing assistants, generating high-quality research paper introductions remains both challenging and essential. We introduce Scientific Introduction Generation (SciIG), a task that evaluates LLMs'…

Computation and Language · Computer Science 2025-08-26 Krishna Garg , Firoz Shaik , Sambaran Bandyopadhyay , Cornelia Caragea

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

This study explores the effectiveness of Large Language Models (LLMs) for Automatic Question Generation in educational settings. Three LLMs are compared in their ability to create questions from university slide text without fine-tuning.…

Computation and Language · Computer Science 2024-09-17 Ivo Lodovico Molina , Valdemar Švábenský , Tsubasa Minematsu , Li Chen , Fumiya Okubo , Atsushi Shimada

Large language models (LLMs) have made significant progress in various domains, including healthcare. However, the specialized nature of clinical language understanding tasks presents unique challenges and limitations that warrant further…

Computation and Language · Computer Science 2023-08-01 Yuqing Wang , Yun Zhao , Linda Petzold

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a…

Computation and Language · Computer Science 2023-08-29 Lixiang Yan , Lele Sha , Linxuan Zhao , Yuheng Li , Roberto Martinez-Maldonado , Guanliang Chen , Xinyu Li , Yueqiao Jin , Dragan Gašević

Large Language Models (LLMs) pre-trained on multilingual data have revolutionized natural language processing research, by transitioning from languages and task specific model pipelines to a single model adapted on a variety of tasks.…

Computation and Language · Computer Science 2025-01-31 Munief Hassan Tahir , Sana Shams , Layba Fiaz , Farah Adeeba , Sarmad Hussain

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

Computation and Language · Computer Science 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

The rise of multimodal data, integrating text, audio, and visuals, has created new opportunities for studying multimodal tasks such as intent detection. This work investigates the effectiveness of Large Language Models (LLMs) and non-LLMs,…

Computation and Language · Computer Science 2025-10-22 Ankan Mullick , Saransh Sharma , Abhik Jana , Pawan Goyal

Background: Structured information extraction from unstructured histopathology reports facilitates data accessibility for clinical research. Manual extraction by experts is time-consuming and expensive, limiting scalability. Large language…

In recent years, groundbreaking advancements in natural language processing have culminated in the emergence of powerful large language models (LLMs), which have showcased remarkable capabilities across a vast array of domains, including…

Computation and Language · Computer Science 2023-12-11 Microsoft Research AI4Science , Microsoft Azure Quantum

This study examines the potential of large language models (LLMs) to augment the academic peer review process by reliably evaluating the quality of economics research without introducing systematic bias. We conduct one of the first…

Computers and Society · Computer Science 2025-04-04 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Achiwaranguprok , Pattie Maes

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

Computation and Language · Computer Science 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

The advent of ChatGPT and GPT-4 has captivated the world with large language models (LLMs), demonstrating exceptional performance in question-answering, summarization, and content generation. The aviation industry is characterized by an…

Computation and Language · Computer Science 2023-11-30 Liya Wang , Jason Chou , Xin Zhou , Alex Tien , Diane M Baumgartner

Large Language Models (LLMs) like ChatGPT, DeepSeek and Gemini seem to be increasingly used for knowledge discovery, information retrieval, and knowledge summaries, including for academic topics. This can result in users being misled, such…

Information Retrieval · Computer Science 2026-05-28 Mike Thelwall

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Large Language Models (LLMs) have shown significant promise across various natural language processing tasks. However, their application in the field of pathology, particularly for extracting meaningful insights from unstructured medical…

Computation and Language · Computer Science 2025-03-04 Rachit Saluja , Jacob Rosenthal , Yoav Artzi , David J. Pisapia , Benjamin L. Liechty , Mert R. Sabuncu

Requirements Engineering (RE) is essential for developing complex and regulated software projects. Given the challenges in transforming stakeholder inputs into consistent software designs, Qualitative Data Analysis (QDA) provides a…

Software Engineering · Computer Science 2025-04-29 Syed Tauhid Ullah Shah , Mohamad Hussein , Ann Barcomb , Mohammad Moshirpour

AI and generative AI tools, including chatbots like ChatGPT that rely on large language models (LLMs), have burst onto the scene this year, creating incredible opportunities to increase work productivity and improve our lives. Statisticians…

Computation and Language · Computer Science 2024-03-27 Mark Glickman , Yi Zhang

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on…

Human-Computer Interaction · Computer Science 2023-10-26 Bhavya Chopra , Ananya Singha , Anna Fariha , Sumit Gulwani , Chris Parnin , Ashish Tiwari , Austin Z. Henley

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi