English
Related papers

Related papers: Systematic Evaluation of Large Language Models for…

200 papers

Deep learning algorithms are dependent on the availability of large-scale annotated clinical text datasets. The lack of such publicly available datasets is the biggest bottleneck for the development of clinical Natural Language…

Computation and Language · Computer Science 2022-03-11 Sonish Sivarajkumar , Yanshan Wang

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis

The growing volume of biomedical scholarly document abstracts presents an increasing challenge in efficiently retrieving accurate and relevant information. To address this, we introduce a novel approach that integrates an optimized topic…

Computation and Language · Computer Science 2024-11-04 Parvez Zamil , Gollam Rabby , Md. Sadekur Rahman , Sören Auer

Graph neural networks (GNNs) have become the preferred models for node classification in graph data due to their robust capabilities in integrating graph structures and attributes. However, these models heavily depend on a substantial…

Machine Learning · Computer Science 2025-05-19 Taiyan Zhang , Renchi Yang , Yurui Lai , Mingyu Yan , Xiaochun Ye , Dongrui Fan

Recent advancements in open vocabulary models, like CLIP, have notably advanced zero-shot classification and segmentation by utilizing natural language for class-specific embeddings. However, most research has focused on improving model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wenfang Sun , Yingjun Du , Gaowen Liu , Ramana Kompella , Cees G. M. Snoek

NLP benchmarks rely on standardized datasets for training and evaluating models and are crucial for advancing the field. Traditionally, expert annotations ensure high-quality labels; however, the cost of expert annotation does not scale…

Computation and Language · Computer Science 2025-09-15 Omer Nahum , Nitay Calderon , Orgad Keller , Idan Szpektor , Roi Reichart

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

Computation and Language · Computer Science 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Recent advancements in the field of Natural Language Processing, particularly the development of large-scale language models that are pretrained on vast amounts of knowledge, are creating novel opportunities within the realm of Knowledge…

Computation and Language · Computer Science 2023-10-06 Anisa Rula , Jennifer D'Souza

Large language models (LLMs) such as GPT-4o and o1 have demonstrated strong performance on clinical natural language processing (NLP) tasks across multiple medical benchmarks. Nonetheless, two high-impact NLP tasks - structured tabular…

AI in dermatology is evolving at a rapid pace but the major limitation to training trustworthy classifiers is the scarcity of data with ground-truth concept level labels, which are meta-labels semantically meaningful to humans. Foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soham Gadgil , Mahtab Bigverdi

Clinical notes recorded during a patient's perioperative journey holds immense informational value. Advances in large language models (LLMs) offer opportunities for bridging this gap. Using 84,875 pre-operative notes and its associated…

Computation and Language · Computer Science 2025-04-03 Charles Alba , Bing Xue , Joanna Abraham , Thomas Kannampallil , Chenyang Lu

The rapid growth of biomedical literature poses challenges for manual knowledge curation and synthesis. Biomedical Natural Language Processing (BioNLP) automates the process. While Large Language Models (LLMs) have shown promise in general…

Cybersecurity post-incident reviews are essential for identifying control failures and improving organisational resilience, yet they remain labour-intensive, time-consuming, and heavily reliant on expert judgment. This paper investigates…

Cryptography and Security · Computer Science 2026-01-08 Huan Lin Oh , Jay Yong Jun Jie , Mandy Lee Ling Siu , Jonathan Pan

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with…

Artificial Intelligence · Computer Science 2025-01-14 Xinyao Ma , Rui Zhu , Zihao Wang , Jingwei Xiong , Qingyu Chen , Haixu Tang , L. Jean Camp , Lucila Ohno-Machado

In the rapidly evolving landscape of medical documentation, transcribing clinical dialogues accurately is increasingly paramount. This study explores the potential of Large Language Models (LLMs) to enhance the accuracy of Automatic Speech…

Computation and Language · Computer Science 2024-02-13 Ayo Adedeji , Sarita Joshi , Brendan Doohan

Recent advancements in language models (LMs) have led to the emergence of powerful models such as Small LMs (e.g., T5) and Large LMs (e.g., GPT-4). These models have demonstrated exceptional capabilities across a wide range of tasks, such…

Computation and Language · Computer Science 2024-05-07 Mingchen Li , Rui Zhang

Large language models (LLMs) have shown promise in safety-critical applications such as healthcare, yet the ability to quantify performance has lagged. An example of this challenge is in evaluating a summary of the patient's medical record.…

Computation and Language · Computer Science 2024-11-13 Elliot Schumacher , Daniel Rosenthal , Dhruv Naik , Varun Nair , Luladay Price , Geoffrey Tso , Anitha Kannan

Large Language Models revolutionized NLP and showed dramatic performance improvements across several tasks. In this paper, we investigated the role of such language models in text classification and how they compare with other approaches…

Computation and Language · Computer Science 2025-02-21 Sowmya Vajjala , Shwetali Shimangaud

Large language models (LLMs) and high-capacity encoders have advanced zero and few-shot classification, but their inference cost and latency limit practical deployment. We propose training lightweight text classifiers using dynamically…

Computation and Language · Computer Science 2026-01-26 Gaurav Maheshwari , Kevin El Haddad