English
Related papers

Related papers: Large Language Models as Foundations for Next-Gen …

200 papers

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

A prominent achievement of natural language processing (NLP) is its ability to understand and generate meaningful human language. This capability relies on complex feedforward transformer block architectures pre-trained on large language…

Computation and Language · Computer Science 2025-11-11 Ronit D. Gross , Yarden Tzach , Tal Halevi , Ella Koresh , Ido Kanter

Pretrained language models have become the standard approach for many NLP tasks due to strong performance, but they are very expensive to train. We propose a simple and efficient learning framework, TLM, that does not rely on large-scale…

Computation and Language · Computer Science 2022-07-25 Xingcheng Yao , Yanan Zheng , Xiaocong Yang , Zhilin Yang

This paper evaluates the performance of a large language model (LLM) based semantic search tool relative to a traditional keyword-based search for data discovery. Using real-world search behaviour, we compare outputs from a bespoke semantic…

Information Retrieval · Computer Science 2026-01-28 Mark Green , Maura Halstead , Caroline Jay , Richard Kingston , Alex Singleton , David Topping

Large Language Models (LLMs) have attracted extensive attention due to their remarkable performance across various tasks. However, the substantial computational and memory requirements of LLM inference pose challenges for deployment in…

Large language models (LLMs) provide powerful means to leverage prior knowledge for predictive modeling when data is limited. In this work, we demonstrate how LLMs can use their compressed world knowledge to generate intrinsically…

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Time series data plays a critical role across diverse domains such as healthcare, energy, and finance, where tasks like classification, anomaly detection, and forecasting are essential for informed decision-making. Recently, large language…

Machine Learning · Computer Science 2024-12-18 Francis Tang , Ying Ding

Addressing the challenge of limited annotated data in specialized fields and low-resource languages is crucial for the effective use of Language Models (LMs). While most Large Language Models (LLMs) are trained on general-purpose English…

Computation and Language · Computer Science 2024-07-31 Serena Auriemma , Martina Miliani , Mauro Madeddu , Alessandro Bondielli , Lucia Passaro , Alessandro Lenci

Although Large Language Models (LLMs) have demonstrated extraordinary capabilities in many domains, they still have a tendency to hallucinate and generate fictitious responses to user requests. This problem can be alleviated by augmenting…

Information Retrieval · Computer Science 2023-06-09 Jiongnan Liu , Jiajie Jin , Zihan Wang , Jiehan Cheng , Zhicheng Dou , Ji-Rong Wen

This research focuses on assessing the ability of large language models (LLMs) in representing geometries and their spatial relations. We utilize LLMs including GPT-2 and BERT to encode the well-known text (WKT) format of geometries and…

Computation and Language · Computer Science 2023-07-10 Yuhan Ji , Song Gao

This study evaluates the resilience of large language models (LLMs) against adversarial attacks, specifically focusing on Flan-T5, BERT, and RoBERTa-Base. Using systematically designed adversarial tests through TextFooler and BERTAttack, we…

Cryptography and Security · Computer Science 2025-09-15 Taniya Gidatkar , Oluwaseun Ajao , Matthew Shardlow

Although supervised machine learning is popular for information extraction from clinical notes, creating large annotated datasets requires extensive domain expertise and is time-consuming. Meanwhile, large language models (LLMs) have…

Computation and Language · Computer Science 2024-01-26 Madhumita Sushil , Travis Zack , Divneet Mandair , Zhiwei Zheng , Ahmed Wali , Yan-Ning Yu , Yuwei Quan , Atul J. Butte

Complex Word Identification (CWI) is an essential step in the lexical simplification task and has recently become a task on its own. Some variations of this binary classification task have emerged, such as lexical complexity prediction…

Computation and Language · Computer Science 2024-11-05 Răzvan-Alexandru Smădu , David-Gabriel Ion , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language models (LLMs) in listwise reranking for limited-resource…

Computation and Language · Computer Science 2025-01-16 Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du , Yiyi Tao , Yixian Shen , Hang Zhang

Large language models (LLMs) have shown potential as tools for scientific discovery. This has engendered growing interest in their use in humanistic disciplines, such as historical linguistics and literary studies. These fields often…

Computation and Language · Computer Science 2026-03-31 Elisabeth Fittschen , Sabrina Li , Tom Lippincott , Leshem Choshen , Craig Messner

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

Computation and Language · Computer Science 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis

Recent work has shown that directly fine-tuning large language models (LLMs) for dense retrieval yields strong performance, but their substantial parameter counts make them computationally inefficient. While prior studies have revealed…

Information Retrieval · Computer Science 2025-12-24 Yibin Lei , Shwai He , Ang Li , Andrew Yates