English
Related papers

Related papers: Toward Informal Language Processing: Knowledge of …

200 papers

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding and language generation, and thus have the potential to make a substantial impact on our society. Such…

Computation and Language · Computer Science 2024-05-24 Zhongwei Wan , Xin Wang , Che Liu , Samiul Alam , Yu Zheng , Jiachen Liu , Zhongnan Qu , Shen Yan , Yi Zhu , Quanlu Zhang , Mosharaf Chowdhury , Mi Zhang

Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understanding. In this paper we apply a zero-shot approach…

Computation and Language · Computer Science 2022-01-25 Darren Abramson , Ali Emami

Leveraging large language models (LLMs) for various natural language processing tasks has led to superlative claims about their performance. For the evaluation of machine translation (MT), existing research shows that LLMs are able to…

Computation and Language · Computer Science 2024-10-10 Shenbin Qian , Archchana Sindhujan , Minnie Kabra , Diptesh Kanojia , Constantin Orăsan , Tharindu Ranasinghe , Frédéric Blain

Small language models (SLMs), despite their widespread adoption in modern smart devices, have received significantly less academic attention compared to their large language model (LLM) counterparts, which are predominantly deployed in data…

Computation and Language · Computer Science 2025-02-27 Zhenyan Lu , Xiang Li , Dongqi Cai , Rongjie Yi , Fangming Liu , Xiwen Zhang , Nicholas D. Lane , Mengwei Xu

Metaphor is a pervasive feature of discourse and a powerful lens for examining cognition, emotion, and ideology. Large-scale analysis, however, has been constrained by the need for manual annotation due to the context-sensitive nature of…

Computation and Language · Computer Science 2025-10-02 Matteo Fuoli , Weihang Huang , Jeannette Littlemore , Sarah Turner , Ellen Wilding

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

Computation and Language · Computer Science 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

Small Language Models (SLMs) have become increasingly important due to their efficiency and performance to perform various language tasks with minimal computational resources, making them ideal for various settings including on-device,…

People have long hoped for a conversational system that can assist in real-life situations, and recent progress on large language models (LLMs) is bringing this idea closer to reality. While LLMs are often impressive in performance, their…

Computation and Language · Computer Science 2025-02-06 Linkai Peng , Baorian Nuchged , Yingming Gao

In support of open and reproducible research, there has been a rapidly increasing number of datasets made available for research. As the availability of datasets increases, it becomes more important to have quality metadata for discovering…

Computation and Language · Computer Science 2023-10-18 Shiwei Zhang , Mingfang Wu , Xiuzhen Zhang

Recent foundational language models have shown state-of-the-art performance in many NLP tasks in zero- and few-shot settings. An advantage of these models over more standard approaches based on fine-tuning is the ability to understand…

Computation and Language · Computer Science 2024-04-16 Aleksandra Edwards , Jose Camacho-Collados

Recent studies have highlighted the significant potential of Large Language Models (LLMs) as zero-shot relevance rankers. These methods predominantly utilize prompt learning to assess the relevance between queries and documents by…

Information Retrieval · Computer Science 2024-11-08 Dezhi Ye , Junwei Hu , Jiabin Fan , Bowen Tian , Jie Liu , Haijin Liang , Jin Ma

Low-resource languages pose a challenge for machine translation with large language models (LLMs), which require large amounts of training data. One potential way to circumvent this data dependence is to rely on LLMs' ability to use…

Computation and Language · Computer Science 2026-04-09 Jackson Petty , Jaulie Goe , Tal Linzen

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

Computation and Language · Computer Science 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Identifying relevant text spans is important for several downstream tasks in NLP, as it contributes to model explainability. While most span identification approaches rely on relatively smaller pre-trained language models like BERT, a few…

Computation and Language · Computer Science 2026-01-05 Alphaeus Dmonte , Roland Oruche , Tharindu Ranasinghe , Marcos Zampieri , Prasad Calyam

In recent years, large language models (LLMs) have been extensively utilized for behavioral modeling, for example, to automatically generate sequence diagrams. However, no overview of this work has been published yet. Such an overview will…

Software Engineering · Computer Science 2025-09-30 Muhammad Laiq

Formal languages are an integral part of modeling and simulation. They allow the distillation of knowledge into concise simulation models amenable to automatic execution, interpretation, and analysis. However, the arguably most humanly…

Machine Learning · Computer Science 2025-10-23 Justin N. Kreikemeyer , Miłosz Jankowski , Pia Wilsdorf , Adelinde M. Uhrmacher

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

Computation and Language · Computer Science 2025-06-27 Zhengyan Shi

Large Language Models (LLMs) have made remarkable strides in various tasks. Whether LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains an open problem. In this work, we aim to provide a thorough…

Computation and Language · Computer Science 2024-04-15 Yubo Ma , Yixin Cao , YongChing Hong , Aixin Sun