English
Related papers

Related papers: iSEA: An Interactive Pipeline for Semantic Error A…

200 papers

In the task of code translation, neural network-based models have been shown to frequently produce semantically erroneous code that deviates from the original logic of the source code. This issue persists even with advanced large models.…

Software Engineering · Computer Science 2024-10-31 Lei Chen , Sai Zhang , Fangzhou Xu , Zhenchang Xing , Liang Wan , Xiaowang Zhang , Zhiyong Feng

In order to deeply understand the capability of pretrained language models in text generation and conduct a diagnostic evaluation, we propose TGEA, an error-annotated dataset with multiple benchmark tasks for text generation from pretrained…

Computation and Language · Computer Science 2025-03-07 Jie He , Bo Peng , Yi Liao , Qun Liu , Deyi Xiong

The automatic detection of offensive language is a pressing societal need. Many systems perform well on explicit offensive language but struggle to detect more complex, nuanced, or implicit cases of offensive and hateful language. OLEA is…

Computation and Language · Computer Science 2022-11-01 Marie Grace , Xajavion "Jay" Seabrum , Dananjay Srinivas , Alexis Palmer

Discovering authoritative links between publications and the datasets that they use can be a labor-intensive process. We introduce a natural language processing pipeline that retrieves and reviews publications for informal references to…

Digital Libraries · Computer Science 2023-05-03 Sara Lafia , Lizhou Fan , Libby Hemphill

State-of-the-art NLP methods achieve human-like performance on many tasks, but make errors nevertheless. Characterizing these errors in easily interpretable terms gives insight into whether a classifier is prone to making systematic errors,…

Computation and Language · Computer Science 2023-11-21 Michael A. Hedderich , Jonas Fischer , Dietrich Klakow , Jilles Vreeken

Prompt engineering is an iterative procedure often requiring extensive manual effort to formulate suitable instructions for effectively directing large language models (LLMs) in specific tasks. Incorporating few-shot examples is a vital and…

Scientific discovery pipelines typically involve complex, rigid, and time-consuming processes, from data preparation to analyzing and interpreting findings. Recent advances in AI have the potential to transform such pipelines in a way that…

Machine Learning · Computer Science 2026-02-20 Paimon Goulart , Jordan Steinhauser , Dawon Ahn , Kylene Shuler , Edward Korzus , Jia Chen , Evangelos E. Papalexakis

When AI tools can generate many solutions, some human preference must be applied to determine which solution is relevant to the current project. One way to find those preferences is interactive search-based software engineering (iSBSE)…

Software Engineering · Computer Science 2023-01-18 Andre Lustosa , Jaydeep Patel , Venkata Sai Teja Malapati , Tim Menzies

Since the emergence of Large Language Models (LLMs), the challenge of effectively leveraging their potential in healthcare has taken center stage. A critical barrier to using LLMs for extracting insights from unstructured clinical notes…

Artificial Intelligence · Computer Science 2024-12-04 Nader Karayanni , Aya Awwad , Chein-Lien Hsiao , Surish P Shanmugam

Survival analysis is central to clinical research, informing patient prognoses, guiding treatment decisions, and optimising resource allocation. Accurate time-to-event predictions not only improve quality of life but also reveal risk…

Online forums provide a unique opportunity for online users to share comments and exchange information on a particular topic. Understanding user behaviour is valuable to organizations and has applications for social and security strategies,…

Artificial Intelligence · Computer Science 2021-04-22 Hamed Jelodar , Richard Frank

This study describes the development of an AI-assisted error analysis system designed to identify, categorize, and correct writing errors in English. Utilizing Large Language Models (LLMs) like Claude 3.5 Sonnet and DeepSeek R1, the system…

Computation and Language · Computer Science 2025-12-02 Damian Heywood , Joseph Andrew Carrier , Kyu-Hong Hwang

While mechanistic interpretability has developed powerful tools to analyze the internal workings of Large Language Models (LLMs), their complexity has created an accessibility gap, limiting their use to specialists. We address this…

Computation and Language · Computer Science 2026-02-23 Aaron Louis Eidt , Nils Feldhus

Model selection in machine learning (ML) is a crucial part of the Bayesian learning procedure. Model choice may impose strong biases on the resulting predictions, which can hinder the performance of methods such as Bayesian neural networks…

Machine Learning · Statistics 2022-08-09 Simón Rodríguez Santana , Luis A. Ortega , Daniel Hernández-Lobato , Bryan Zaldívar

The sixth-generation (6G) mobile network is envisioned to incorporate sensing and edge artificial intelligence (AI) as two key functions. Their natural convergence leads to the emergence of Integrated Sensing and Edge AI (ISEA), a novel…

Information Theory · Computer Science 2025-03-18 Zhiyan Liu , Kaibin Huang

Despite significant progress in Natural Language Generation for Indian languages (IndicNLP), there is a lack of datasets around complex structured tasks such as semantic parsing. One reason for this imminent gap is the complexity of the…

Computation and Language · Computer Science 2023-06-06 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan

Pretrained natural language processing (NLP) models have achieved high overall performance, but they still make systematic errors. Instead of manual error analysis, research on slice detection models (SDM), which automatically identify…

Computation and Language · Computer Science 2023-09-12 Wenyue Hua , Lifeng Jin , Linfeng Song , Haitao Mi , Yongfeng Zhang , Dong Yu

State-of-the-art models in NLP are now predominantly based on deep neural networks that are opaque in terms of how they come to make predictions. This limitation has increased interest in designing more interpretable deep models for NLP…

Computation and Language · Computer Science 2020-04-27 Jay DeYoung , Sarthak Jain , Nazneen Fatema Rajani , Eric Lehman , Caiming Xiong , Richard Socher , Byron C. Wallace

Recurrent Neural Networks (RNNs) have been widely used in Natural Language Processing (NLP) tasks given its superior performance on processing sequential data. However, it is challenging to interpret and debug RNNs due to the inherent…

Human-Computer Interaction · Computer Science 2023-03-06 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

One key bottleneck of employing state-of-the-art semantic segmentation networks in the real world is the availability of training labels. Conventional semantic segmentation networks require massive pixel-wise annotated labels to reach…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Erik Ostrowski , Muhammad Shafique