English
Related papers

Related papers: Explaining novel senses using definition generatio…

200 papers

Word groupings useful for language processing tasks are increasingly available, as thesauri appear on-line, and as distributional word clustering techniques improve. However, for many tasks, one is interested in relationships among word…

cmp-lg · Computer Science 2008-02-03 Philip Resnik

Background: Over the past few decades, the process and methodology of automated question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the…

Artificial Intelligence · Computer Science 2024-12-06 Dominic Lohr , Marc Berges , Abhishek Chugh , Michael Kohlhase , Dennis Müller

Recent concept-based interpretable models have succeeded in providing meaningful explanations by pre-defined concept sets. However, the dependency on the pre-defined concepts restricts the application because of the limited number of…

Artificial Intelligence · Computer Science 2025-02-19 Shin'ya Yamaguchi , Kosuke Nishida

This paper introduces SENSE (Shared Embedding for N-lingual Speech and tExt), an open-source solution inspired by the SAMU-XLSR framework and conceptually similar to Meta AI's SONAR models. These approaches rely on a teacher-student…

Computation and Language · Computer Science 2025-12-10 Salima Mdhaffar , Haroun Elleuch , Chaimae Chellaf , Ha Nguyen , Yannick Estève

Amidst the sharp rise in the evaluation of large language models (LLMs) on various tasks, we find that semantic textual similarity (STS) has been under-explored. In this study, we show that STS can be cast as a text generation problem while…

Computation and Language · Computer Science 2023-09-14 Joseph Gatto , Omar Sharif , Parker Seegmiller , Philip Bohlman , Sarah Masud Preum

Recent breakthroughs in NLP research, such as the advent of Transformer models have indisputably contributed to major advancements in several tasks. However, few works research robustness and explainability issues of their evaluation…

Computation and Language · Computer Science 2022-10-31 Maria Lymperaiou , George Manoliadis , Orfeas Menis Mastromichalakis , Edmund G. Dervakos , Giorgos Stamou

Search-based test generators are effective at producing unit tests with high coverage. However, such automatically generated tests have no meaningful test and variable names, making them hard to understand and interpret by developers. On…

Software Engineering · Computer Science 2025-06-12 Matteo Biagiola , Gianluca Ghislotti , Paolo Tonella

Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks. Despite recent advancements towards the interpretability of these models, understanding internal representations of LMMs…

Machine Learning · Computer Science 2024-12-03 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Alasdair Newson , Matthieu Cord

Language models (LMs) like GPT-4 are important in AI applications, but their opaque decision-making process reduces user trust, especially in safety-critical areas. We introduce LMExplainer, a novel knowledge-grounded explainer that…

Computation and Language · Computer Science 2024-07-17 Zichen Chen , Jianda Chen , Yuanyuan Chen , Han Yu , Ambuj K Singh , Misha Sra

Capability ontologies are increasingly used to model functionalities of systems or machines. The creation of such ontological models with all properties and constraints of capabilities is very complex and can only be done by ontology…

Artificial Intelligence · Computer Science 2024-10-21 Luis Miguel Vieira da Silva , Aljosha Köcher , Felix Gehlhoff , Alexander Fay

We present a generalizable classification approach that leverages Large Language Models (LLMs) to facilitate the detection of implicitly encoded social meaning in conversations. We design a multi-faceted prompt to extract a textual…

Computation and Language · Computer Science 2024-07-01 Ritam Dutt , Zhen Wu , Kelly Shi , Divyanshu Sheth , Prakhar Gupta , Carolyn Penstein Rose

Semantic parsing is the problem of deriving machine interpretable meaning representations from natural language utterances. Neural models with encoder-decoder architectures have recently achieved substantial improvements over traditional…

Computation and Language · Computer Science 2019-09-30 Huseyin A. Inan , Gaurav Singh Tomar , Huapu Pan

This paper presents a novel methodological framework for detecting and classifying latent constructs, including frames, narratives, and topics, from textual data using Open-Source Large Language Models (LLMs). The proposed hybrid approach…

Computation and Language · Computer Science 2025-04-01 Maël Kubli

Large Language Models (LLMs) recently demonstrated capabilities for generating source code in common programming languages. Additionally, commercial products such as ChatGPT 4 started to provide code interpreters, allowing for the automatic…

Software Engineering · Computer Science 2023-11-15 Felix Härer

Large language models can be prompted to produce text. They can also be prompted to produce "explanations" of their output. But these are not really explanations, because they do not accurately reflect the mechanical process underlying the…

Human-Computer Interaction · Computer Science 2024-05-08 Advait Sarkar

In this paper, we tackle the task of definition modeling, where the goal is to learn to generate definitions of words and phrases. Existing approaches for this task are discriminative, combining distributional and lexical semantics in an…

Computation and Language · Computer Science 2020-10-08 Machel Reid , Edison Marrese-Taylor , Yutaka Matsuo

Word embeddings capture syntactic and semantic information about words. Definition modeling aims to make the semantic content in each embedding explicit, by outputting a natural language definition based on the embedding. However, existing…

Computation and Language · Computer Science 2019-09-23 Ruimin Zhu , Thanapon Noraset , Alisa Liu , Wenxin Jiang , Doug Downey

We propose a novel framework ConceptX, to analyze how latent concepts are encoded in representations learned within pre-trained language models. It uses clustering to discover the encoded concepts and explains them by aligning with a large…

Computation and Language · Computer Science 2022-06-28 Hassan Sajjad , Nadir Durrani , Fahim Dalvi , Firoj Alam , Abdul Rafae Khan , Jia Xu

Large language models have achieved remarkable success in general language understanding tasks. However, as a family of generative methods with the objective of next token prediction, the semantic evolution with the depth of these models…

Computation and Language · Computer Science 2024-06-11 Zhu Liu , Cunliang Kong , Ying Liu , Maosong Sun

Advancements in natural language generation (NLG) and large language models (LLMs) have led to proficient text generation in various tasks. However, integrating intricate constraints into neural text generation, due to LLMs' opacity,…

Computation and Language · Computer Science 2024-03-22 Xiang Chen , Xiaojun Wan