English
Related papers

Related papers: Hierarchical Interpretation of Neural Text Classif…

200 papers

Topics models, such as LDA, are widely used in Natural Language Processing. Making their output interpretable is an important area of research with applications to areas such as the enhancement of exploratory search interfaces and the…

Computation and Language · Computer Science 2019-04-01 Areej Alokaili , Nikolaos Aletras , Mark Stevenson

Neural document ranking models perform impressively well due to superior language understanding gained from pre-training tasks. However, due to their complexity and large number of parameters, these (typically transformer-based) models are…

Information Retrieval · Computer Science 2022-12-02 Jurek Leonhardt , Koustav Rudra , Avishek Anand

Researchers have relegated natural language processing tasks to Transformer-type models, particularly generative models, because these models exhibit high versatility when performing generation and classification tasks. As the size of these…

Computation and Language · Computer Science 2025-04-04 Fabio Yáñez-Romero , Andrés Montoyo , Armando Suárez , Yoan Gutiérrez , Ruslan Mitkov

Extraction from raw text to a knowledge base of entities and fine-grained types is often cast as prediction into a flat set of entity and type labels, neglecting the rich hierarchies over types and entities contained in curated ontologies.…

Computation and Language · Computer Science 2018-07-16 Shikhar Murty* , Patrick Verga* , Luke Vilnis , Irena Radovanovic , Andrew McCallum

The classic supervised classification algorithms are efficient, but time-consuming, complicated and not interpretable, which makes it difficult to analyze their results that limits the possibility to improve them based on real observations.…

Computation and Language · Computer Science 2018-03-05 Hussam Hamdan

Distributed word vector spaces are considered hard to interpret which hinders the understanding of natural language processing (NLP) models. In this work, we introduce a new method to interpret arbitrary samples from a word vector space. To…

Computation and Language · Computer Science 2019-04-03 Robert Schwarzenberg , Lisa Raithel , David Harbecke

Neural networks provide new possibilities to automatically learn complex language patterns and query-document relations. Neural IR models have achieved promising results in learning query-document relevance patterns, but few explorations…

Information Retrieval · Computer Science 2019-05-23 Zhuyun Dai , Jamie Callan

Recent works show that learning contextualized embeddings for words is beneficial for downstream tasks. BERT is one successful example of this approach. It learns embeddings by solving two tasks, which are masked language model (masked LM)…

Computation and Language · Computer Science 2020-11-10 Çağla Aksoy , Alper Ahmetoğlu , Tunga Güngör

Experimental methods for estimating the impacts of text on human evaluation have been widely used in the social sciences. However, researchers in experimental settings are usually limited to testing a small number of pre-specified text…

Computation and Language · Computer Science 2024-12-04 Megan Ayers , Luke Sanford , Margaret Roberts , Eddie Yang

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Depression is a common mental disorder. Automatic depression detection tools using speech, enabled by machine learning, help early screening of depression. This paper addresses two limitations that may hinder the clinical implementations of…

Computation and Language · Computer Science 2023-10-09 Qingkun Deng , Saturnino Luz , Sofia de la Fuente Garcia

Most existing Neural Machine Translation models use groups of characters or whole words as their unit of input and output. We propose a model with a hierarchical char2word encoder, that takes individual characters both as input and output.…

Computation and Language · Computer Science 2016-10-21 Alexander Rosenberg Johansen , Jonas Meinertz Hansen , Elias Khazen Obeid , Casper Kaae Sønderby , Ole Winther

Attention mechanisms in sequence to sequence models have shown great ability and wonderful performance in various natural language processing (NLP) tasks, such as sentence embedding, text generation, machine translation, machine reading…

Computation and Language · Computer Science 2018-08-14 Zehao Dou , Zhihua Zhang

Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmentation rules to…

Computation and Language · Computer Science 2024-03-27 He Zhu , Junran Wu , Ruomei Liu , Yue Hou , Ze Yuan , Shangzhe Li , Yicheng Pan , Ke Xu

In probabilistic approaches to classification and information extraction, one typically builds a statistical model of words under the assumption that future data will exhibit the same regularities as the training data. In many data sets,…

Machine Learning · Computer Science 2013-01-07 David Blei , J Andrew Bagnell , Andrew McCallum

Current breakthroughs in natural language processing have benefited dramatically from neural language models, through which distributional semantics can leverage neural data representations to facilitate downstream applications. Since…

Computation and Language · Computer Science 2022-10-04 Dongqiang Yang , Ning Li , Li Zou , Hongwei Ma

The current deep neural network algorithm still stays in the end-to-end training supervision method like Image-Label pairs, which makes traditional algorithm is difficult to explain the reason for the results, and the prediction logic is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yishuang Tian , Ning Wang , Liang Zhang

Mining a set of meaningful topics organized into a hierarchy is intuitively appealing since topic correlations are ubiquitous in massive text corpora. To account for potential hierarchical topic structures, hierarchical topic models…

Computation and Language · Computer Science 2020-07-21 Yu Meng , Yunyi Zhang , Jiaxin Huang , Yu Zhang , Chao Zhang , Jiawei Han

Time series classification is a task of paramount importance, as this kind of data often arises in safety-critical applications. However, it is typically tackled with black-box deep learning methods, making it hard for humans to understand…

Machine Learning · Computer Science 2025-08-28 Irene Ferfoglia , Simone Silvetti , Gaia Saveri , Laura Nenzi , Luca Bortolussi

The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text classification and explanation. Existing prototype-based models offer intuitive explanations but…

Artificial Intelligence · Computer Science 2026-05-19 Utsav Kumar Nareti , Suraj Kumar , Soumya Pandey , Soumi Chattopadhyay , Chandranath Adak , Sankha Subhra Mullick