English
Related papers

Related papers: Text classification with word embedding regulariza…

200 papers

Word embeddings learnt from large corpora have been adopted in various applications in natural language processing and served as the general input representations to learning systems. Recently, a series of post-processing methods have been…

Machine Learning · Computer Science 2019-10-25 Shuai Tang , Mahta Mousavi , Virginia R. de Sa

Conventional text classification models make a bag-of-words assumption reducing text into word occurrence counts per document. Recent algorithms such as word2vec are capable of learning semantic meaning and similarity between words in an…

Computation and Language · Computer Science 2018-07-11 Vincent Major , Alisa Surkis , Yindalon Aphinyanaphongs

Word embeddings have been widely used in biomedical Natural Language Processing (NLP) applications as they provide vector representations of words capturing the semantic properties of words and the linguistic relationship between words.…

Information Retrieval · Computer Science 2018-07-20 Yanshan Wang , Sijia Liu , Naveed Afzal , Majid Rastegar-Mojarad , Liwei Wang , Feichen Shen , Paul Kingsbury , Hongfang Liu

Text classification is the task of assigning a document to a predefined class. However, it is expensive to acquire enough labeled documents or to label them. In this paper, we study the regularization methods' effects on various…

Computation and Language · Computer Science 2024-03-05 Jongga Lee , Jaeseung Yim , Seohee Park , Changwon Lim

Measuring the semantic similarity between two sentences is still an important task. The word mover's distance (WMD) computes the similarity via the optimal alignment between the sets of word embeddings. However, WMD does not utilize word…

Computation and Language · Computer Science 2023-11-03 Hiroaki Yamagiwa , Sho Yokoi , Hidetoshi Shimodaira

The inclusion of semantic information in any similarity measures improves the efficiency of the similarity measure and provides human interpretable results for further analysis. The similarity calculation method that focuses on features…

Information Retrieval · Computer Science 2019-11-01 Pinky Sitikhu , Kritish Pahi , Pujan Thapa , Subarna Shakya

Word and sentence embeddings are useful feature representations in natural language processing. However, intrinsic evaluation for embeddings lags far behind, and there has been no significant update since the past decade. Word and sentence…

Computation and Language · Computer Science 2022-03-22 Bin Wang , C. -C. Jay Kuo , Haizhou Li

Our task is to generate an effective summary for a given document with specific realtime requirements. We use the softplus function to enhance keyword rankings to favor important sentences, based on which we present a number of…

Information Retrieval · Computer Science 2017-10-03 Liqun Shao , Hao Zhang , Ming Jia , Jie Wang

Word embeddings are now ubiquitous forms of word representation in natural language processing. There have been applications of word embeddings for monolingual word sense disambiguation (WSD) in English, but few comparisons have been done.…

Computation and Language · Computer Science 2017-04-11 Hong Jin Kang , Tao Chen , Muthu Kumar Chandrasekaran , Min-Yen Kan

Word similarity has many applications to social science and cultural analytics tasks like measuring meaning change over time and making sense of contested terms. Yet traditional similarity methods based on cosine similarity between word…

Computation and Language · Computer Science 2025-02-11 Kaitlyn Zhou , Haishan Gao , Sarah Chen , Dan Edelstein , Dan Jurafsky , Chen Shani

Text similarity calculation is a fundamental problem in natural language processing and related fields. In recent years, deep neural networks have been developed to perform the task and high performances have been achieved. The neural…

Computation and Language · Computer Science 2018-10-26 Yilin Niu , Chao Qiao , Hang Li , Minlie Huang

The Word Mover's Distance (WMD) is a metric that measures the semantic dissimilarity between two text documents by computing the cost of moving all words of a source/query document to the most similar words of a target document optimally.…

Machine Learning · Computer Science 2021-03-24 Jesmin Jahan Tithi , Fabrizio Petrini

Efficient distributed numerical word representation models (word embeddings) combined with modern machine learning algorithms have recently yielded considerable improvement on automatic document classification tasks. However, the…

Computation and Language · Computer Science 2018-09-07 Roger A. Stein , Patricia A. Jaques , Joao F. Valiati

We present a supervised learning algorithm for text categorization which has brought the team of authors the 2nd place in the text categorization division of the 2012 Cybersecurity Data Mining Competition (CDMC'2012) and a 3rd prize…

Information Retrieval · Computer Science 2013-07-11 Hubert Haoyang Duan , Vladimir Pestov , Varun Singla

Assessing the proper difficulty levels of reading materials or texts in general is the first step towards effective comprehension and learning. In this study, we improve the conventional methodology of automatic readability assessment by…

Computation and Language · Computer Science 2021-09-21 Joseph Marvin Imperial , Ethel Ong

Text classification is one of the most frequent tasks for processing textual data, facilitating among others research from large-scale datasets. Embeddings of different kinds have recently become the de facto standard as features used for…

Computation and Language · Computer Science 2020-09-03 Arkaitz Zubiaga

Text classification has become indispensable due to the rapid increase of text in digital form. Over the past three decades, efforts have been made to approach this task using various learning algorithms and statistical models based on…

Machine Learning · Statistics 2018-06-11 Erica K. Shimomoto , Lincon S. Souza , Bernardo B. Gatto , Kazuhiro Fukui

Text document classification is an important task for diverse natural language processing based applications. Traditional machine learning approaches mainly focused on reducing dimensionality of textual data to perform classification. This…

Computation and Language · Computer Science 2019-09-13 Muhammad Nabeel Asim , Muhammad Usman Ghani Khan , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

With the booming of Large Language Models (LLMs), prompt-learning has become a promising method mainly researched in various research areas. Recently, many attempts based on prompt-learning have been made to improve the performance of text…

Computation and Language · Computer Science 2024-06-07 Chun Liu , Hongguang Zhang , Kainan Zhao , Xinghai Ju , Lin Yang

A promising approach for knowledge-based Word Sense Disambiguation (WSD) is to select the sense whose contextualized embeddings computed for its definition sentence are closest to those computed for a target word in a given sentence. This…

Computation and Language · Computer Science 2023-04-25 Sakae Mizuki , Naoaki Okazaki