English
Related papers

Related papers: Two Steps Feature Selection and Neural Network Cla…

200 papers

Text categorization is the process of grouping documents into categories based on their contents. This process is important to make information retrieval easier, and it became more important due to the huge textual information available…

Information Retrieval · Computer Science 2015-01-08 Ashraf Odeh , Aymen Abu-Errub , Qusai Shambour , Nidal Turab

The exponential growth of data generated on the Internet in the current information age is a driving force for the digital economy. Extraction of information is the major value in an accumulated big data. Big data dependency on statistical…

This work concerns a comparison of SVM kernel methods in text categorization tasks. In particular I define a kernel function that estimates the similarity between two objects computing by their compressed lengths. In fact, compression…

Machine Learning · Computer Science 2012-10-30 Antonio Giuliano Zippo

Many text generation tasks naturally contain two steps: content selection and surface realization. Current neural encoder-decoder models conflate both steps into a black-box architecture. As a result, the content to be described in the text…

Computation and Language · Computer Science 2019-09-11 Xiaoyu Shen , Jun Suzuki , Kentaro Inui , Hui Su , Dietrich Klakow , Satoshi Sekine

Text classification is one of the most frequent tasks for processing textual data, facilitating among others research from large-scale datasets. Embeddings of different kinds have recently become the de facto standard as features used for…

Computation and Language · Computer Science 2020-09-03 Arkaitz Zubiaga

The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last ten years, due to the increased availability of documents in digital form and the ensuing need to organize…

Information Retrieval · Computer Science 2021-09-21 Fabrizio Sebastiani

Topic modeling is used for discovering latent semantic structure, usually referred to as topics, in a large collection of documents. The most widely used methods are Latent Dirichlet Allocation and Probabilistic Latent Semantic Analysis.…

Computation and Language · Computer Science 2020-08-24 Dimo Angelov

The classical method of the thematic classification of texts is based on using the frequency weight on the list of words occurring in texts from the text corpus that determines the theme. In this method , the weight of each word is defined…

Optimization and Control · Mathematics 2017-01-31 Mikhail A. Antonets , Grigoriy P. Kogan

By automatically recognize argument component, essay writers can do some inspections to texts that they have written. It will assist essay scoring process objectively and precisely because essay grader is able to see how well the argument…

Computation and Language · Computer Science 2015-12-03 Derwin Suhartono

Document categorization is a technique where the category of a document is determined. In this paper three well-known supervised learning techniques which are Support Vector Machine(SVM), Na\"ive Bayes(NB) and Stochastic Gradient…

Computation and Language · Computer Science 2017-01-31 Md. Saiful Islam , Fazla Elahi Md Jubayer , Syed Ikhtiar Ahmed

Most approaches for similar text retrieval and ranking with long natural language queries rely at some level on queries and responses having words in common with each other. Recent applications of transformer-based neural language models to…

Information Retrieval · Computer Science 2020-05-22 Javed Qadrud-Din , Ashraf Bah Rabiou , Ryan Walker , Ravi Soni , Martin Gajek , Gabriel Pack , Akhil Rangaraj

Duplicate removal is a critical step to accomplish a reasonable amount of predictions in prevalent proposal-based object detection frameworks. Albeit simple and effective, most previous algorithms utilize a greedy process without making…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Lu Qi , Shu Liu , Jianping Shi , Jiaya Jia

Research has shown that Convolutional Neural Networks (CNN) can be effectively applied to text classification as part of a predictive coding protocol. That said, most research to date has been conducted on data sets with short documents…

Information Retrieval · Computer Science 2019-12-23 Robert Keeling , Rishi Chhatwal , Nathaniel Huber-Fliflet , Jianping Zhang , Fusheng Wei , Haozhen Zhao , Shi Ye , Han Qin

With the advancement in generative language models, the selection of prompts has gained significant attention in recent years. A prompt is an instruction or description provided by the user, serving as a guide for the generative language…

Machine Learning · Statistics 2024-05-21 Haoting Zhang , Jinghai He , Rhonda Righter , Zeyu Zheng

Why do modern language models, trained to do well on next-word prediction, appear to generate coherent documents and capture long-range structure? Here we show that next-token prediction is provably powerful for learning longer-range…

Machine Learning · Computer Science 2025-12-09 Xinyuan Cao , Santosh S. Vempala

Topic evolution modeling has been researched for a long time and has gained considerable interest. A state-of-the-art method has been recently using word modeling algorithms in combination with community detection mechanisms to achieve…

Computation and Language · Computer Science 2019-12-17 Patrick Kiss , Elaheh Momeni

Text classification is the automated assignment of natural language texts to predefined categories based on their content. Text classification is the primary requirement of text retrieval systems, which retrieve texts in response to a user…

Information Retrieval · Computer Science 2010-09-28 S. M. Kamruzzaman , Farhana Haider , Ahmed Ryadh Hasan

We design alignment-free techniques for comparing a sequence or word, called a target, against a set of words, called a reference. A target-specific factor of a target $T$ against a reference $R$ is a factor $w$ of a word in $T$ which is…

Data Structures and Algorithms · Computer Science 2023-04-07 Marie-Pierre Béal , Maxime Crochemore

Texts like news, encyclopedias, and some social media strive for objectivity. Yet bias in the form of inappropriate subjectivity - introducing attitudes via framing, presupposing truth, and casting doubt - remains ubiquitous. This kind of…

Computation and Language · Computer Science 2019-12-13 Reid Pryzant , Richard Diehl Martinez , Nathan Dass , Sadao Kurohashi , Dan Jurafsky , Diyi Yang

In recent years, there has been an increased interest in the application of Natural Language Processing (NLP) to legal documents. The use of convolutional and recurrent neural networks along with word embedding techniques have presented…

Information Retrieval · Computer Science 2020-11-06 Mariana Y. Noguti , Eduardo Vellasques , Luiz S. Oliveira