English
Related papers

Related papers: Improving Text Normalization by Optimizing Nearest…

200 papers

Linear Text Segmentation is the task of automatically tagging text documents with topic shifts, i.e. the places in the text where the topics change. A well-established area of research in Natural Language Processing, drawing from…

Computation and Language · Computer Science 2024-11-26 Iacopo Ghinassi , Lin Wang , Chris Newell , Matthew Purver

This paper describes ANN-Benchmarks, a tool for evaluating the performance of in-memory approximate nearest neighbor algorithms. It provides a standard interface for measuring the performance and quality achieved by nearest neighbor…

Information Retrieval · Computer Science 2018-07-19 Martin Aumüller , Erik Bernhardsson , Alexander Faithfull

This study is to review the approaches used for measuring sentences similarity. Measuring similarity between natural language sentences is a crucial task for many Natural Language Processing applications such as text classification,…

Computation and Language · Computer Science 2019-10-10 Mamdouh Farouk

Image-text retrieval aims to bridge the modality gap and retrieve cross-modal content based on semantic similarities. Prior work usually focuses on the pairwise relations (i.e., whether a data sample matches another) but ignores the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Leigang Qu , Meng Liu , Wenjie Wang , Zhedong Zheng , Liqiang Nie , Tat-Seng Chua

Text segmentation, the task of dividing a document into contiguous segments based on its semantic structure, is a longstanding challenge in language understanding. Previous work on text segmentation focused on unsupervised methods such as…

Computation and Language · Computer Science 2018-03-28 Omri Koshorek , Adir Cohen , Noam Mor , Michael Rotman , Jonathan Berant

We develop a new framework for generalizing approximation algorithms from the structural graph algorithm literature so that they apply to graphs somewhat close to that class (a scenario we expect is common when working with real-world…

Language models (LMs) compute the probability of a text by sequentially computing a representation of an already-seen context and using this representation to predict the next word. Currently, most LMs calculate these representations…

Computation and Language · Computer Science 2023-01-18 Frank F. Xu , Uri Alon , Graham Neubig

We present a supervised learning algorithm for text categorization which has brought the team of authors the 2nd place in the text categorization division of the 2012 Cybersecurity Data Mining Competition (CDMC'2012) and a 3rd prize…

Information Retrieval · Computer Science 2013-07-11 Hubert Haoyang Duan , Vladimir Pestov , Varun Singla

The nearest neighbor rule is a classic yet essential classification model, particularly in problems where the supervising information is given by pairwise dissimilarities and the embedding function are not easily obtained. Prototype…

Machine Learning · Computer Science 2018-01-09 Shin Ando

A synchronizing word of a deterministic finite complete automaton is a word whose action maps every state to a single one. Finding a shortest or a short synchronizing word is a central computational problem in the theory of synchronizing…

Formal Languages and Automata Theory · Computer Science 2022-07-13 Marek Szykuła , Adam Zyzik

Social media data has been of interest to Natural Language Processing (NLP) practitioners for over a decade, because of its richness in information, but also challenges for automatic processing. Since language use is more informal,…

With the current shift in the mass media landscape from journalistic rigor to social media, personalized social media is becoming the new norm. Although the digitalization progress of the media brings many advantages, it also increases the…

Computation and Language · Computer Science 2023-04-18 Ciprian-Octavian Truică , Elena-Simona Apostol

Similarity graphs are an active research direction for the nearest neighbor search (NNS) problem. New algorithms for similarity graph construction are continuously being proposed and analyzed by both theoreticians and practitioners.…

Machine Learning · Computer Science 2020-02-14 Dmitry Baranchuk , Artem Babenko

Normalization techniques are essential for accelerating the training and improving the generalization of deep neural networks (DNNs), and have successfully been used in various applications. This paper reviews and comments on the past,…

Machine Learning · Computer Science 2020-09-29 Lei Huang , Jie Qin , Yi Zhou , Fan Zhu , Li Liu , Ling Shao

Automatic text categorization is a complex and useful task for many natural language processing applications. Recent approaches to text categorization focus more on algorithms than on resources involved in this operation. In contrast to…

cmp-lg · Computer Science 2008-02-03 Jose Maria Gomez Hidalgo , Manuel de Buenaga Rodriguez

Semantic matching of natural language sentences or identifying the relationship between two sentences is a core research problem underlying many natural language tasks. Depending on whether training data is available, prior research has…

Computation and Language · Computer Science 2018-03-02 Bang Liu , Ting Zhang , Fred X. Han , Di Niu , Kunfeng Lai , Yu Xu

Social networks play a fundamental role in propagation of information and news. Characterizing the content of the messages becomes vital for different tasks, like breaking news detection, personalized message recommendation, fake users…

Information Retrieval · Computer Science 2022-01-04 Federico Albanese , Esteban Feuerstein

Network alignment, or the task of finding meaningful node correspondences between nodes in different graphs, is an important graph mining task with many scientific and industrial applications. An important principle for network alignment is…

Social and Information Networks · Computer Science 2021-01-25 Mark Heimann , Xiyuan Chen , Fatemeh Vahedian , Danai Koutra

The general goal of text simplification (TS) is to reduce text complexity for human consumption. This paper investigates another potential use of neural TS: assisting machines performing natural language processing (NLP) tasks. We evaluate…

Computation and Language · Computer Science 2021-09-15 Hoang Van , Zheng Tang , Mihai Surdeanu

In most cases, the lack of parallel corpora makes it impossible to directly train supervised models for the text style transfer task. In this paper, we explore training algorithms that instead optimize reward functions that explicitly…

Computation and Language · Computer Science 2021-05-14 Yixin Liu , Graham Neubig , John Wieting