English
Related papers

Related papers: Improving Document Clustering by Eliminating Unnat…

200 papers

Natural Language Processing offers new insights into language data across almost all disciplines and domains, and allows us to corroborate and/or challenge existing knowledge. The primary hurdles to widening participation in and use of…

Computation and Language · Computer Science 2021-05-31 Rebekah Baglini , Arthur Hjorth

Many search systems work with large amounts of natural language data, e.g., search queries, user profiles, and documents. Building a successful search system requires a thorough understanding of textual data semantics, where deep learning…

Information Retrieval · Computer Science 2021-08-31 Weiwei Guo , Xiaowei Liu , Sida Wang , Michaeel Kazi , Zhiwei Wang , Zhoutong Fu , Jun Jia , Liang Zhang , Huiji Gao , Bo Long

Many of the kinds of language model used in speech understanding suffer from imperfect modeling of intra-sentential contextual influences. I argue that this problem can be addressed by clustering the sentences in a training corpus…

cmp-lg · Computer Science 2008-02-03 David Carter

Cross-lingual plagiarism (CLP) occurs when texts written in one language are translated into a different language and used without acknowledging the original sources. One of the most common methods for detecting CLP requires online machine…

Computation and Language · Computer Science 2018-01-04 Victor Thompson

Incorporating linguistic, world and common sense knowledge into AI/NLP systems is currently an important research area, with several open problems and challenges. At the same time, processing and storing this knowledge in lexical resources…

Computation and Language · Computer Science 2018-07-03 Jose Camacho-Collados , Luis Espinosa-Anke , Mohammad Taher Pilehvar

Recent work in behavioral testing for natural language processing (NLP) models, such as Checklist, is inspired by related paradigms in software engineering testing. They allow evaluation of general linguistic capabilities and domain…

Computation and Language · Computer Science 2024-08-09 Ying Li , Rahul Singh , Tarun Joshi , Agus Sudjianto

Traditionally in the domain of legal research, the retrieval of pertinent citations from intricate case descriptions has demanded manual effort and keyword-based search applications that mandate expertise in understanding legal jargon.…

Information Retrieval · Computer Science 2024-08-16 Akshat Mohan Dasula , Hrushitha Tigulla , Preethika Bhukya

Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context…

Computation and Language · Computer Science 2023-11-22 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Despite alarm over the reliance of machine learning systems on so-called spurious patterns, the term lacks coherent meaning in standard statistical frameworks. However, the language of causality offers clarity: spurious associations are due…

Computation and Language · Computer Science 2020-02-18 Divyansh Kaushik , Eduard Hovy , Zachary C. Lipton

The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of…

Computation and Language · Computer Science 2020-06-17 Victor Zitian Chen , Felipe Montano-Campos , Wlodek Zadrozny

This paper explores the use of clustering methods and machine learning algorithms, including Natural Language Processing (NLP), to identify and classify problems identified in credit risk models through textual information contained in…

Machine Learning · Computer Science 2023-06-05 Szymon Lis , Mariusz Kubkowski , Olimpia Borkowska , Dobromił Serwa , Jarosław Kurpanik

Topic modelling, as a well-established unsupervised technique, has found extensive use in automatically detecting significant topics within a corpus of documents. However, classic topic modelling approaches (e.g., LDA) have certain…

Computation and Language · Computer Science 2024-03-27 Yida Mu , Chun Dong , Kalina Bontcheva , Xingyi Song

Keyphrases are useful for a variety of purposes, including summarizing, indexing, labeling, categorizing, clustering, highlighting, browsing, and searching. The task of automatic keyphrase extraction is to select keyphrases from within the…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

The dynamic web has increased exponentially over the past few years with more than thousands of documents related to a subject available to the user now. Most of the web documents are unstructured and not in an organized manner and hence…

Information Retrieval · Computer Science 2014-06-24 R. K. Roul , O. R. Devanand , S. K. Sahay

Disagreement in annotation is a common phenomenon in the development of NLP datasets and serves as a valuable source of insight. While majority voting remains the dominant strategy for aggregating labels, recent work has explored modeling…

Nowadays, with the booming development of the Internet, people benefit from its convenience due to its open and sharing nature. A large volume of natural language texts is being generated by users in various forms, such as search queries,…

Computation and Language · Computer Science 2019-08-07 Chenwei Zhang

Content based Document Classification is one of the biggest challenges in the context of free text mining. Current algorithms on document classifications mostly rely on cluster analysis based on bag-of-words approach. However that method is…

Information Retrieval · Computer Science 2015-12-15 Koushiki Sarkar , Ritwika Law

The preprocessing pipelines in Natural Language Processing usually involve a step of removing sentences consisted of illegal characters. The definition of illegal characters and the specific removal strategy depend on the task, language,…

Computation and Language · Computer Science 2019-08-27 Yingbo Gao , Weiyue Wang , Hermann Ney

Cross-lingual document search is an information retrieval task in which the queries' language differs from the documents' language. In this paper, we study the instability of neural document search models and propose a novel end-to-end…

Information Retrieval · Computer Science 2020-11-03 Jiapeng Liu , Xiao Zhang , Dan Goldwasser , Xiao Wang

With the ongoing growth in number of digital articles in a wider set of languages and the expanding use of different languages, we need annotation methods that enable browsing multi-lingual corpora. Multilingual probabilistic topic models…

Computation and Language · Computer Science 2021-01-11 Carlos Badenes-Olmedo , Jose-Luis Redondo García , Oscar Corcho