中文
相关论文

相关论文: Part-of-Speech-Tagging using morphological informa…

200 篇论文

There have been multiple attempts to resolve various inflection matching problems in information retrieval. Stemming is a common approach to this end. Among many techniques for stemming, statistical stemming has been shown to be effective…

信息检索 · 计算机科学 2016-06-22 Javid Dadashkarimi , Hossein Nasr Esfahani , Heshaam Faili , Azadeh Shakery

Detecting synthetic from real speech is increasingly crucial due to the risks of misinformation and identity impersonation. While various datasets for synthetic speech analysis have been developed, they often focus on specific areas,…

声音 · 计算机科学 2025-07-18 Zhoulin Ji , Chenhao Lin , Hang Wang , Chao Shen

A methodology based upon recurrence quantification analysis is proposed for the study of orthographic structure of written texts. Five different orthographic data sets (20th century Italian poems, 20th century American poems, contemporary…

cmp-lg · 计算机科学 2012-08-27 F. Orsucci , K. Walter , A. Giuliani , C. L. Webber, , J. P. Zbilut

Nous pr\'esentons dans cette contribution une approche \`a la fois symbolique et probabiliste permettant d'extraire l'information sur la segmentation du signal de parole \`a partir d'information prosodique. Nous utilisons pour ce faire des…

机器学习 · 计算机科学 2008-12-18 Irina Nesterenko , Stéphane Rauzy

This paper presents a method for large corpus analysis to semantically classify an entire clause. In particular, we use cooccurrence statistics among similar clauses to determine the aspectual class of an input clause. The process examines…

cmp-lg · 计算机科学 2008-02-03 Eric V. Siegel , Kathleen R. McKeown

Based on data from a large-scale experiment with human subjects, we conclude that the logarithm of probability to guess a word in context (unpredictability) depends linearly on the word length. This result holds both for poetry and prose,…

信息论 · 计算机科学 2007-07-16 Dmitrii Manin

This article is devoted to the verification of the empirical Heaps law in European languages using Google Books Ngram corpus data. The connection between word distribution frequency and expected dependence of individual word number on text…

计算与语言 · 计算机科学 2020-03-30 Vladimir V. Bochkarev , Eduard Yu. Lerner , Anna V. Shevlyakova

We present a pipeline for a statistical textual exploration, offering a stylometry-based explanation and statistical validation of a hypothesized partition of a text. Given a parameterization of the text, our pipeline: (1) detects literary…

计算与语言 · 计算机科学 2023-06-13 Gideon Yoffe , Axel Bühler , Nachum Dershowitz , Israel Finkelstein , Eli Piasetzky , Thomas Römer , Barak Sober

New events emerge over time influencing the topics of rumors in social media. Current rumor detection benchmarks use random splits as training, development and test sets which typically results in topical overlaps. Consequently, models…

计算与语言 · 计算机科学 2023-02-08 Yida Mu , Kalina Bontcheva , Nikolaos Aletras

As more historical texts are digitized, there is interest in applying natural language processing tools to these archives. However, the performance of these tools is often unsatisfactory, due to language change and genre differences.…

计算与语言 · 计算机科学 2016-04-05 Yi Yang , Jacob Eisenstein

One of the major challenges that NLP faces is metaphor detection, especially by automatic means, a task that becomes even more difficult for languages lacking in linguistic resources and tools. Our purpose is the automatic differentiation…

计算与语言 · 计算机科学 2019-02-12 Eirini Florou , Konstantinos Perifanos , Dionysis Goutsos

Language modeling, a central task in natural language processing, involves estimating a probability distribution over strings. In most cases, the estimated distribution sums to 1 over all finite strings. However, in some pathological cases,…

计算与语言 · 计算机科学 2023-08-23 Li Du , Lucas Torroba Hennigen , Tiago Pimentel , Clara Meister , Jason Eisner , Ryan Cotterell

Unsupervised word segmentation in audio utterances is challenging as, in speech, there is typically no gap between words. In a preliminary experiment, we show that recent deep self-supervised features are very effective for word…

音频与语音处理 · 电气工程与系统科学 2023-04-04 Tzeviya Sylvia Fuchs , Yedid Hoshen

This paper introduces a new statistical approach to partitioning text automatically into coherent segments. Our approach enlists both short-range and long-range language models to help it sniff out likely sites of topic changes in text. To…

cmp-lg · 计算机科学 2008-02-03 Doug Beeferman , Adam Berger , John Lafferty

Ancient Chinese word segmentation (WSG) and part-of-speech tagging (POS) are important to study ancient Chinese, but the amount of ancient Chinese WSG and POS tagging data is still rare. In this paper, we propose a novel augmentation method…

计算与语言 · 计算机科学 2023-03-07 Shuo Feng , Piji Li

This paper proposes to use distributed representation of words (word embeddings) in cross-language textual similarity detection. The main contributions of this paper are the following: (a) we introduce new cross-language similarity…

计算与语言 · 计算机科学 2017-02-13 J. Ferrero , F. Agnes , L. Besacier , D. Schwab

The probabilistic Latent Semantic Indexing model assumes that the expectation of the corpus matrix is low-rank and can be written as the product of a topic-word matrix and a word-document matrix. In this paper, we study the estimation of…

统计方法学 · 统计学 2023-10-11 Huy Tran , Yating Liu , Claire Donnat

This paper investigates part-of-speech tagging, an important task in Natural Language Processing (NLP) for the Nagamese language. The Nagamese language, a.k.a. Naga Pidgin, is an Assamese-lexified Creole language developed primarily as a…

计算与语言 · 计算机科学 2025-10-14 Alovi N Shohe , Chonglio Khiamungam , Teisovi Angami

Verifying the veracity of claims requires reasoning over a large knowledge base, often in the form of corpora of trustworthy sources. A common approach consists in retrieving short portions of relevant text from the reference documents and…

信息检索 · 计算机科学 2021-09-14 Misael Mongiovì , Aldo Gangemi

Much recent work in NLP has documented dataset artifacts, bias, and spurious correlations between input features and output labels. However, how to tell which features have "spurious" instead of legitimate correlations is typically left…

计算与语言 · 计算机科学 2021-12-30 Matt Gardner , William Merrill , Jesse Dodge , Matthew E. Peters , Alexis Ross , Sameer Singh , Noah A. Smith