English
Related papers

Related papers: On the Difficulty of Segmenting Words with Attenti…

200 papers

This paper presents a model-based, unsupervised algorithm for recovering word boundaries in a natural-language text from which they have been deleted. The algorithm is derived from a probability model of the source that generated the text.…

Computation and Language · Computer Science 2007-05-23 Michael R. Brent

Word or word-fragment based Language Models (LM) are typically preferred over character-based ones in many downstream applications. This may not be surprising as words seem more linguistically relevant units than characters. Words provide…

Computation and Language · Computer Science 2022-10-07 Tu Anh Nguyen , Maureen de Seyssel , Robin Algayres , Patricia Roze , Ewan Dunbar , Emmanuel Dupoux

Word discovery is the task of extracting words from unsegmented text. In this paper we examine to what extent neural networks can be applied to this task in a realistic unwritten language scenario, where only small corpora and limited…

Computation and Language · Computer Science 2017-09-20 Marcely Zanon Boito , Alexandre Berard , Aline Villavicencio , Laurent Besacier

Active learning is particularly of interest for semantic segmentation, where annotations are costly. Previous academic studies focused on datasets that are already very diverse and where the model is trained in a supervised manner with a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sudhanshu Mittal , Joshua Niemeijer , Jörg P. Schäfer , Thomas Brox

The debate around the interpretability of attention mechanisms is centered on whether attention scores can be used as a proxy for the relative amounts of signal carried by sub-components of data. We propose to study the interpretability of…

Machine Learning · Computer Science 2022-07-27 Jonathan Haab , Nicolas Deutschmann , Maria Rodríguez Martínez

The use of subword-level information (e.g., characters, character n-grams, morphemes) has become ubiquitous in modern word representation learning. Its importance is attested especially for morphologically rich languages which generate a…

Computation and Language · Computer Science 2019-05-07 Yi Zhu , Ivan Vulić , Anna Korhonen

Segmentation localizes objects in an image on a fine-grained per-pixel scale. Segmentation benefits by humans-in-the-loop to provide additional input of objects to segment using a combination of foreground or background clicks. Tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Nikolai Warner , Meera Hahn , Jonathan Huang , Irfan Essa , Vighnesh Birodkar

Most language modeling methods rely on large-scale data to statistically learn the sequential patterns of words. In this paper, we argue that words are atomic language units but not necessarily atomic semantic units. Inspired by HowNet, we…

Computation and Language · Computer Science 2018-10-31 Yihong Gu , Jun Yan , Hao Zhu , Zhiyuan Liu , Ruobing Xie , Maosong Sun , Fen Lin , Leyu Lin

Categorical speech emotion recognition is typically performed as a sequence-to-label problem, i.e., to determine the discrete emotion label of the input utterance as a whole. One of the main challenges in practice is that most of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Shuiyang Mao , P. C. Ching , C. -C. Jay Kuo , Tan Lee

Ranking functions in information retrieval are often used in search engines to recommend the relevant answers to the query. This paper makes use of this notion of information retrieval and applies onto the problem domain of cognate…

Information Retrieval · Computer Science 2018-11-21 Pranav A

Dividing oral histories into topically coherent segments can make them more accessible online. People regularly make judgments about where coherent segments can be extracted from oral histories. But making these judgments can be taxing, so…

Computation and Language · Computer Science 2015-09-30 Ryan Shaw

Recent progress in Spoken Language Modeling has shown that learning language directly from speech is feasible. Generating speech through a pipeline that operates at the text level typically loses nuances, intonations, and non-verbal…

Computation and Language · Computer Science 2024-10-31 Maxime Poli , Emmanuel Chemla , Emmanuel Dupoux

Auditory attention and selective phase-locking are central to human speech understanding in complex acoustic scenes and cocktail party settings, yet these capabilities in multilingual subjects remain poorly understood. While machine…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Sai Samrat Kankanala , Ram Chandra , Sriram Ganapathy

Many NLP pipelines split text into sentences as one of the crucial preprocessing steps. Prior sentence segmentation tools either rely on punctuation or require a considerable amount of sentence-segmented training data: both central…

Computation and Language · Computer Science 2023-05-31 Benjamin Minixhofer , Jonas Pfeiffer , Ivan Vulić

Referring image segmentation, the task of segmenting any arbitrary entities described in free-form texts, opens up a variety of vision applications. However, manual labeling of training data for this task is prohibitively costly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Dongwon Kim , Namyup Kim , Cuiling Lan , Suha Kwak

The demand for accurate food quantification has increased in the recent years, driven by the needs of applications in dietary monitoring. At the same time, computer vision approaches have exhibited great potential in automating tasks within…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Valasia Vlachopoulou , Ioannis Sarafis , Alexandros Papadopoulos

Describes an audio dataset of spoken words designed to help train and evaluate keyword spotting systems. Discusses why this task is an interesting challenge, and why it requires a specialized dataset that is different from conventional…

Computation and Language · Computer Science 2018-04-11 Pete Warden

Identifying and correcting grammatical errors in the text written by non-native writers has received increasing attention in recent years. Although a number of annotated corpora have been established to facilitate data-driven grammatical…

Computation and Language · Computer Science 2016-11-30 Zhuoran Liu , Yang Liu

End-to-end Speech Translation is hindered by a lack of available data resources. While most of them are based on documents, a sentence-level version is available, which is however single and static, potentially impeding the usefulness of…

Computation and Language · Computer Science 2023-11-02 Ioannis Tsiamas , José A. R. Fonollosa , Marta R. Costa-jussà

Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, making segmentation…

Computation and Language · Computer Science 2025-07-08 Yige Chen , Zelong Li , Cindy Zhang , Changbing Yang , Amandisa Cady , Ai Ka Lee , Zejiao Zeng , Eunkyul Leah Jo , Haihua Pan , Jungyeul Park