English
Related papers

Related papers: Open-Set Language Identification

200 papers

Dataset curation has become a basis for strong large language model (LLM) performance. While various rule-based filtering heuristics exist for English and multilingual datasets, model-based filtering techniques have primarily focused on…

Computation and Language · Computer Science 2026-02-20 Bettina Messmer , Vinko Sabolčec , Martin Jaggi

The quality of a multilingual speech recognition system can be improved by adaptation methods if the input language is specified. For systems that can accept multilingual inputs, the popular approach is to apply a language identifier to the…

Computation and Language · Computer Science 2020-05-05 Van Huy Nguyen , Thi Quynh Khanh Dinh , Truong Thinh Nguyen , Dang Khoa Mac

Face recognition has been widely studied due to its importance in different applications; however, most of the proposed methods fail when face images are occluded or captured under illumination and pose variations. Recently several low-rank…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 Homa Foroughi , Moein Shakeri , Nilanjan Ray , Hong Zhang

Open-set face recognition describes a scenario where unknown subjects, unseen during the training stage, appear on test time. Not only it requires methods that accurately identify individuals of interest, but also demands approaches that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Rafael Henrique Vareto , William Robson Schwartz

Multilingual (or cross-lingual) embeddings represent several languages in a unique vector space. Using a common embedding space enables for a shared semantic between words from different languages. In this paper, we propose to embed images…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Maxime Portaz , Hicham Randrianarivo , Adrien Nivaggioli , Estelle Maudet , Christophe Servan , Sylvain Peyronnet

Visual recognition tasks are often limited to dealing with a small subset of classes simply because the labels for the remaining classes are unavailable. We are interested in identifying novel concepts in a dataset through representation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Geeho Kim , Junoh Kang , Bohyung Han

One-class classification (OCC), which models one single positive class and distinguishes it from the negative class, has been a long-standing topic with pivotal application to realms like anomaly detection. As modern society often deals…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Siqi Wang , Jiyuan Liu , Guang Yu , Xinwang Liu , Sihang Zhou , En Zhu , Yuexiang Yang , Jianping Yin

Many NLP applications require disambiguating polysemous words. Existing methods that learn polysemous word vector representations involve first detecting various senses and optimizing the sense-specific embeddings separately, which are…

Computation and Language · Computer Science 2017-08-16 Yifan Sun , Nikhil Rao , Weicong Ding

Interpreting the learned features of vision models has posed a longstanding challenge in the field of machine learning. To address this issue, we propose a novel method that leverages the capabilities of language models to interpret the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Saeid Asgari Taghanaki , Aliasghar Khani , Ali Saheb Pasand , Amir Khasahmadi , Aditya Sanghi , Karl D. D. Willis , Ali Mahdavi-Amiri

We propose a deep learning-based solution for the problem of feature learning in one-class classification. The proposed method operates on top of a Convolutional Neural Network (CNN) of choice and produces descriptive features while…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Pramuditha Perera , Vishal M. Patel

We present a new method for estimating vector space representations of words: embedding learning by concept induction. We test this method on a highly parallel corpus and learn semantic representations of words in 1259 different languages…

Computation and Language · Computer Science 2018-06-28 Philipp Dufter , Mengjie Zhao , Martin Schmitt , Alexander Fraser , Hinrich Schütze

The open-set text recognition task is an emerging challenge that requires an extra capability to cognize novel characters during evaluation. We argue that a major cause of the limited performance for current methods is the confounding…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Chang Liu , Chun Yang , Xu-Cheng Yin

In this paper, we propose the first multilingual study on definition modeling. We use monolingual dictionary data for four new languages (Spanish, French, Portuguese, and German) and perform an in-depth empirical study to test the…

Computation and Language · Computer Science 2025-06-03 Edison Marrese-Taylor , Erica K. Shimomoto , Alfredo Solano , Enrique Reid

Multilingual pretrained language models (such as multilingual BERT) have achieved impressive results for cross-lingual transfer. However, due to the constant model capacity, multilingual pre-training usually lags behind the monolingual…

Computation and Language · Computer Science 2019-11-12 Zewen Chi , Li Dong , Furu Wei , Xian-Ling Mao , Heyan Huang

Many applications require categorization of text documents using predefined categories. The main approach to performing text categorization is learning from labeled examples. For many tasks, it may be difficult to find examples in one…

Computation and Language · Computer Science 2018-02-13 Sarai Duek , Shaul Markovitch

A statistical classification algorithm and its application to language identification from noisy input are described. The main innovation is to compute confidence limits on the classification, so that the algorithm terminates when enough…

Computation and Language · Computer Science 2007-05-23 David Elworthy

Real-world recognition system often encounters the challenge of unseen labels. To identify such unseen labels, multi-label zero-shot learning (ML-ZSL) focuses on transferring knowledge by a pre-trained textual label embedding (e.g., GloVe).…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Bo Ren , Shu-Tao Xia

Image-classification datasets have been used to pretrain image recognition models. Recently, web-scale image-caption datasets have emerged as a source of powerful pretraining alternative. Image-caption datasets are more ``open-domain'',…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Kuniaki Saito , Kihyuk Sohn , Xiang Zhang , Chun-Liang Li , Chen-Yu Lee , Kate Saenko , Tomas Pfister

In this paper we propose and carefully evaluate a sequence labeling framework which solely utilizes sparse indicator features derived from dense distributed word representations. The proposed model obtains (near) state-of-the art…

Computation and Language · Computer Science 2016-12-22 Gábor Berend

Slot filling is an important problem in Spoken Language Understanding (SLU) and Natural Language Processing (NLP), which involves identifying a user's intent and assigning a semantic concept to each word in a sentence. This paper presents a…

Computation and Language · Computer Science 2018-06-20 Ruixi Lin