English
Related papers

Related papers: $k$-Nearest Neighbor Augmented Neural Networks for…

200 papers

We propose a new active learning (AL) method for text classification with convolutional neural networks (CNNs). In AL, one selects the instances to be manually labeled with the aim of maximizing model performance with minimal effort. Neural…

Computation and Language · Computer Science 2016-12-02 Ye Zhang , Matthew Lease , Byron C. Wallace

Finetuning is a common practice widespread across different communities to adapt pretrained models to particular tasks. Text classification is one of these tasks for which many pretrained models are available. On the other hand, ensembles…

Computation and Language · Computer Science 2024-10-29 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

The objective of this study is to develop a good risk model for classifying business delinquency by simultaneously exploring several machine learning based methods including regularization, hyper-parameter optimization, and model ensembling…

Machine Learning · Computer Science 2020-10-13 Yan Wang , Xuelei Sherry Ni

This paper proposes a novel acoustic word embedding called Acoustic Neighbor Embeddings where speech or text of arbitrary length are mapped to a vector space of fixed, reduced dimensions by adapting stochastic neighbor embedding (SNE) to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-10 Woojay Jeon

Long text brings a big challenge to semantic matching due to their complicated semantic and syntactic structures. To tackle the challenge, we consider using prior knowledge to help identify useful information and filter out noise to…

Computation and Language · Computer Science 2016-11-16 Yu Wu , Wei Wu , Zhoujun Li , Ming Zhou

Non-parametric neural language models (NLMs) learn predictive distributions of text utilizing an external datastore, which allows them to learn through explicitly memorizing the training datapoints. While effective, these models often…

Computation and Language · Computer Science 2021-11-16 Junxian He , Graham Neubig , Taylor Berg-Kirkpatrick

Neural machine translation has achieved promising results on many translation tasks. However, previous studies have shown that neural models induce a non-smooth representation space, which harms its generalization results. Recently, kNN-MT…

Computation and Language · Computer Science 2023-06-13 Wenhao Zhu , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen

The traditional k nearest neighbor (kNN) approach uses a distance formula within a spherical region to determine the k closest training observations to a test sample point. However, this approach may not work well when test point is located…

Machine Learning · Statistics 2024-02-19 Amjad Ali , Zardad Khan , Dost Muhammad Khan , Saeed Aldahmani

Recent deep learning models have demonstrated strong capabilities for classifying text and non-text components in natural images. They extract a high-level feature computed globally from a whole image component (patch), where the cluttered…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Tong He , Weilin Huang , Yu Qiao , Jian Yao

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

Natural language processing (NLP) and neural networks (NNs) have both undergone significant changes in recent years. For active learning (AL) purposes, NNs are, however, less commonly used -- despite their current popularity. By using the…

Computation and Language · Computer Science 2020-08-18 Christopher Schröder , Andreas Niekler

Neural network based methods have obtained great progress on a variety of natural language processing tasks. However, in most previous works, the models are learned based on single-task supervised objectives, which often suffer from…

Computation and Language · Computer Science 2016-05-18 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

The popularity of Artificial intelligence and machine learning have prompted researchers to use it in the recent researches. The proposed method uses K-Nearest Neighbor (KNN) algorithm for segmentation of medical images, extracting of image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Ayesha Heena , Nagashettappa Biradar , Najmuddin M. Maroof , Surbhi Bhatia , Rashmi Agarwal , Kanta Prasad

K-Nearest Neighbor Neural Machine Translation (kNN-MT) successfully incorporates external corpus by retrieving word-level representations at test time. Generally, kNN-MT borrows the off-the-shelf context representation in the translation…

Computation and Language · Computer Science 2023-09-20 Qiang Wang , Rongxiang Weng , Ming Chen

Text classification is a very common task nowadays and there are many efficient methods and algorithms that we can employ to accomplish it. Transformers have revolutionized the field of deep learning, particularly in Natural Language…

Machine Learning · Computer Science 2024-12-31 Christos Petridis

Twin neural network regression is trained to predict differences between regression targets rather than the targets themselves. A solution to the original regression problem can be obtained by ensembling predicted differences between the…

Machine Learning · Computer Science 2023-10-03 Sebastian J. Wetzel

With the rapid development of natural language processing technologies, more and more text steganographic methods based on automatic text generation technology have appeared in recent years. These models use the powerful self-learning and…

Multimedia · Computer Science 2020-01-08 Zhongliang Yang , Ke Wang , Jian Li , Yongfeng Huang , Yu-Jin Zhang

Non-parametric, k-nearest-neighbor algorithms have recently made inroads to assist generative models such as language models and machine translation decoders. We explore whether such non-parametric models can improve machine translation…

Computation and Language · Computer Science 2023-05-24 Jiayi Wang , Ke Wang , Yuqi Zhang , Yu Zhao , Pontus Stenetorp

We introduce second-order vector representations of words, induced from nearest neighborhood topological features in pre-trained contextual word embeddings. We then analyze the effects of using second-order embeddings as input features in…

Computation and Language · Computer Science 2017-05-25 Denis Newman-Griffis , Eric Fosler-Lussier

Text classification is one of the fundamental tasks in natural language processing to label an open-ended text and is useful for various applications such as sentiment analysis. In this paper, we discuss various classification approaches…

Computation and Language · Computer Science 2021-12-14 Rina Buoy , Nguonly Taing , Sovisal Chenda