English
Related papers

Related papers: Word2vec Skip-gram Dimensionality Selection via Se…

200 papers

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we…

Methodology · Statistics 2023-09-06 Yifan Cui , Eric Tchetgen Tchetgen

A bottleneck of sufficient dimension reduction (SDR) in the modern era is that, among numerous methods, only the sliced inverse regression (SIR) is generally applicable under the high-dimensional settings. The higher-order inverse…

Methodology · Statistics 2024-07-24 Yin Jin , Wei Luo

Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the…

Computation and Language · Computer Science 2024-02-09 Weijie Xu , Jay Desai , Srinivasan Sengamedu , Xiaoyu Jiang , Francis Iannacci

Recently, information theoretic analysis has become a popular framework for understanding the generalization behavior of deep neural networks. It allows a direct analysis for stochastic gradient/Langevin descent (SGD/SGLD) learning…

Machine Learning · Statistics 2023-05-03 Yuxin Dong , Tieliang Gong , Hong Chen , Chen Li

Word2Vec is a prominent model for natural language processing (NLP) tasks. Similar inspiration is found in distributed embeddings for new state-of-the-art (SotA) deep neural networks. However, wrong combination of hyper-parameters can…

Computation and Language · Computer Science 2021-04-20 Tosin P. Adewumi , Foteini Liwicki , Marcus Liwicki

Due to their ease of use and high accuracy, Word2Vec (W2V) word embeddings enjoy great success in the semantic representation of words, sentences, and whole documents as well as for semantic similarity estimation. However, they have the…

Computation and Language · Computer Science 2024-01-10 Tim vor der Brück , Marc Pouly

A common heuristic in semi-supervised deep learning (SSDL) is to select unlabelled data based on a notion of semantic similarity to the labelled data. For example, labelled images of numbers should be paired with unlabelled images of…

Machine Learning · Computer Science 2021-04-27 Saul Calderon-Ramirez , Luis Oala

Bayesian Generalized Nonlinear Models (BGNLM) offer a flexible nonlinear alternative to GLM while still providing better interpretability than machine learning techniques such as neural networks. In BGNLM, the methods of Bayesian Variable…

Computation · Statistics 2023-12-29 Jon Lachmann , Aliaksandr Hubin

Machine comprehension(MC) style question answering is a representative problem in natural language processing. Previous methods rarely spend time on the improvement of encoding layer, especially the embedding of syntactic information and…

Artificial Intelligence · Computer Science 2017-07-31 Boyuan Pan , Hao Li , Zhou Zhao , Bin Cao , Deng Cai , Xiaofei He

Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness of text classification against word substitutions,…

Computation and Language · Computer Science 2021-05-06 Emanuele La Malfa , Min Wu , Luca Laurenti , Benjie Wang , Anthony Hartshorn , Marta Kwiatkowska

We consider model selection in generalized linear models (GLM) for high-dimensional data and propose a wide class of model selection criteria based on penalized maximum likelihood with a complexity penalty on the model size. We derive a…

Statistics Theory · Mathematics 2016-03-31 Felix Abramovich , Vadim Grinshtein

In recent several years, the information bottleneck (IB) principle provides an information-theoretic framework for deep multi-view clustering (MVC) by compressing multi-view observations while preserving the relevant information of multiple…

Information Theory · Computer Science 2024-03-26 Xiaoqiang Yan , Zhixiang Jin , Fengshou Han , Yangdong Ye

Estimating the number of communities is a fundamental problem in network analysis under the stochastic block model (SBM). In this paper, we study penalized estimators for this task based on normalized likelihood criteria. We show that a…

Statistics Theory · Mathematics 2026-04-14 Andressa Cerqueira , Felipe Baptistão

The normalized maximum likelihood (NML) is a recent penalized likelihood that has properties that justify defining the amount of discrimination information (DI) in the data supporting an alternative hypothesis over a null hypothesis as the…

Statistics Theory · Mathematics 2012-05-02 David R. Bickel

We propose semantic smoothing, a smoothing method for language models that uses embeddings to share statistical observations across semantically similar contexts. The starting point is a decomposition of log-perplexity that motivates…

Information Theory · Computer Science 2026-05-11 Haricharan Balasundaram , Swathi Shree Narashiman , Pranay Mathur , Andrew Thangaraj

Feature norm datasets of human conceptual knowledge, collected in surveys of human volunteers, yield highly interpretable models of word meaning and play an important role in neurolinguistic research on semantic cognition. However, these…

Computation and Language · Computer Science 2019-09-02 Steven Derby , Paul Miller , Barry Devereux

Two-view structure from motion (SfM) is the cornerstone of 3D reconstruction and visual SLAM (vSLAM). Many existing end-to-end learning-based methods usually formulate it as a brute regression problem. However, the inadequate utilization of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yuxi Xiao , Li Li , Xiaodi Li , Jian Yao

The objective of this research is to enhance performance of Stochastic Gradient Descent (SGD) algorithm in text classification. In our research, we proposed using SGD learning with Grid-Search approach to fine-tuning hyper-parameters in…

Information Retrieval · Computer Science 2019-02-26 Shadi Diab

In order to facilitate long-term localization using a visual simultaneous localization and mapping (SLAM) algorithm, careful feature selection can help ensure that reference points persist over long durations and the runtime and storage…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Pranav Ganti , Steven L. Waslander

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan