English
Related papers

Related papers: Noise Contrastive Estimation for Autoencoding-base…

200 papers

E-Learning systems (ELS) and Intelligent Tutoring Systems (ITS) play a significant part in today's education programs. Sequencing questions is the art of generating a personalized quiz for a target learner. A personalized test will enrich…

Machine Learning · Computer Science 2020-04-28 Lior Sidi , Hadar Klein

In recent years, deep neural networks have yielded immense success on speech recognition, computer vision and natural language processing. However, the exploration of deep neural networks on recommender systems has received relatively less…

Information Retrieval · Computer Science 2017-08-29 Xiangnan He , Lizi Liao , Hanwang Zhang , Liqiang Nie , Xia Hu , Tat-Seng Chua

This paper proposes a method for multi-class classification problems, where the number of classes K is large. The method, referred to as Candidates vs. Noises Estimation (CANE), selects a small subset of candidate classes and samples the…

Machine Learning · Statistics 2018-09-14 Lei Han , Yiheng Huang , Tong Zhang

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Distance metric learning based on triplet loss has been applied with success in a wide range of applications such as face recognition, image retrieval, speaker change detection and recently recommendation with the CML model. However, as we…

Information Retrieval · Computer Science 2019-09-25 Viet-Anh Tran , Romain Hennequin , Jimena Royo-Letelier , Manuel Moussallam

Active authentication refers to the process in which users are unobtrusively monitored and authenticated continuously throughout their interactions with mobile devices. Generally, an active authentication problem is modelled as a one class…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Poojan Oza , Vishal M. Patel

We propose Few-Example Clustering (FEC), a novel algorithm that performs contrastive learning to cluster few examples. Our method is composed of the following three steps: (1) generation of candidate cluster assignments, (2) contrastive…

Machine Learning · Computer Science 2022-07-12 Minguk Jang , Sae-Young Chung

Collaborative filtering (CF) is a successful approach commonly used by many recommender systems. Conventional CF-based methods use the ratings given to items by users as the sole source of information for learning to make recommendation.…

Machine Learning · Computer Science 2015-06-22 Hao Wang , Naiyan Wang , Dit-Yan Yeung

Reliance on vast annotations to achieve leading performance severely restricts the practicality of large-scale point cloud semantic segmentation. For the purpose of reducing data annotation costs, effective labeling schemes are developed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Puzuo Wang , Wei Yao , Jie Shao

Network-on-Chip (NoC) congestion builds up during heavy traffic load and cripples the system performance by stalling the cores. Moreover, congestion leads to wasted link bandwidth due to blocked buffers and bouncing packets. Existing…

Hardware Architecture · Computer Science 2023-02-27 Shruti Yadav Narayana , Sumit K. Mandal , Raid Ayoub , Michael Kishinevsky , Umit Y. Ogras

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a…

Machine Learning · Computer Science 2019-01-14 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Training large vocabulary Neural Network Language Models (NNLMs) is a difficult task due to the explicit requirement of the output layer normalization, which typically involves the evaluation of the full softmax function over the complete…

Computation and Language · Computer Science 2017-08-23 Youssef Oualil , Dietrich Klakow

Supervised learning can be viewed as distilling relevant information from input data into feature representations. This process becomes difficult when supervision is noisy as the distilled information might not be relevant. In fact, recent…

Machine Learning · Computer Science 2022-06-28 Yingyi Chen , Shell Xu Hu , Xi Shen , Chunrong Ai , Johan A. K. Suykens

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Deep neural networks have shown promise in collaborative filtering (CF). However, existing neural approaches are either user-based or item-based, which cannot leverage all the underlying information explicitly. We propose CF-UIcA, a neural…

Machine Learning · Computer Science 2018-07-06 Chao Du , Chongxuan Li , Yin Zheng , Jun Zhu , Bo Zhang

Contrastive learning has been effectively utilized to enhance the training of sequential recommendation models by leveraging informative self-supervised signals. Most existing approaches generate augmented views of the same user sequence…

Information Retrieval · Computer Science 2025-02-06 Ziqiang Cui , Haolun Wu , Bowei He , Ji Cheng , Chen Ma

Recommender systems are designed to learn user preferences from observed feedback and comprise many fundamental tasks, such as rating prediction and post-click conversion rate (pCVR) prediction. However, the observed feedback usually suffer…

Information Retrieval · Computer Science 2024-02-09 Jun Wang , Haoxuan Li , Chi Zhang , Dongxu Liang , Enyun Yu , Wenwu Ou , Wenjia Wang

Text embedding models have been popular for information retrieval applications such as semantic search and Question-Answering systems based on Retrieval-Augmented Generation (RAG). Those models are typically Transformer models that are…

Information Retrieval · Computer Science 2025-02-10 Gabriel de Souza P. Moreira , Radek Osmulski , Mengyao Xu , Ronay Ak , Benedikt Schifferer , Even Oldridge

In human neuroscience, machine learning can help reveal lower-dimensional neural representations relevant to subjects' behavior. However, state-of-the-art models typically require large datasets to train, so are prone to overfitting on…