English
Related papers

Related papers: Second-order Co-occurrence Sensitivity of Skip-Gra…

200 papers

The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in human-annotated…

Machine Learning · Computer Science 2021-03-31 Zhaowei Zhu , Tongliang Liu , Yang Liu

In information theory, the link between continuous information and discrete information is established through well-known sampling theorems. Sampling theory explains, for example, how frequency-filtered music signals are reconstructible…

General Relativity and Quantum Cosmology · Physics 2009-11-10 Achim Kempf

Text Summarization is recognised as one of the NLP downstream tasks and it has been extensively investigated in recent years. It can assist people with perceiving the information rapidly from the Internet, including news articles, social…

Computation and Language · Computer Science 2022-12-08 Guan Wang , Weihua Li , Edmund Lai , Jianhua Jiang

Semantic segmentation in autonomous driving predominantly focuses on learning from large-scale data with a closed set of known classes without considering unknown objects. Motivated by safety reasons, we address the video class agnostic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Mennatullah Siam , Alex Kendall , Martin Jagersand

Unsupervised learning from continuous visual streams is a challenging problem that cannot be naturally and efficiently managed in the classic batch-mode setting of computation. The information stream must be carefully processed accordingly…

Machine Learning · Computer Science 2020-06-17 Matteo Tiezzi , Stefano Melacci , Alessandro Betti , Marco Maggini , Marco Gori

Modular object-centric representations are essential for *human-like reasoning* but are challenging to obtain under spatial ambiguities, *e.g. due to occlusions and view ambiguities*. However, addressing challenges presents both theoretical…

Machine Learning · Computer Science 2025-06-10 Avinash Kori , Francesca Toni , Ben Glocker

This paper contains a study of multivariate second order stochastic mappings indexed by an abstract set $\Lambda$ in close connection to their operator covariance functions. The characterizations of the normal Hilbert module or of Hilbert…

Functional Analysis · Mathematics 2015-01-27 Pastorel Gaspar , Lorena Popa

Learning low-dimensional representations for entities and relations in knowledge graphs using contrastive estimation represents a scalable and effective method for inferring connectivity patterns. A crucial aspect of contrastive learning…

Machine Learning · Computer Science 2020-10-08 Kian Ahrabian , Aarash Feizi , Yasmin Salehi , William L. Hamilton , Avishek Joey Bose

It has long been a goal to efficiently compute and use second order information on a function ($f$) to assist in numerical approximations. Here it is shown how, using only basic physics and a numerical approximation, such information can be…

Machine Learning · Computer Science 2021-05-31 Michael F. Zimmer

Deep networks have shown remarkable results in the task of object detection. However, their performance suffers critical drops when they are subsequently trained on novel classes without any sample from the base classes originally used to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Training dense passage representations via contrastive learning has been shown effective for Open-Domain Passage Retrieval (ODPR). Existing studies focus on further optimizing by improving negative sampling strategy or extra pretraining.…

Computation and Language · Computer Science 2022-03-08 Bohong Wu , Zhuosheng Zhang , Jinyuan Wang , Hai Zhao

Weakly supervised semantic segmentation receives much research attention since it alleviates the need to obtain a large amount of dense pixel-wise ground-truth annotations for the training images. Compared with other forms of weak…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Tianyi Zhang , Guosheng Lin , Jianfei Cai , Tong Shen , Chunhua Shen , Alex C. Kot

World models trained by contrastive learning are a compelling alternative to autoencoder-based world models, which learn by reconstructing pixel states. In this paper, we describe three cases where small changes in how we sample negative…

Machine Learning · Computer Science 2021-07-27 Ondrej Biza , Elise van der Pol , Thomas Kipf

Humans judge the similarity of two objects not just based on their visual appearance but also based on their semantic relatedness. However, it remains unclear how humans learn about semantic relationships between objects and categories. One…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Arthur Aubret , Timothy Schaumlöffel , Gemma Roig , Jochen Triesch

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a…

Artificial Intelligence · Computer Science 2024-04-15 Yanbei Liu , Yu Zhao , Xiao Wang , Lei Geng , Zhitao Xiao

Object localisation, in the context of regular images, often depicts objects like people or cars. In these images, there is typically a relatively small number of objects per class, which usually is manageable to annotate. However, outside…

Machine Learning · Computer Science 2021-08-24 Andreas Panteli , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

Joint-event-extraction, which extracts structural information (i.e., entities or triggers of events) from unstructured real-world corpora, has attracted more and more research attention in natural language processing. Most existing works do…

Computation and Language · Computer Science 2020-10-15 Yue Wang , Zhuo Xu , Lu Bai , Yao Wan , Lixin Cui , Qian Zhao , Edwin R. Hancock , Philip S. Yu

We propose an importance sampling method for tractable and efficient estimation of counterfactual expressions in general settings, named Exogenous Matching. By minimizing a common upper bound of counterfactual estimators, we transform the…

Machine Learning · Computer Science 2025-02-14 Yikang Chen , Dehui Du , Lili Tian

Objects within a category are often similar in their shape and usage. When we---as humans---want to grasp something, we transfer our knowledge from past experiences and adapt it to novel objects. In this paper, we propose a new approach for…

Robotics · Computer Science 2018-09-17 Diego Rodriguez , Sven Behnke