English
Related papers

Related papers: Learning Where to Embed: Noise-Aware Positional Em…

200 papers

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in recommender systems. Nevertheless, the process of searching and ranking from a large item corpus usually requires high latency, which limits the widespread…

Information Retrieval · Computer Science 2023-09-06 Huiyuan Chen , Kaixiong Zhou , Kwei-Herng Lai , Chin-Chia Michael Yeh , Yan Zheng , Xia Hu , Hao Yang

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these…

Computation and Language · Computer Science 2021-08-30 Richard Plant , Dimitra Gkatzia , Valerio Giuffrida

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tong Jin , Feng Lu , Shuyu Hu , Chun Yuan , Yunpeng Liu

Unsupervised learning of vision transformers seeks to pretrain an encoder via pretext tasks without labels. Among them is the Masked Image Modeling (MIM) aligned with pretraining of language transformers by predicting masked patches as a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Xiao Wang , Ying Wang , Ziwei Xuan , Guo-Jun Qi

Relational data mining is becoming ubiquitous in many fields of study. It offers insights into behaviour of complex, real-world systems which cannot be modeled directly using propositional learning. We propose Symbolic Graph Embedding…

Machine Learning · Computer Science 2019-10-30 Blaz Škrlj , Jan Kralj , Nada Lavrač

Hyperspectral imaging (HSI) provides rich spectral-spatial information across hundreds of contiguous bands, enabling precise material discrimination in applications such as environmental monitoring, agriculture, and urban analysis. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Saad Sohail , Muhammad Usama , Usman Ghous , Manuel Mazzara , Salvatore Distefano , Muhammad Ahmad

On-device directional hearing requires audio source separation from a given direction while achieving stringent human-imperceptible latency requirements. While neural nets can achieve significantly better performance than traditional…

Sound · Computer Science 2021-12-14 Anran Wang , Maruchi Kim , Hao Zhang , Shyamnath Gollakota

Existing learning-based denoising methods typically train models to generalize the image prior from large-scale datasets, suffering from the variability in noise distributions encountered in real-world scenarios. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yuanfei Huang , Hua Huang

A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common…

Modeling heterogeneity by extraction and exploitation of high-order information from heterogeneous information networks (HINs) has been attracting immense research attention in recent times. Such heterogeneous network embedding (HNE)…

Machine Learning · Computer Science 2022-01-11 Mubashir Imran , Hongzhi Yin , Tong Chen , Zi Huang , Kai Zheng

We propose a multi-layer variational autoencoder method, we call HR-VQVAE, that learns hierarchical discrete representations of the data. By utilizing a novel objective function, each layer in HR-VQVAE learns a discrete representation of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mohammad Adiban , Kalin Stefanov , Sabato Marco Siniscalchi , Giampiero Salvi

Accurate localization of cephalometric landmarks holds great importance in the fields of orthodontics and orthognathics due to its potential for automating key point labeling. In the context of landmark detection, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Qian Wu , Si Yong Yeo , Yufei Chen , Jun Liu

With the advent of affordable depth sensors, 3D capture becomes more and more ubiquitous and already has made its way into commercial products. Yet, capturing the geometry or complete shapes of everyday objects using scanning devices (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Abhishek Sharma , Oliver Grau , Mario Fritz

Data-driven discovery of partial differential equations (PDEs) has attracted increasing attention in recent years. Although significant progress has been made, certain unresolved issues remain. For example, for PDEs with high-order…

Machine Learning · Computer Science 2021-09-14 Hao Xu , Dongxiao Zhang , Nanzhe Wang

Human pose estimation (HPE) is a key building block for developing AI-based context-aware systems inside the operating room (OR). The 24/7 use of images coming from cameras mounted on the OR ceiling can however raise concerns for privacy,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Vinkle Srivastav , Afshin Gangi , Nicolas Padoy

Understanding the coordinated activity underlying brain computations requires large-scale, simultaneous recordings from distributed neuronal structures at a cellular-level resolution. One major hurdle to design high-bandwidth,…

Neural and Evolutionary Computing · Computer Science 2018-09-18 Tong Wu , Wenfeng Zhao , Edward Keefer , Zhi Yang

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

The deployment of pre-trained models (PTMs) has greatly advanced the field of continual learning (CL), enabling positive knowledge transfer and resilience to catastrophic forgetting. To sustain these advantages for sequentially arriving…

Machine Learning · Computer Science 2025-04-18 Liyuan Wang , Jingyi Xie , Xingxing Zhang , Hang Su , Jun Zhu

Recently, many methods have been proposed for object detection. They cannot detect objects by semantic features, adaptively. In this work, according to channel and spatial attention mechanisms, we mainly analyze that different methods…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Qian Li , Nan Guo , Xiaochun Ye , Dongrui Fan , Zhimin Tang