English
Related papers

Related papers: Dimension Mask Layer: Optimizing Embedding Efficie…

200 papers

With recent advances in large language models (LLMs), there has been emerging numbers of research in developing Semantic IDs based on LLMs to enhance the performance of recommendation systems. However, the dimension of these embeddings…

Information Retrieval · Computer Science 2024-10-15 Taolin Zhang , Junwei Pan , Jinpeng Wang , Yaohua Zha , Tao Dai , Bin Chen , Ruisheng Luo , Xiaoxiang Deng , Yuan Wang , Ming Yue , Jie Jiang , Shu-Tao Xia

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

Recent large language models (LLMs) have demonstrated exceptional performance on general-purpose text embedding tasks. While dense embeddings have dominated related research, we introduce the first lexicon-based embeddings (LENS) leveraging…

Computation and Language · Computer Science 2026-03-20 Yibin Lei , Tao Shen , Yu Cao , Andrew Yates

Deep hiding, concealing secret information using Deep Neural Networks (DNNs), can significantly increase the embedding rate and improve the efficiency of secret sharing. Existing works mainly force on designing DNNs with higher embedding…

Multimedia · Computer Science 2023-02-24 Han Li , Hangcheng Liu , Shangwei Guo , Mingliang Zhou , Ning Wang , Tao Xiang , Tianwei Zhang

Recently, the growing memory demands of embedding tables in Deep Learning Recommendation Models (DLRMs) pose great challenges for model training and deployment. Existing embedding compression solutions cannot simultaneously meet three key…

Machine Learning · Computer Science 2024-03-28 Hailin Zhang , Zirui Liu , Boxuan Chen , Yikai Zhao , Tong Zhao , Tong Yang , Bin Cui

The proposed method extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Yanfeng Liu , Eric Psota , Lance Pérez

We consider the problem of selecting an optimal mask for an image manifold, i.e., choosing a subset of the pixels of the image that preserves the manifold's geometric structure present in the original data. Such masking implements a form of…

Machine Learning · Statistics 2016-06-16 Hamid Dadkhahi , Marco F. Duarte

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

Input features play a crucial role in DNN-based recommender systems with thousands of categorical and continuous fields from users, items, contexts, and interactions. Noisy features and inappropriate embedding dimension assignments can…

Information Retrieval · Computer Science 2023-11-14 Yao Yao , Bin Liu , Haoxun He , Dakui Sheng , Ke Wang , Li Xiao , Huanhuan Cao

Visualizing a large-scale volumetric dataset with high resolution is challenging due to the substantial computational time and space complexity. Recent deep learning-based image inpainting methods significantly improve rendering latency by…

Graphics · Computer Science 2025-10-13 Jianxin Sun , David Lenz , Hongfeng Yu , Tom Peterka

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

Effective expression feature representations generated by a triplet-based deep metric learning are highly advantageous for facial expression recognition (FER). The performance of triplet-based deep metric learning is contingent upon…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Wenwu Yang , Jinyi Yu , Tuo Chen , Zhenguang Liu , Xun Wang , Jianbing Shen

As the deep learning revolution marches on, self-supervised learning has garnered increasing attention in recent years thanks to its remarkable representation learning ability and the low dependence on labeled data. Among these varied…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Siyuan Li , Luyuan Zhang , Zedong Wang , Di Wu , Lirong Wu , Zicheng Liu , Jun Xia , Cheng Tan , Yang Liu , Baigui Sun , Stan Z. Li

In this paper, we propose a scalable image compression scheme, including the base layer for feature representation and enhancement layer for texture representation. More specifically, the base layer is designed as the deep learning feature…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Shurun Wang , Shiqi Wang , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

This paper addresses the problem of mapping high-dimensional data to a low-dimensional space, in the presence of other known features. This problem is ubiquitous in science and engineering as there are often controllable/measurable features…

Machine Learning · Statistics 2024-01-01 Anh Tuan Bui

Existing manifold learning methods are not appropriate for image retrieval task, because most of them are unable to process query image and they have much additional computational cost especially for large scale database. Therefore, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Jian Xu , Chunheng Wang , Chengzuo Qi , Cunzhao Shi , Baihua Xiao

One of the fundamental problems within the field of machine learning is dimensionality reduction. Dimensionality reduction methods make it possible to combat the so-called curse of dimensionality, visualize high-dimensional data and, in…

Machine Learning · Computer Science 2025-05-12 Sergio García-Heredia , Ángela Fernández , Carlos M. Alaíz

Diffusion Probabilistic Models (DPMs) have achieved great success in image generation but suffer from high inference latency due to their iterative denoising nature. Motivated by the evolving feature dynamics across the denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Haodong He , Yuan Gao , Weizhong Zhang , Gui-Song Xia

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Feature selection aims to identify the optimal feature subset for enhancing downstream models. Effective feature selection can remove redundant features, save computational resources, accelerate the model learning process, and improve the…

Machine Learning · Computer Science 2024-12-19 Nanxu Gong , Wangyang Ying , Dongjie Wang , Yanjie Fu