English
Related papers

Related papers: Adap-$\tau$: Adaptively Modulating Embedding Magni…

200 papers

Node embedding methods find latent lower-dimensional representations which are used as features in machine learning models. In the last few years, these methods have become extremely popular as a replacement for manual feature engineering.…

Social and Information Networks · Computer Science 2020-06-01 Christoph Martin , Meike Riebeling

Adaptive optimization algorithms -- such as Adagrad, Adam, and their variants -- have found widespread use in machine learning, signal processing and many other settings. Several methods in this family are not rotationally equivariant,…

Machine Learning · Computer Science 2026-02-17 Adela DePavia , Jose Cruzado , Jiayou Liang , Vasileios Charisopoulos , Rebecca Willett

The review-based recommender systems are commonly utilized to measure users preferences towards different items. In this paper, we focus on addressing three main problems existing in the review-based methods. Firstly, these methods suffer…

Information Retrieval · Computer Science 2020-12-14 Yuexin Wu , Tianyu Gao , Sihao Wang , Zhongmin Xiong

Deep image matting methods have achieved increasingly better results on benchmarks (e.g., Composition-1k/alphamatting.com). However, the robustness, including robustness to trimaps and generalization to images from different domains, is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yutong Dai , Brian Price , He Zhang , Chunhua Shen

The notion of metric plays a key role in machine learning problems such as classification, clustering or ranking. However, it is worth noting that there is a severe lack of theoretical guarantees that can be expected on the generalization…

Machine Learning · Computer Science 2015-04-01 Maria-Irina Nicolae , Marc Sebban , Amaury Habrard , Éric Gaussier , Massih-Reza Amini

This paper proposes a recommender system to alleviate the cold-start problem that can estimate user preferences based on only a small number of items. To identify a user's preference in the cold state, existing recommender systems, such as…

Information Retrieval · Computer Science 2019-08-02 Hoyeop Lee , Jinbae Im , Seongwon Jang , Hyunsouk Cho , Sehee Chung

With the increasing development of e-commerce and online services, personalized recommendation systems have become crucial for enhancing user satisfaction and driving business revenue. Traditional sequential recommendation methods that rely…

Information Retrieval · Computer Science 2023-04-27 Kunzhe Song , Qingfeng Sun , Can Xu , Kai Zheng , Yaming Yang

Recently, large multimodal models, such as CLIP and Stable Diffusion have experimented tremendous successes in both foundations and applications. However, as these models increase in parameter size and computational requirements, it becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Victor Gallego

Popularity bias is a well-known phenomenon in recommender systems: popular items are recommended even more frequently than their popularity would warrant, amplifying long-tail effects already present in many recommendation domains. Prior…

Information Retrieval · Computer Science 2020-07-27 Himan Abdollahpouri , Masoud Mansoury , Robin Burke , Bamshad Mobasher

In natural language processing (NLP), the semantic similarity task requires large-scale, high-quality human-annotated labels for fine-tuning or evaluation. By contrast, in cases of music similarity, such labels are expensive to collect and…

Sound · Computer Science 2021-09-10 Xinran Zhang , Maosong Sun , Jiafeng Liu , Xiaobing Li

Data augmentation (DA) is widely used to improve the generalization of neural networks by enforcing the invariances and symmetries to pre-defined transformations applied to input data. However, a fixed augmentation policy may have different…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Chengkai Hou , Jieyu Zhang , Tianyi Zhou

Industry-scale recommender systems face a core challenge: representing entities with high cardinality, such as users or items, using dense embeddings that must be accessible during both training and inference. However, as embedding sizes…

Information Retrieval · Computer Science 2025-05-19 Petr Kasalický , Martin Spišák , Vojtěch Vančura , Daniel Bohuněk , Rodrigo Alves , Pavel Kordík

In recommendation systems, high-quality user embeddings can capture subtle preferences, enable precise similarity calculations, and adapt to changing preferences over time to maintain relevance. The effectiveness of recommendation systems…

Multimodal recommendation systems are increasingly popular for their potential to improve performance by integrating diverse data types. However, the actual benefits of this integration remain unclear, raising questions about when and how…

Information Retrieval · Computer Science 2025-08-08 Hongyu Zhou , Yinan Zhang , Aixin Sun , Zhiqi Shen

Many meta-learning algorithms can be formulated into an interleaved process, in the sense that task-specific predictors are learned during inner-task adaptation and meta-parameters are updated during meta-update. The normal meta-training…

Machine Learning · Computer Science 2021-08-25 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-Lai Chung

Most popular optimizers for deep learning can be broadly categorized as adaptive methods (e.g. Adam) and accelerated schemes (e.g. stochastic gradient descent (SGD) with momentum). For many models such as convolutional neural networks…

Machine Learning · Computer Science 2020-12-22 Juntang Zhuang , Tommy Tang , Yifan Ding , Sekhar Tatikonda , Nicha Dvornek , Xenophon Papademetris , James S. Duncan

The learning rate warmup heuristic achieves remarkable success in stabilizing training, accelerating convergence and improving generalization for adaptive stochastic optimization algorithms like RMSprop and Adam. Here, we study its…

Machine Learning · Computer Science 2021-10-27 Liyuan Liu , Haoming Jiang , Pengcheng He , Weizhu Chen , Xiaodong Liu , Jianfeng Gao , Jiawei Han

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

Numerical Analysis · Computer Science 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

Recently, textual information has been proved to play a positive role in recommendation systems. However, most of the existing methods only focus on representation learning of textual information in ratings, while potential selection bias…

Information Retrieval · Computer Science 2021-10-14 Jiabin Liu , Zheng Wei , Zhengpin Li , Xiaojun Mao , Jian Wang , Zhongyu Wei , Qi Zhang

Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are applied and have…

Information Retrieval · Computer Science 2023-12-19 Zhengbang Zhu , Rongjun Qin , Junjie Huang , Xinyi Dai , Yang Yu , Yong Yu , Weinan Zhang