English
Related papers

Related papers: Unleashing the Potential of Two-Tower Models: Diff…

200 papers

We have recently seen tremendous progress in diffusion advances for generating realistic human motions. Yet, they largely disregard the multi-human interactions. In this paper, we present InterGen, an effective diffusion-based approach that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Han Liang , Wenqian Zhang , Wenxuan Li , Jingyi Yu , Lan Xu

Multifaceted user modeling aims to uncover fine-grained patterns and learn representations from user data, revealing their diverse interests and characteristics, such as profile, preference, and personality. Recent studies on foundation…

Information Retrieval · Computer Science 2024-12-24 Chunxu Zhang , Guodong Long , Hongkuan Guo , Zhaojie Liu , Guorui Zhou , Zijian Zhang , Yang Liu , Bo Yang

Conditional diffusion models have made impressive progress in the field of image processing, but the characteristics of constructing data distribution pathways make it difficult to exploit the intrinsic correlation between tasks in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chengjie Huang , Jiafeng Yan , Jing Li , Lu Bai

Intelligent agents, such as robots and virtual agents, must understand the dynamics of complex social interactions to interact with humans. Effectively representing social dynamics is challenging because we require multi-modal, synchronized…

Machine Learning · Computer Science 2025-01-22 Antonio Lech Martin-Ozimek , Isuru Jayarathne , Su Larb Mon , Jouh Yeong Chew

In this paper, we propose a two-layer adoption-opinion model to study the diffusion of two competing technologies within a population whose opinions evolve under social influence and adoption-driven feedback. After adopting one technology,…

Systems and Control · Electrical Eng. & Systems 2026-01-26 Martina Alutto , Fabrizio Dabbene , Angela Fontan , Karl H. Johansson , Chiara Ravazzi

Semantic communication enhances transmission efficiency by conveying semantic information rather than raw input symbol sequences. Task-oriented semantic communication is a variant that tries to retains only task-specific information, thus…

Cryptography and Security · Computer Science 2025-10-06 Xuesong Wang , Mo Li , Xingyan Shi , Zhaoqian Liu , Shenghao Yang

Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics:…

Machine Learning · Computer Science 2026-03-03 Jinluan Yang , Yuxin Liu , Zhengyu Chen , Chengcheng Han , Yueqing Sun , Qi Gu , Hui Su , Xunliang Cai , Fei Wu , Kun Kuang

Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the…

Information Retrieval · Computer Science 2025-10-23 Wenyu Mao , Jiancan Wu , Guoqing Hu , Zhengyi Yang , Wei Ji , Xiang Wang

The two-tower architecture has been widely applied for learning item and user representations, which is important for large-scale recommender systems. Many two-tower models are trained using various in-batch negative sampling strategies,…

Information Retrieval · Computer Science 2021-10-29 Jinpeng Wang , Jieming Zhu , Xiuqiang He

In click-through rate prediction, click-through rate prediction is used to model users' interests. However, most of the existing CTR prediction methods are mainly based on the ID modality. As a result, they are unable to comprehensively…

Information Retrieval · Computer Science 2025-09-01 Xiaoxi Cui , Weihai Lu , Yu Tong , Yiheng Li , Zhejun Zhao

Data intensive applications often involve the analysis of large datasets that require large amounts of compute and storage resources. While dedicated compute and/or storage farms offer good task/data throughput, they suffer low resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-08-27 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the…

Networking and Internet Architecture · Computer Science 2024-12-02 Xinyu Yuan , Yan Qiao , Zhenchun Wei , Zeyu Zhang , Minyue Li , Pei Zhao , Rongyao Hu , Wenjing Li

Diffusion models have been shown to be capable of generating high-quality images, suggesting that they could contain meaningful internal representations. Unfortunately, the feature maps that encode a diffusion model's internal information…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Grace Luo , Lisa Dunlap , Dong Huk Park , Aleksander Holynski , Trevor Darrell

We address the problem of generating realistic 3D human-object interactions (HOIs) driven by textual prompts. To this end, we take a modular design and decompose the complex task into simpler sub-tasks. We first develop a dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xiaogang Peng , Yiming Xie , Zizhao Wu , Varun Jampani , Deqing Sun , Huaizu Jiang

In industrial applications like online advertising and recommendation systems, diverse and accurate user profiles can greatly help improve personalization. Deep learning is widely applied to mine expressive tags to users from their…

Information Retrieval · Computer Science 2022-06-01 Zhenhui Xu , Meng Zhao , Liqun Liu , Lei Xiao , Xiaopeng Zhang , Bifeng Zhang

Understanding how humans would behave during hand-object interaction is vital for applications in service robot manipulation and extended reality. To achieve this, some recent works have been proposed to simultaneously forecast hand…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Junyi Ma , Jingyi Xu , Xieyuanli Chen , Hesheng Wang

Diffusion models have demonstrated exceptional capabilities in generating a broad spectrum of visual content, yet their proficiency in rendering text is still limited: they often generate inaccurate characters or words that fail to blend…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jianyi Zhang , Yufan Zhou , Jiuxiang Gu , Curtis Wigington , Tong Yu , Yiran Chen , Tong Sun , Ruiyi Zhang

In prototype-based federated learning, the exchange of model parameters between clients and the master server is replaced by transmission of prototypes or quantized versions of the data samples to the aggregation server. A fully…

Recent text-to-image (T2I) diffusion models have achieved remarkable advancement, yet faithfully following complex textual descriptions remains challenging due to insufficient interactions between textual and visual features. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

Image generation based on diffusion models has demonstrated impressive capability, motivating exploration into diverse and specialized applications. Owing to the importance of emotion in advertising, emotion-oriented image generation has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Guoli Jia , Junyao Hu , Xinwei Long , Kai Tian , Kaiyan Zhang , KaiKai Zhao , Ning Ding , Bowen Zhou