English
Related papers

Related papers: DGPO: RL-Steered Graph Diffusion for Neural Archit…

200 papers

Direct Preference Optimization (DPO) guides large language models (LLMs) to generate recommendations aligned with user historical behavior distributions by minimizing preference alignment loss. However, our systematic empirical research and…

Information Retrieval · Computer Science 2026-05-28 Chu Zhao , Enneng Yang , Jianzhe Zhao , Guibing Guo

Representation learning on graphs that evolve has recently received significant attention due to its wide application scenarios, such as bioinformatics, knowledge graphs, and social networks. The propagation of information in graphs is…

Machine Learning · Computer Science 2021-06-04 Mingyi Liu , Zhiying Tu , Xiaofei Xu , Zhongjie Wang

Aligning text-to-image (T2I) diffusion models with Direct Preference Optimization (DPO) has shown notable improvements in generation quality. However, applying DPO to T2I faces two challenges: the sensitivity of DPO to preference pairs and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Renjie Chen , Wenfeng Lin , Yichen Zhang , Jiangchuan Wei , Boyuan Liu , Chao Feng , Jiao Ran , Mingyu Guo

Preference optimization has become a central paradigm for aligning large language models with human feedback. Direct Preference Optimization (DPO) simplifies reinforcement learning from human feedback by directly optimizing pairwise…

Machine Learning · Computer Science 2026-05-05 Inoussa Mouiche

Diffusion models have achieved promising results for Structure-Based Drug Design (SBDD). Nevertheless, high-quality protein subpocket and ligand data are relatively scarce, which hinders the models' generation capabilities. Recently, Direct…

Biomolecules · Quantitative Biology 2026-02-11 Xiwei Cheng , Xiangxin Zhou , Yuwei Yang , Yu Bao , Quanquan Gu

Diffusion has emerged as a powerful framework for generative modeling, achieving remarkable success in applications such as image and audio synthesis. Enlightened by this progress, we propose a novel diffusion-based approach for symbolic…

Machine Learning · Computer Science 2025-06-02 Zachary Bastiani , Robert M. Kirby , Jacob Hochhalter , Shandian Zhe

Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge sources. However, when applied to heterogeneous corpora and multi-step queries, Naive RAG pipelines often degrade in quality due to…

Information Retrieval · Computer Science 2026-04-10 Valeriy Kovalskiy , Nikita Belov , Nikita Miteyko , Igor Reshetnikov , Max Maximov

Distributed stream processing systems are widely deployed to process real-time data generated by various devices, such as sensors and software systems. A key challenge in the system is overloading, which leads to an unstable system status…

Networking and Internet Architecture · Computer Science 2025-06-16 Ziren Xiao

Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood. Unlike models in other domains, popular backbones for…

Machine Learning · Computer Science 2025-02-05 Xiyuan Wang , Yewei Liu , Lexi Pang , Siwei Chen , Muhan Zhang

Recent studies have shown the great potential of diffusion models in improving reinforcement learning (RL) by modeling complex policies, expressing a high degree of multi-modality, and efficiently handling high-dimensional continuous…

Robotics · Computer Science 2025-05-14 Huiyun Jiang , Zhuang Yang

One practice of employing deep neural networks is to apply the same architecture to all the input instances. However, a fixed architecture may not be representative enough for data with high diversity. To promote the model capacity,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Kun Yuan , Quanquan Li , Dapeng Chen , Aojun Zhou , Junjie Yan

Graph-level representation learning is the pivotal step for downstream tasks that operate on the whole graph. The most common approach to this problem heretofore is graph pooling, where node features are typically averaged or summed to…

Machine Learning · Computer Science 2022-09-20 Kaixuan Chen , Jie Song , Shunyu Liu , Na Yu , Zunlei Feng , Gengshi Han , Mingli Song

Graph convolutional neural networks have recently shown great potential for the task of zero-shot learning. These models are highly sample efficient as related concepts in the graph structure share statistical strength allowing…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Michael Kampffmeyer , Yinbo Chen , Xiaodan Liang , Hao Wang , Yujia Zhang , Eric P. Xing

Recent advances in generative AI have revolutionized visual content creation, yet aligning model outputs with human preferences remains a critical challenge. While Reinforcement Learning (RL) has emerged as a promising approach for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zeyue Xue , Jie Wu , Yu Gao , Fangyuan Kong , Lingting Zhu , Mengzhao Chen , Zhiheng Liu , Wei Liu , Qiushan Guo , Weilin Huang , Ping Luo

We propose a generative flow-induced neural architecture search algorithm. The proposed approach devices simple feed-forward neural networks to learn stochastic policies to generate sequences of architecture hyperparameters such that the…

Machine Learning · Computer Science 2024-05-14 Hartej Soin , Tapas Tripura , Souvik Chakraborty

Classification tasks based on feature vectors can be significantly improved by including within deep learning a graph that summarises pairwise relationships between the samples. Intuitively, the graph acts as a conduit to channel and bias…

Machine Learning · Computer Science 2019-09-27 Robert L. Peach , Alexis Arnaudon , Mauricio Barahona

Classical on-policy algorithms such as PPO and mirror descent policy optimization provide stable proximal policy updates through tractable action likelihoods, but are typically instantiated with simple Gaussian policies whose expressiveness…

Machine Learning · Computer Science 2026-05-29 Yuehu Gong , Zeyuan Wang , Yulin Chen , Shutong Ding , Qingyuan Zhou , Yanwei Fu

Enabling neural networks to learn complex logical constraints and fulfill symbolic reasoning is a critical challenge. Bridging this gap often requires guiding the neural network's output distribution to move closer to the symbolic…

Artificial Intelligence · Computer Science 2025-08-25 Xuan Zhang , Zhijian Zhou , Weidi Xu , Yanting Miao , Chao Qu , Yuan Qi

Graph-based collaborative filtering has been established as a prominent approach in recommendation systems, leveraging the inherent graph topology of user-item interactions to model high-order connectivity patterns and enhance…

Information Retrieval · Computer Science 2025-03-21 Fan Huang , Wei Wang

Graph has become increasingly integral to the advancement of recommendation systems, particularly with the fast development of graph neural network(GNN). By exploring the virtue of rich node features and link information, GNN is designed to…

Cryptography and Security · Computer Science 2024-11-14 Jinyin Chen , Haonan Ma , Haibin Zheng