English
Related papers

Related papers: Controlla: Learning Controllability via Graph-Cons…

200 papers

Multimodal alignment is commonly learned from isolated image-text pairs via CLIP-style dual encoders, leaving the relational context among entities largely unused. Multimodal attributed graphs (MAGs), where nodes carry multimodal attributes…

Machine Learning · Computer Science 2026-05-18 Xu Wang , Xunkai Li , Yinlin Zhu , Rong-Hua Li , Guoren Wang

Designing molecules with specific properties is a long-lasting research problem and is central to advancing crucial domains such as drug discovery and material science. Recent advances in deep graph generative models treat molecule design…

Machine Learning · Computer Science 2022-03-02 Yuanqi Du , Xiaojie Guo , Amarda Shehu , Liang Zhao

Recent generative adversarial networks (GANs) are able to generate impressive photo-realistic images. However, controllable generation with GANs remains a challenging research problem. Achieving controllable generation requires semantically…

Machine Learning · Computer Science 2021-05-04 Grigorios G Chrysos , Jean Kossaifi , Zhiding Yu , Anima Anandkumar

Recent advances in generic large models, such as GPT and DeepSeek, have motivated the introduction of universality to graph pre-training, aiming to learn rich and generalizable knowledge across diverse domains using graph representations to…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Siqi Liu , Jiaxu Cui , Weixiong Zhang

Multi-aspect controllable text generation aims to control text generation in attributes from multiple aspects, making it a complex but powerful task in natural language processing. Supervised fine-tuning methods are often employed for this…

Computation and Language · Computer Science 2025-02-20 Chenyu Zhu , Yefeng Liu , Chenyang Lyu , Xue Yang , Guanhua Chen , Longyue Wang , Weihua Luo , Kaifu Zhang

Controllable video generation has emerged as a versatile tool for autonomous driving, enabling realistic synthesis of traffic scenarios. However, existing methods depend on control signals at inference time to guide the generative model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mirlan Karimov , Teodora Spasojevic , Markus Braun , Julian Wiederer , Vasileios Belagiannis , Marc Pollefeys

Evaluating autonomous driving systems in complex and diverse traffic scenarios through controllable simulation is essential to ensure their safety and reliability. However, existing traffic simulation methods face challenges in their…

Robotics · Computer Science 2025-08-01 Zhiyuan Liu , Leheng Li , Yuning Wang , Haotian Lin , Hao Cheng , Zhizhe Liu , Lei He , Jianqiang Wang

Understanding low-dimensional structures within high-dimensional data is crucial for visualization, interpretation, and denoising in complex datasets. Despite the advancements in manifold learning techniques, key challenges-such as limited…

Machine Learning · Statistics 2025-04-04 Yafei Shen , Huan-Fei Ma , Ling Yang

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

In this paper, we investigate the controllability of a class of formation control systems. Given a directed graph, we assign an agent to each of its vertices and let the edges of the graph describe the information flow in the system. We…

Systems and Control · Computer Science 2015-06-02 Xudong Chen , M. -A. Belabbas , Tamer Basar

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

Understanding where and how emotions are represented in large-scale foundation models remains an open problem, particularly in multimodal affective settings. Despite the strong empirical performance of recent affective models, the internal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zhen Zhang , Runhao Zeng , Sicheng Zhao , Xiping Hu

Graph-based causal discovery methods aim to capture conditional independencies consistent with the observed data and differentiate causal relationships from indirect or induced ones. Successful construction of graphical models of data…

Machine Learning · Statistics 2021-01-08 Boris Hayete , Fred Gruber , Anna Decker , Raymond Yan

Recent advances in text-to-music models have enabled coherent music generation from text prompts, yet fine-grained emotional control remains unresolved. We introduce LARA-Gen, a framework for continuous emotion control that aligns the…

Sound · Computer Science 2026-03-11 Jiahao Mei , Xuenan Xu , Zeyu Xie , Zihao Zheng , Ye Tao , Yue Ding , Mengyue Wu

In this paper, we investigate the controllability of a linear time-invariant network following a Laplacian dynamics defined on a threshold graph. In this direction, an algorithm for deriving the modal matrix associated with the Laplacian…

Optimization and Control · Mathematics 2019-04-23 Shima Sadat Mousavi , Mohammad Haeri , Mehran Mesbahi

Multimodal foundation models integrate heterogeneous signals across modalities, yet it remains poorly understood how their predictions depend on specific internal feature groups and whether such reliance can be deliberately controlled.…

Machine Learning · Computer Science 2026-02-03 Hyunsuk Chung , Caren Han , Yerin Choi , Seungyeon Ji , Jinwoo Kim , Eun-Jung Holden , Kyungreem Han

Controlling real-world networked systems, including ecological, biomedical, and engineered networks that exhibit higher-order interactions, remains challenging due to inherent nonlinearities and large system scales. Despite extensive…

Optimization and Control · Mathematics 2026-03-23 Joshua Pickard , Xin Mao , Can Chen

Motion trajectories offer reliable references for physics-based motion learning but suffer from sparsity, particularly in regions that lack sufficient data coverage. To address this challenge, we introduce a self-supervised, structured…

Machine Learning · Computer Science 2024-02-22 Chenhao Li , Elijah Stanger-Jones , Steve Heim , Sangbae Kim

Controllable painting generation plays a pivotal role in image stylization. Currently, the control way of style transfer is subject to exemplar-based reference or a random one-hot vector guidance. Few works focus on decoupling the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Minxuan Lin , Yingying Deng , Fan Tang , Weiming Dong , Changsheng Xu

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

Robotics · Computer Science 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar