English
Related papers

Related papers: Generating Procedural Materials from Text or Image…

200 papers

This work focuses on the novel problem setting of generating graphs conditioned on a description of the graph's functional requirements in a downstream task. We pose the problem as a text-to-text generation problem and focus on the approach…

Machine Learning · Computer Science 2023-11-02 Peter A. Zachares , Vahan Hovhannisyan , Alan Mosca , Yarin Gal

Book covers are intentionally designed and provide an introduction to a book. However, they typically require professional skills to design and produce the cover images. Thus, we propose a generative neural network that can produce book…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Wensheng Zhang , Yan Zheng , Taiga Miyazono , Seiichi Uchida , Brian Kenji Iwana

Text-to-image generative models like DALL-E and Stable Diffusion have revolutionized visual content creation across various applications, including advertising, personalized media, and design prototyping. However, crafting effective textual…

Artificial Intelligence · Computer Science 2025-07-22 Donghoon Kim , Minji Bae , Kyuhong Shim , Byonghyo Shim

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

Structure aware graph generation aims to generate graphs that satisfy given topological properties. It has applications in domains such as drug discovery, social network modeling, and knowledge graph construction. Unlike existing methods…

Artificial Intelligence · Computer Science 2026-05-05 Nidhi Vakil , Hadi Amiri

Early graph prompt tuning approaches relied on task-specific designs for Graph Neural Networks (GNNs), limiting their adaptability across diverse pre-training strategies. In contrast, another promising line of research has investigated…

Machine Learning · Computer Science 2025-12-10 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Yijie Li , Edith C. H. Ngai

In this paper, we propose and investigate the use of neural audio codec language models for the automatic generation of sample-based musical instruments based on text or reference audio prompts. Our approach extends a generative audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-23 Shahan Nercessian , Johannes Imort , Ninon Devis , Frederik Blang

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

Generating shapes using natural language can enable new ways of imagining and creating the things around us. While significant recent progress has been made in text-to-image generation, text-to-shape generation remains a challenging problem…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Aditya Sanghi , Hang Chu , Joseph G. Lambourne , Ye Wang , Chin-Yi Cheng , Marco Fumero , Kamal Rahimi Malekshan

The performance of computer vision models in certain real-world applications (e.g., rare wildlife observation) is limited by the small number of available images. Expanding datasets using pre-trained generative models is an effective way to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Changjian Chen , Fei Lv , Yalong Guan , Pengcheng Wang , Shengjie Yu , Yifan Zhang , Zhuo Tang

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sarah Cechnicka , Matthew Baugh , Weitong Zhang , Mischa Dombrowski , Zhe Li , Johannes C. Paetzold , Candice Roufosse , Bernhard Kainz

Recommendation Systems are effective in managing the ever-increasing amount of multimodal data available today and help users discover interesting new items. These systems can handle various media types such as images, text, audio, and…

Machine Learning · Computer Science 2026-03-03 Haimonti Dutta , Pruthvi Moluguri , Jin Dai , Saurabh Amarnath Mahindre

We extend our previous algorithm that generates all labeled graphs with a given graphical degree sequence to generate all labeled triangle-free graphs with a given graphical degree sequence. The algorithm uses various pruning techniques to…

Combinatorics · Mathematics 2026-01-23 Kai Wang

Text-to-image diffusion models enable high-quality image generation but are computationally expensive. While prior work optimizes per-inference efficiency, we explore an orthogonal approach: reducing redundancy across correlated prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Dale Decatur , Thibault Groueix , Wang Yifan , Rana Hanocka , Vladimir Kim , Matheus Gadelha

Most previous work on neural text generation from graph-structured data relies on standard sequence-to-sequence methods. These approaches linearise the input graph to be fed to a recurrent neural network. In this paper, we propose an…

Computation and Language · Computer Science 2018-10-24 Diego Marcheggiani , Laura Perez-Beltrachini

The problem of code generation from textual program descriptions has long been viewed as a grand challenge in software engineering. In recent years, many deep learning based approaches have been proposed, which can generate a sequence of…

Software Engineering · Computer Science 2021-04-23 Chen Lyu , Ruyun Wang , Hongyu Zhang , Hanwen Zhang , Songlin Hu

Graphical causal models are an important tool for knowledge discovery because they can represent both the causal relations between variables and the multivariate probability distributions over the data. Once learned, causal graphs can be…

Artificial Intelligence · Computer Science 2017-04-11 Andrew J Sedgewick , Joseph D. Ramsey , Peter Spirtes , Clark Glymour , Panayiotis V. Benos

Learning the underlying distribution of molecular graphs and generating high-fidelity samples is a fundamental research problem in drug discovery and material science. However, accurately modeling distribution and rapidly generating novel…

Machine Learning · Computer Science 2023-05-24 Han Huang , Leilei Sun , Bowen Du , Weifeng Lv

Generative models for graph data are an important research topic in machine learning. Graph data comprise two levels that are typically analyzed separately: node-level properties such as the existence of a link between a pair of nodes, and…

Machine Learning · Computer Science 2023-01-18 Kiarash Zahirnia , Oliver Schulte , Parmis Naddaf , Ke Li

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton