English
Related papers

Related papers: GenAssist: Making Image Generation Accessible

200 papers

Recently, with the rapid advancements of generative models, the field of visual text generation has witnessed significant progress. However, it is still challenging to render high-quality text images in real-world scenarios, as three…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yuanzhi Zhu , Jiawei Liu , Feiyu Gao , Wenyu Liu , Xinggang Wang , Peng Wang , Fei Huang , Cong Yao , Zhibo Yang

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

EasyRead pictograms are simple, visually clear images that represent specific concepts and support comprehension for people with intellectual disabilities, low literacy, or language barriers. The large-scale production of EasyRead content…

Human-Computer Interaction · Computer Science 2026-03-17 Nicolas Dickenmann , Yanis Merzouki , Sonia Laguna , Thy Nowak-Tran , Emanuele Palumbo , Julia E. Vogt , Gerda Binder

Visual generation models have achieved remarkable progress in computer graphics applications but still face significant challenges in real-world deployment. Current assessment approaches for visual generation tasks typically follow an…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xiaoyue Mi , Fan Tang , Juan Cao , Qiang Sheng , Ziyao Huang , Peng Li , Yang Liu , Tong-Yee Lee

As virtual 3D environments become more prevalent, equitable access is essential for blind and low-vision (BLV) users, who face challenges with spatial awareness, navigation, and interaction. Prior work has explored supplementing visual…

Human-Computer Interaction · Computer Science 2026-02-10 Xinyun Cao , Kexin Phyllis Ju , Chenglin Li , Venkatesh Potluri , Dhruv Jain

Our work aims to develop new assistive technologies that enable blind or low vision (BLV) people to explore and analyze data readily. At present, barriers exist for BLV people to explore and analyze data, restricting access to government,…

Human-Computer Interaction · Computer Science 2025-07-01 Samuel Reinders , Munazza Zaib , Matthew Butler , Bongshin Lee , Ingrid Zukerman , Lizhen Qu , Kim Marriott

For individuals with blindness or low vision (BLV), navigating complex environments can pose serious risks. Large Vision-Language Models (LVLMs) show promise for generating scene descriptions, but their effectiveness for BLV users remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Na Min An , Eunki Kim , Wan Ju Kang , Sangryul Kim , James Thorne , Hyunjung Shim

Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Aditya Chinchure , Pushkar Shukla , Gaurav Bhatt , Kiri Salij , Kartik Hosanagar , Leonid Sigal , Matthew Turk

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Generative models are increasingly integrated into creative workflows. While text-to-image generation excels in visual quality and diversity, color accessibility for users with Color Vision Deficiencies (CVD) remains largely unexplored. Our…

Graphics · Computer Science 2026-03-11 Xinyao Zhuang , Jose Echevarria , Kaan Akşit

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

Graphics · Computer Science 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

Painting is one of the ways for people to express their ideas, but what if people with disabilities in hands want to paint? To tackle this challenge, we create an end-to-end solution that can generate artistic images from text descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Qinghe Tian , Jean-Claude Franchitti

Advances in text-based image generation and editing have revolutionized content creation, enabling users to create impressive content from imaginative text prompts. However, existing methods are not designed to work well with the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tiancheng Shen , Jun Hao Liew , Long Mai , Lu Qi , Jiashi Feng , Jiaya Jia

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

Exams are a fundamental test of expert-level intelligence and require integrated understanding, reasoning, and generation. Existing exam-style benchmarks mainly focus on understanding and reasoning tasks, and current generation benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhaokai Wang , Penghao Yin , Xiangyu Zhao , Changyao Tian , Yu Qiao , Wenhai Wang , Jifeng Dai , Gen Luo

Recent advances in Generative AI have transformed how users interact with data analysis through natural language interfaces. However, many systems rely too heavily on LLMs, creating risks of hallucination, opaque reasoning, and reduced user…

Human-Computer Interaction · Computer Science 2025-09-04 Ratanond Koonchanok , Alex Kale , Khairi Reda

Automatic artistic text generation is an emerging topic which receives increasing attention due to its wide applications. The artistic text can be divided into three components, content, font, and texture, respectively. Existing artistic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Qirui Huang , Bin Fu , Aozhong Zhang , Yu Qiao

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo