English
Related papers

Related papers: Scientific Graphics Program Synthesis via Dual Sel…

200 papers

Multimodal Large Language Models (MLLMs) have shown strong potential for radiology report generation, yet their clinical translation is hindered by architectural heterogeneity and the prevalence of factual hallucinations. Standard…

Machine Learning · Computer Science 2026-01-13 Kun Zhao , Siyuan Dai , Pan Wang , Jifeng Song , Hui Ji , Chenghua Lin , Liang Zhan , Haoteng Tang

Retrieval-Augmented Generation (RAG) has become critical for knowledge-intensive applications, yet evaluating its performance in vertical domains remains difficult due to domain complexity, diverse context scales, and heavy reliance on…

Computation and Language · Computer Science 2026-05-27 Jingbin Qian , Congwen Yi , Min Xia , Wen Wu , Jun Zhu , Jian Guan

We propose a novel approach for generating high-quality, synthetic data for domain-specific learning tasks, for which training data may not be readily available. We leverage recent progress in image-to-image translation to bridge the gap…

Robotics · Computer Science 2017-10-13 Gregory J. Stein , Nicholas Roy

Texture synthesis is a fundamental task in computer vision, whose goal is to generate visually realistic and structurally coherent textures for a wide range of applications, from graphics to scientific simulations. While traditional methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Elahe Salari , Zohreh Azimifar

We introduce Skywork UniPic, a 1.5 billion-parameter autoregressive model that unifies image understanding, text-to-image generation, and image editing within a single architecture-eliminating the need for task-specific adapters or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Peiyu Wang , Yi Peng , Yimeng Gan , Liang Hu , Tianyidan Xie , Xiaokun Wang , Yichen Wei , Chuanxin Tang , Bo Zhu , Changshi Li , Hongyang Wei , Eric Li , Xuchen Song , Yang Liu , Yahui Zhou

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Large Language Models (LLMs) are increasingly capable of generating complete applications from natural language instructions, creating new opportunities in science and education. In these domains, interactive scientific demonstrations are…

Software Engineering · Computer Science 2026-05-21 Qiaosheng Chen , Yang Liu , Lei Li , Kai Chen , Qipeng Guo , Gong Cheng , Fei Yuan

Creating high-quality figures and visualizations for scientific papers is a time-consuming task that requires both deep domain knowledge and professional design skills. Despite over 2.5 million scientific papers published annually, the…

Artificial Intelligence · Computer Science 2026-01-09 Siyuan Huang , Yutong Gao , Juyang Bai , Yifan Zhou , Zi Yin , Xinxin Liu , Rama Chellappa , Chun Pong Lau , Sayan Nag , Cheng Peng , Shraman Pramanick

The performance of a zero-shot sketch-based image retrieval (ZS-SBIR) task is primarily affected by two challenges. The substantial domain gap between image and sketch features needs to be bridged, while at the same time the side…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sumrit Gupta , Ushasi Chaudhuri , Biplab Banerjee

Generating structured, editable diagrams remains a significant challenge for contemporary large language models, despite their proficiency in general-purpose vector code generation. The primary difficulty lies in the structural fragility of…

Computation and Language · Computer Science 2026-05-26 Sifan Li , Yujun Cai , Hongkai Chen , Yiwei Wang

Although neural networks have been applied to several systems in recent years, they still cannot be used in safety-critical systems due to the lack of efficient techniques to certify their robustness. A number of techniques based on convex…

Machine Learning · Computer Science 2021-09-28 Ziye Ma , Somayeh Sojoudi

Quantization has emerged as a promising direction for model compression. Recently, data-free quantization has been widely studied as a promising method to avoid privacy concerns, which synthesizes images as an alternative to real training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jianhong Bai , Yuchen Yang , Huanpeng Chu , Hualiang Wang , Zuozhu Liu , Ruizhe Chen , Xiaoxuan He , Lianrui Mu , Chengfei Cai , Haoji Hu

Being able to effectively read scientific plots, or chart understanding, is a central part toward building effective agents for science. However, existing multimodal large language models (MLLMs), especially open-source ones, are still…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yuwei Yang , Zeyu Zhang , Yunzhong Hou , Zhuowan Li , Gaowen Liu , Ali Payani , Yuan-Sen Ting , Liang Zheng

Large Language Models frequently generate outputs that appear scientifically reasonable yet violate fundamental principles--a phenomenon we characterize as the "plausibility-validity gap." This challenge proves especially acute in…

Machine Learning · Computer Science 2026-01-07 Malikussaid , Hilal Hudan Nuha , Isman Kurniawan

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yibin Liu , Jianyu Zhang , Li Zhang , Shijian Li , Gang Pan

Aims: We present a custom support vector machine classification package for photometric redshift estimation, including comparisons with other methods. We also explore the efficacy of including galaxy shape information in redshift…

Instrumentation and Methods for Astrophysics · Physics 2017-04-12 Evan Jones , J. Singal

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

The use of deep learning techniques has achieved significant progress for program synthesis from input-output examples. However, when the program semantics become more complex, it still remains a challenge to synthesize programs that are…

Machine Learning · Computer Science 2020-10-23 Kavi Gupta , Peter Ebert Christensen , Xinyun Chen , Dawn Song

Background: The development of scientific software applications is far from trivial, due to the constant increase in the necessary complexity of these applications, their increasing size, and their need for intensive maintenance and reuse.…

Software Engineering · Computer Science 2020-10-21 Elvira-Maria Arvanitou , Apostolos Ampatzoglou , Alexander Chatzigeorgiou , Jeffrey C. Carver

Generative models, such as diffusion and autoregressive approaches, have demonstrated impressive capabilities in editing natural images. However, applying these tools to scientific charts rests on a flawed assumption: a chart is not merely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Shawn Li , Ryan Rossi , Sungchul Kim , Sunav Choudhary , Franck Dernoncourt , Puneet Mathur , Zhengzhong Tu , Yue Zhao