English
Related papers

Related papers: Using Large Text-to-Image Models with Structured P…

200 papers

In medical image analysis, the expertise scarcity and the high cost of data annotation limits the development of large artificial intelligence models. This paper investigates the potential of transfer learning with pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiajin Zhang , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

We explore the extension of chain-of-thought (CoT) prompting to medical reasoning for the task of automatic diagnosis. Motivated by doctors' underlying reasoning process, we present Diagnostic-Reasoning CoT (DR-CoT). Empirical results…

Computation and Language · Computer Science 2023-07-19 Cheng-Kuang Wu , Wei-Lin Chen , Hsin-Hsi Chen

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

Machine Learning · Computer Science 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li

Recent developments in large language models (LLMs) have unlocked new opportunities for healthcare, from information synthesis to clinical decision support. These new LLMs are not just capable of modeling language, but can also act as…

Human-Computer Interaction · Computer Science 2023-09-21 Nikita Mehandru , Brenda Y. Miao , Eduardo Rodriguez Almaraz , Madhumita Sushil , Atul J. Butte , Ahmed Alaa

Despite tremendous progress in computer vision, there has not been an attempt for machine learning on very large-scale medical image databases. We present an interleaved text/image deep learning system to extract and mine the semantic…

Computer Vision and Pattern Recognition · Computer Science 2015-05-05 Hoo-Chang Shin , Le Lu , Lauren Kim , Ari Seff , Jianhua Yao , Ronald M. Summers

Text-to-image (T2I) models offer great potential for creating virtually limitless synthetic data, a valuable resource compared to fixed and finite real datasets. Previous works evaluate the utility of synthetic data from T2I models on three…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhang Xiaofeng , Aaron Courville , Michal Drozdzal , Adriana Romero-Soriano

The application of Artificial Intelligence (AI) in healthcare has been revolutionary, especially with the recent advancements in transformer-based Large Language Models (LLMs). However, the task of understanding unstructured electronic…

Computation and Language · Computer Science 2023-08-08 Shivani Shekhar , Simran Tiwari , T. C. Rensink , Ramy Eskander , Wael Salloum

Large language models (LLMs) holds significant promise in achieving general medication recommendation systems owing to their comprehensive interpretation of clinical notes and flexibility to medication encoding. We evaluated both…

Information Retrieval · Computer Science 2025-08-05 Zihao Zhao , Chenxiao Fan , Junlong Liu , Zheng Wang , Xiangnan He , Chongming Gao , Juan Li , Fuli Feng

Text-to-SQL systems facilitate smooth interaction with databases by translating natural language queries into Structured Query Language (SQL), bridging the gap between non-technical users and complex database management systems. This survey…

Artificial Intelligence · Computer Science 2025-01-24 Aditi Singh , Akash Shetty , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei

Multiple adverse health conditions co-occurring in a patient are typically associated with poor prognosis and increased office or hospital visits. Developing methods to identify patterns of co-occurring conditions can assist in diagnosis.…

Computation and Language · Computer Science 2017-11-30 Moumita Bhattacharya , Claudine Jurkovitz , Hagit Shatkay

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

Large language models (LLMs) trained purely on text ostensibly lack any direct perceptual experience, yet their internal representations are implicitly shaped by multimodal regularities encoded in language. We test the hypothesis that…

Computation and Language · Computer Science 2025-10-06 Sophie L. Wang , Phillip Isola , Brian Cheung

Prompt tuning has been employed as an efficient way to adapt large vision-language pre-trained models (e.g. CLIP) to various downstream tasks in data-limited or label-limited settings. Nonetheless, visual data (e.g., images) is by default…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Zixian Guo , Bowen Dong , Zhilong Ji , Jinfeng Bai , Yiwen Guo , Wangmeng Zuo

This paper aims to address the challenge of sparse and missing data in recommendation systems, a significant hurdle in the age of big data. Traditional imputation methods struggle to capture complex relationships within the data. We propose…

Information Retrieval · Computer Science 2024-08-09 Zhicheng Ding , Jiahao Tian , Zhenkai Wang , Jinman Zhao , Siyang Li

Text-to-image models such as stable diffusion have opened a plethora of opportunities for generating art. Recent literature has surveyed the use of text-to-image models for enhancing the work of many creative artists. Many e-commerce…

Human-Computer Interaction · Computer Science 2024-03-12 Shanu Vashishtha , Abhinav Prakash , Lalitesh Morishetti , Kaushiki Nag , Yokila Arora , Sushant Kumar , Kannan Achan

Several recent works have argued that Large Language Models (LLMs) can be used to tame the data deluge in the cybersecurity field, by improving the automation of Cyber Threat Intelligence (CTI) tasks. This work presents an evaluation…

Cryptography and Security · Computer Science 2025-11-13 Emanuele Mezzi , Fabio Massacci , Katja Tuma

Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or…

Computation and Language · Computer Science 2024-03-05 Kinshuk Vasisht , Balaji Ganesan , Vikas Kumar , Vasudha Bhatnagar

Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Tanzila Rahman , Shweta Mahajan , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Leonid Sigal

Despite continued advancement in recent years, deep neural networks still rely on large amounts of training data to avoid overfitting. However, labeled training data for real-world applications such as healthcare is limited and difficult to…