English
Related papers

Related papers: Exploring Compositional Generalization of Multimod…

200 papers

The natural world is abundant with concepts expressed via visual, acoustic, tactile, and linguistic modalities. Much of the existing progress in multimodal learning, however, focuses primarily on problems where the same set of modalities…

Machine Learning · Computer Science 2020-12-08 Paul Pu Liang , Peter Wu , Liu Ziyin , Louis-Philippe Morency , Ruslan Salakhutdinov

Multimodal Large Language Models (MLLMs) have demonstrated remarkable effectiveness in various general-domain scenarios, such as visual question answering and image captioning. Recently, researchers have increasingly focused on empowering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yan Shu , Chi Liu , Robin Chen , Derek Li , Bryan Dai

Compositionality is a common property in many modalities including natural languages and images, but the compositional generalization of multi-modal models is not well-understood. In this paper, we identify two sources of visual-linguistic…

Computation and Language · Computer Science 2023-10-05 Chenwei Wu , Li Erran Li , Stefano Ermon , Patrick Haffner , Rong Ge , Zaiwei Zhang

Recent developments in multimodal methodologies have marked the beginning of an exciting era for models adept at processing diverse data types, encompassing text, audio, and visual content. Models like GPT-4V, which merge computer vision…

Computation and Language · Computer Science 2024-11-15 Xiang Zhang , Senyu Li , Ning Shi , Bradley Hauer , Zijun Wu , Grzegorz Kondrak , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan

Recent advancements in multimodal foundation models have yielded significant progress in vision-language understanding. Initial attempts have also explored the potential of multimodal large language models (MLLMs) for visual content…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rongyao Fang , Chengqi Duan , Kun Wang , Hao Li , Hao Tian , Xingyu Zeng , Rui Zhao , Jifeng Dai , Hongsheng Li , Xihui Liu

The potential of large language models (LLMs) to simultaneously perform a wide range of natural language processing (NLP) tasks has been the subject of extensive research. Although instruction tuning has proven to be a data-efficient method…

Computation and Language · Computer Science 2023-10-25 Chufan Shi , Yixuan Su , Cheng Yang , Yujiu Yang , Deng Cai

Grounded language models use external sources of information, such as knowledge graphs, to meet some of the general challenges associated with pre-training. By extending previous work on compositional generalization in semantic parsing, we…

Computation and Language · Computer Science 2024-06-10 Sondre Wold , Étienne Simon , Lucas Georges Gabriel Charpentier , Egor V. Kostylev , Erik Velldal , Lilja Øvrelid

The advancement of Multimodal Large Language Models (MLLMs) has greatly accelerated the development of applications in understanding integrated texts and images. Recent works leverage image-caption datasets to train MLLMs, achieving…

Computation and Language · Computer Science 2024-11-22 Mingxu Tao , Quzhe Huang , Kun Xu , Liwei Chen , Yansong Feng , Dongyan Zhao

In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance generalization, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ranjan Sapkota , Shaina Raza , Maged Shoman , Achyut Paudel , Manoj Karkee

Recent advancements in unified vision-language models (VLMs), which integrate both visual understanding and generation capabilities, have attracted significant attention. The underlying hypothesis is that a unified architecture with mixed…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jihai Zhang , Tianle Li , Linjie Li , Zhengyuan Yang , Yu Cheng

Rapid advancements in imaging techniques and analytical methods over the past decade have revolutionized our ability to comprehensively probe the biological world at multiple scales, pinpointing the type, quantity, location, and even…

Artificial Intelligence · Computer Science 2025-10-02 Shanghang Zhang , Gaole Dai , Tiejun Huang , Jianxu Chen

Retouching is an essential task in post-manipulation of raw photographs. Generative editing, guided by text or strokes, provides a new tool accessible to users but can easily change the identity of the original objects in unacceptable and…

Graphics · Computer Science 2025-05-12 Niladri Shekhar Dutt , Duygu Ceylan , Niloy J. Mitra

Existing Medical Large Vision-Language Models (Med-LVLMs), encapsulating extensive medical knowledge, demonstrate excellent capabilities in understanding medical images. However, there remain challenges in visual localization in medical…

Computation and Language · Computer Science 2025-06-03 Yucheng Zhou , Lingran Song , Jianbing Shen

Compositional Generalization (CG) embodies the ability to comprehend novel combinations of familiar concepts, representing a significant cognitive leap in human intellectual advancement. Despite its critical importance, the deep neural…

Machine Learning · Computer Science 2024-05-21 Jingwen Fu , Zhizheng Zhang , Yan Lu , Nanning Zheng

In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Tristan Sylvain , Francis Dutil , Tess Berthier , Lisa Di Jorio , Margaux Luck , Devon Hjelm , Yoshua Bengio

Multimodal large language models (MLLMs) represent an evolutionary expansion in the capabilities of traditional large language models, enabling them to tackle challenges that surpass the scope of purely text-based applications. It leverages…

Computation and Language · Computer Science 2025-01-17 Jinlong He , Pengfei Li , Gang Liu , Genrong He , Zhaolin Chen , Shenjun Zhong

The rise of multimodal large language models (MLLMs) has sparked an unprecedented wave of applications in the field of medical imaging analysis. However, as one of the earliest and most fundamental tasks integrated into this paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xun Zhu , Fanbin Mo , Xi Chen , Kaili Zheng , Shaoshuai Yang , Yiming Shi , Jian Gao , Miao Li , Ji Wu

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Multimodal Large Language Models (MLLMs) show promise for medical applications, yet progress in dermatology lags due to limited training data, narrow task coverage, and lack of clinically-grounded supervision that mirrors expert diagnostic…

Computation and Language · Computer Science 2026-01-06 Jinghan Ru , Siyuan Yan , Yuguo Yin , Yuexian Zou , Zongyuan Ge

According to the principle of compositional generalization, the meaning of a complex expression can be understood as a function of the meaning of its parts and of how they are combined. This principle is crucial for human language…

Computation and Language · Computer Science 2024-03-19 Sungjun Han , Sebastian Padó
‹ Prev 1 8 9 10 Next ›