English
Related papers

Related papers: Data-efficient Large Vision Models through Sequent…

200 papers

The exponential growth of Large Multimodal Models (LMMs) has driven advancements in cross-modal reasoning but at significant computational costs. In this work, we focus on visual language models. We highlight the redundancy and inefficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yasmine Omri , Parth Shroff , Thierry Tambe

The efficiency of large language models (LLMs) is fundamentally limited by their sequential, token-by-token generation process. We argue that overcoming this bottleneck requires a new design axis for LLM scaling: increasing the semantic…

Computation and Language · Computer Science 2025-11-03 Chenze Shao , Darren Li , Fandong Meng , Jie Zhou

Large multimodal models excel in multimodal tasks but face significant computational challenges due to excessive computation on visual tokens. Unlike token reduction methods that focus on token-level redundancy, we identify and study the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Penghao Wu , Lewei Lu , Ziwei Liu

Training vision-language models on cognitively-plausible amounts of data requires rethinking how models integrate multimodal information. Within the constraints of the Vision track for the BabyLM Challenge 2025, we propose a lightweight…

Artificial Intelligence · Computer Science 2025-10-10 Bianca-Mihaela Ganescu , Suchir Salhan , Andrew Caines , Paula Buttery

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without…

Machine Learning · Computer Science 2025-08-08 Hao Dong , Lijun Sheng , Jian Liang , Ran He , Eleni Chatzi , Olga Fink

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Recent advances in subject-driven image generation using diffusion models have attracted considerable attention for their remarkable capabilities in producing high-quality images. Nevertheless, the potential of Visual Autoregressive (VAR)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xin Jiang , Jingwen Chen , Yehao Li , Yingwei Pan , Kezhou Chen , Zechao Li , Ting Yao , Tao Mei

Large Vision-Language Models (LVLMs) have experienced significant advancements in recent years. However, their performance still falls short in tasks requiring deep visual perception, such as identifying subtle differences between images. A…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Qingguo Hu , Ante Wang , Jia Song , Delai Qiu , Qingsong Liu , Jinsong Su

Despite the remarkable success of foundation models, their task-specific fine-tuning paradigm makes them inconsistent with the goal of general perception modeling. The key to eliminating this inconsistency is to use generalist models for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Hao Li , Jinguo Zhu , Xiaohu Jiang , Xizhou Zhu , Hongsheng Li , Chun Yuan , Xiaohua Wang , Yu Qiao , Xiaogang Wang , Wenhai Wang , Jifeng Dai

Large language models (LLMs) often necessitate extensive labeled datasets and training compute to achieve impressive performance across downstream tasks. This paper explores a self-training paradigm, where the LLM autonomously curates its…

Computation and Language · Computer Science 2024-11-13 Wei Jie Yeo , Teddy Ferdinan , Przemyslaw Kazienko , Ranjan Satapathy , Erik Cambria

The success of deep learning in vision can be attributed to: (a) models with high capacity; (b) increased computational power; and (c) availability of large-scale labeled data. Since 2012, there have been significant advances in…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Chen Sun , Abhinav Shrivastava , Saurabh Singh , Abhinav Gupta

Large Multimodal Model (LMM) is a hot research topic in the computer vision area and has also demonstrated remarkable potential across multiple disciplinary fields. A recent trend is to further extend and enhance the perception capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yang Jiao , Shaoxiang Chen , Zequn Jie , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Recent advancements in multimodal fusion have witnessed the remarkable success of vision-language (VL) models, which excel in various multimodal applications such as image captioning and visual question answering. However, building VL…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Zhiwei Hao , Jianyuan Guo , Li Shen , Yong Luo , Han Hu , Yonggang Wen

Scaling up autoregressive models in vision has not proven as beneficial as in large language models. In this work, we investigate this scaling problem in the context of text-to-image generation, focusing on two critical factors: whether…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Lijie Fan , Tianhong Li , Siyang Qin , Yuanzhen Li , Chen Sun , Michael Rubinstein , Deqing Sun , Kaiming He , Yonglong Tian

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Recent advances in multimodal large language models (MLLMs) have enabled impressive progress in vision-language understanding, yet their high computational cost limits deployment in resource-constrained scenarios such as personal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Quoc-Huy Trinh , Mustapha Abdullahi , Bo Zhao , Debesh Jha

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

Large Vision-Language Models (LVLMs) have achieved remarkable success in a wide range of multimodal tasks by integrating pre-trained vision encoders and large language models. However, current LVLMs primarily rely on visual features…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xu Li , Yi Zheng , Haotian Chen , Xiaolei Chen , Yuxuan Liang , Chenghang Lai , Bin Li , Xiangyang Xue

Power-law scaling indicates that large-scale training with uniform sampling is prohibitively slow. Active learning methods aim to increase data efficiency by prioritizing learning on the most relevant examples. Despite their appeal, these…

Artificial Intelligence · Computer Science 2024-10-17 Talfan Evans , Shreya Pathak , Hamza Merzic , Jonathan Schwarz , Ryutaro Tanno , Olivier J. Henaff

This paper focuses on EEG-based visual recognition, aiming to predict the visual object class observed by a subject based on his/her EEG signals. One of the main challenges is the large variation between signals from different subjects. It…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Pilhyeon Lee , Sunhee Hwang , Seogkyu Jeon , Hyeran Byun