English
Related papers

Related papers: Multi-Modality Driven LoRA for Adverse Condition D…

200 papers

Multimodal Large Language Models (MLLMs) demonstrate remarkable image-language capabilities, but their widespread use faces challenges in cost-effective training and adaptation. Existing approaches often necessitate expensive language model…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Sayna Ebrahimi , Sercan O. Arik , Tejas Nama , Tomas Pfister

We propose LoRA-MCL, a training scheme that extends next-token prediction in language models with a method designed to decode diverse, plausible sentence continuations at inference time. Traditional language modeling is an intrinsically…

Machine Learning · Computer Science 2026-02-05 Victor Letzelter , Hugo Malard , Mathieu Fontaine , Gaël Richard , Slim Essid , Andrei Bursuc , Patrick Pérez

Multi-view multi-label learning frequently suffers from simultaneous feature absence and incomplete annotations, due to challenges in data acquisition and cost-intensive supervision. To tackle the complex yet highly practical problem while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Quanjiang Li , Zhiming Liu , Tianxiang Xu , Tingjin Luo , Chenping Hou

Low-rank adaptation (LoRA) has emerged as a widely adopted parameter-efficient fine-tuning method in deep transfer learning, due to its reduced number of trainable parameters and lower memory requirements enabled by Burer-Monteiro…

Machine Learning · Computer Science 2026-02-10 Yihang Gao , Vincent Y. F. Tan

Robust 3D object detection under adverse weather conditions is crucial for autonomous driving. However, most existing methods simply combine all weather samples for training while overlooking data distribution discrepancies across different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hongwei Lin , Xun Huang , Chenglu Wen , Cheng Wang

Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails…

Computation and Language · Computer Science 2024-03-12 Ming Zhang , Ke Chang , Yunfang Wu

Real-world application models are commonly deployed in dynamic environments, where the target domain distribution undergoes temporal changes. Continual Test-Time Adaptation (CTTA) has recently emerged as a promising technique to gradually…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shilei Cao , Juepeng Zheng , Yan Liu , Baoquan Zhao , Ziqi Yuan , Weijia Li , Runmin Dong , Haohuan Fu

Emerging 3D geometric foundation models, such as DUSt3R, offer a promising approach for in-the-wild 3D vision tasks. However, due to the high-dimensional nature of the problem space and scarcity of high-quality 3D data, these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Ziqi Lu , Heng Yang , Danfei Xu , Boyi Li , Boris Ivanovic , Marco Pavone , Yue Wang

Autonomous driving visual question answering (AD-VQA) aims to answer questions related to perception, prediction, and planning based on given driving scene images, heavily relying on the model's spatial understanding capabilities. Prior…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhiyuan Zhang , Xiaofan Li , Zhihao Xu , Wenjie Peng , Zijian Zhou , Miaojing Shi , Shuangping Huang

Self-supervised depth estimation from monocular cameras in diverse outdoor conditions, such as daytime, rain, and nighttime, is challenging due to the difficulty of learning universal representations and the severe lack of labeled…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Weilong Yan , Ming Li , Haipeng Li , Shuwei Shao , Robby T. Tan

The deployment of multimodal models in high-stakes domains, such as self-driving vehicles and medical diagnostics, demands not only strong predictive performance but also reliable mechanisms for detecting failures. In this work, we address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Moru Liu , Hao Dong , Olga Fink , Mario Trapp

Reliable visual perception under adverse weather conditions, such as rain, haze, snow, or a mixture of them, is desirable yet challenging for autonomous driving and outdoor robots. In this paper, we propose a unified Memory-Enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Qianyi Shao , Yuanfan Zhang , Renxiang Xiao , Liang Hu

Drag-based editing within pretrained diffusion model provides a precise and flexible way to manipulate foreground objects. Traditional methods optimize the input feature obtained from DDIM inversion directly, adjusting them iteratively to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Siwei Xia , Li Sun , Tiantian Sun , Qingli Li

With the increasing adoption of video anomaly detection in intelligent surveillance domains, conventional visual-based detection approaches often struggle with information insufficiency and high false-positive rates in complex environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peng Wu , Wanshun Su , Guansong Pang , Yujia Sun , Qingsen Yan , Peng Wang , Yanning Zhang

Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT). Yet, its efficacy is hampered by two fundamental limitations: semantic drift, by treating all update directions with equal importance, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xi Xiao , Chenrui Ma , Yunbei Zhang , Chen Liu , Zhuxuanzi Wang , Yanshu Li , Lin Zhao , Guosheng Hu , Tianyang Wang , Hao Xu

Large-scale multimodal foundation models, particularly Contrastive Captioners (CoCa), have achieved state-of-the-art results by unifying contrastive alignment with generative captioning. While zero-shot transfer capabilities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 N. K. B. M. P. K. B. Narasinghe , Uthayasanker Thayasivam

Multimodal aspect-based sentiment analysis(MABSA) seeks to identify aspect terms within paired image-text data and determine their fine grained sentiment polarities, representing a fundamental task for improving the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xiaoqiang He

Weakly supervised monocular 3D detection, while less annotation-intensive, often struggles to capture the global context required for reliable 3D reasoning. Conventional label-efficient methods focus on object-centric features, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Chupeng Liu , Runkai Zhao , Weidong Cai

Safe autonomous systems in complex environments require robust road anomaly segmentation to identify unknown obstacles. However, existing approaches often rely on pixel-level statistics to determine whether a region appears anomalous. This…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuolin He , Jiacheng Tang , Jian Pu , Xiangyang Xue

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method validated across NLP and CV domains. However, LoRA faces an inherent low-rank bottleneck: narrowing its performance gap with full finetuning…

Machine Learning · Computer Science 2025-12-03 Haonan Dong , Wenhao Zhu , Guojie Song , Liang Wang