English
Related papers

Related papers: Architecture-Sensitive Supervised Fine-Tuning for …

200 papers

Recently, Vision-Language foundation models like CLIP and ALIGN, which are pre-trained on large-scale data have shown remarkable zero-shot generalization to diverse datasets with different classes and even domains. In this work, we take a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Debarshi Brahma , Anuska Roy , Soma Biswas

Semantic segmentation datasets often exhibit two types of imbalance: \textit{class imbalance}, where some classes appear more frequently than others and \textit{size imbalance}, where some objects occupy more pixels than others. This causes…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zifu Wang , Maxim Berman , Amal Rannen-Triki , Philip H. S. Torr , Devis Tuia , Tinne Tuytelaars , Luc Van Gool , Jiaqian Yu , Matthew B. Blaschko

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Traditional cognitive bias measurement tools are limited by narrow bias coverage, low ecological validity, and reliance on abstract self reports, constraining scenario based and human AI comparisons. We introduce the context based Cognitive…

Human-Computer Interaction · Computer Science 2026-04-28 Chengrui Zhou

We present a novel Parameter-Efficient Fine-Tuning (PEFT) method, dubbed as Adaptive Freezing of Low Rank Adaptation (AFLoRA). Specifically, for each pre-trained frozen weight tensor, we add a parallel path of trainable low-rank matrices,…

Computation and Language · Computer Science 2024-04-17 Zeyu Liu , Souvik Kundu , Anni Li , Junrui Wan , Lianghao Jiang , Peter Anthony Beerel

Current methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into a cloze-format that the PLM can score. In this work, we…

Computation and Language · Computer Science 2022-04-27 Rabeeh Karimi Mahabadi , Luke Zettlemoyer , James Henderson , Marzieh Saeidi , Lambert Mathias , Veselin Stoyanov , Majid Yazdani

Supervised fine-tuning (SFT) is a pivotal approach to adapting large language models (LLMs) for downstream tasks; however, performance often suffers from the ``seesaw phenomenon'', where indiscriminate parameter updates yield progress on…

Computation and Language · Computer Science 2025-09-22 Yao Wang , Di Liang , Minlong Peng

Facial expression image editing requires fine-grained control to strictly preserve human identity and background while precisely manipulating expression. However, existing editing benchmarks primarily focus on general scenarios, lacking…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Fengjian Xue , Xuecheng Wu , Heli Sun , Yunyun Shi , Shi Chen , Liangyu Fu , Jinheng Xie , Dingkang Yang , Hao Wang , Junxiao Xue , Liang He

We evaluate whether frontier LLMs are ready for cybersecurity through a dual-mode benchmark: white-box function-level vulnerability detection (VulnLLM-R, across C/Java/Python) and black-box web application security testing (five…

Cryptography and Security · Computer Science 2026-05-25 Vivek Dahiya , Sunny Nehra , Vipul Dholariya , Bhavik Shangari , Chandra Khatri

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

With the popularity of foundational models, parameter efficient fine tuning has become the defacto approach to leverage pretrained models to perform downstream tasks. Taking inspiration from recent advances in large language models, Visual…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Aadya Arora , Vinay Namboodiri

Spatial reasoning is central to navigation and robotics, yet measuring model capabilities on these tasks remains difficult. Existing benchmarks evaluate models in a one-shot setting, requiring full solution generation in a single response,…

Artificial Intelligence · Computer Science 2026-04-13 Lars Benedikt Kaesberg , Tianyu Yang , Niklas Bauer , Terry Ruas , Jan Philip Wahle , Bela Gipp

Vision-language foundation models have exhibited remarkable success across a multitude of downstream tasks due to their scalability on extensive image-text paired data. However, these models also display significant limitations when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Huan Ma , Yan Zhu , Changqing Zhang , Peilin Zhao , Baoyuan Wu , Long-Kai Huang , Qinghua Hu , Bingzhe Wu

Organizations are increasingly adopting and adapting Large Language Models (LLMs) hosted on public repositories such as HuggingFace. Although these adaptations often improve performance on specialized downstream tasks, recent evidence…

Artificial Intelligence · Computer Science 2025-11-04 Mina Taraghi , Yann Pequignot , Amin Nikanjam , Mohamed Amine Merzouk , Foutse Khomh

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

Machine Learning · Computer Science 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic

Recent deep learning-based methods for lossy image compression achieve competitive rate-distortion performance through extensive end-to-end training and advanced architectures. However, emerging applications increasingly prioritize semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Ruiqi Shen , Haotian Wu , Wenjing Zhang , Jiangjing Hu , Deniz Gunduz

Real-life applications of action recognition often require a fine-grained understanding of subtle movements, e.g., in sports analytics, user interactions in AR/VR, and surgical videos. Although fine-grained actions are more costly to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Mubarak Shah

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

We measure procedural-skill SFT contribution across three Qwen3.5 dense scales (0.8B, 2B, 4B) on a 200-task / 40-skill holdout, with Claude Haiku 4.5 as a frontier reference. The corpus is 353 rows of (task + procedural-skill block, Opus…

Machine Learning · Computer Science 2026-05-15 Igor Strozzi

Prompt-conditioned foundation segmenters have emerged as a dominant paradigm for image segmentation, where explicit spatial prompts (e.g., points, boxes, masks) guide mask decoding. However, many real-world deployments require fully…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Huiyao Zhang , Jin Bai , Rui Guo , JianWen Tan , HongFei Wang , Ye Li
‹ Prev 1 4 5 6 7 8 10 Next ›