中文
相关论文

相关论文: Architecture-Sensitive Supervised Fine-Tuning for …

200 篇论文

Recently, Vision-Language foundation models like CLIP and ALIGN, which are pre-trained on large-scale data have shown remarkable zero-shot generalization to diverse datasets with different classes and even domains. In this work, we take a…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Debarshi Brahma , Anuska Roy , Soma Biswas

Semantic segmentation datasets often exhibit two types of imbalance: \textit{class imbalance}, where some classes appear more frequently than others and \textit{size imbalance}, where some objects occupy more pixels than others. This causes…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Zifu Wang , Maxim Berman , Amal Rannen-Triki , Philip H. S. Torr , Devis Tuia , Tinne Tuytelaars , Luc Van Gool , Jiaqian Yu , Matthew B. Blaschko

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Traditional cognitive bias measurement tools are limited by narrow bias coverage, low ecological validity, and reliance on abstract self reports, constraining scenario based and human AI comparisons. We introduce the context based Cognitive…

人机交互 · 计算机科学 2026-04-28 Chengrui Zhou

We present a novel Parameter-Efficient Fine-Tuning (PEFT) method, dubbed as Adaptive Freezing of Low Rank Adaptation (AFLoRA). Specifically, for each pre-trained frozen weight tensor, we add a parallel path of trainable low-rank matrices,…

计算与语言 · 计算机科学 2024-04-17 Zeyu Liu , Souvik Kundu , Anni Li , Junrui Wan , Lianghao Jiang , Peter Anthony Beerel

Current methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into a cloze-format that the PLM can score. In this work, we…

Supervised fine-tuning (SFT) is a pivotal approach to adapting large language models (LLMs) for downstream tasks; however, performance often suffers from the ``seesaw phenomenon'', where indiscriminate parameter updates yield progress on…

计算与语言 · 计算机科学 2025-09-22 Yao Wang , Di Liang , Minlong Peng

Facial expression image editing requires fine-grained control to strictly preserve human identity and background while precisely manipulating expression. However, existing editing benchmarks primarily focus on general scenarios, lacking…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Fengjian Xue , Xuecheng Wu , Heli Sun , Yunyun Shi , Shi Chen , Liangyu Fu , Jinheng Xie , Dingkang Yang , Hao Wang , Junxiao Xue , Liang He

We evaluate whether frontier LLMs are ready for cybersecurity through a dual-mode benchmark: white-box function-level vulnerability detection (VulnLLM-R, across C/Java/Python) and black-box web application security testing (five…

密码学与安全 · 计算机科学 2026-05-25 Vivek Dahiya , Sunny Nehra , Vipul Dholariya , Bhavik Shangari , Chandra Khatri

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

With the popularity of foundational models, parameter efficient fine tuning has become the defacto approach to leverage pretrained models to perform downstream tasks. Taking inspiration from recent advances in large language models, Visual…

图像与视频处理 · 电气工程与系统科学 2025-01-08 Aadya Arora , Vinay Namboodiri

Spatial reasoning is central to navigation and robotics, yet measuring model capabilities on these tasks remains difficult. Existing benchmarks evaluate models in a one-shot setting, requiring full solution generation in a single response,…

人工智能 · 计算机科学 2026-04-13 Lars Benedikt Kaesberg , Tianyu Yang , Niklas Bauer , Terry Ruas , Jan Philip Wahle , Bela Gipp

Vision-language foundation models have exhibited remarkable success across a multitude of downstream tasks due to their scalability on extensive image-text paired data. However, these models also display significant limitations when applied…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Huan Ma , Yan Zhu , Changqing Zhang , Peilin Zhao , Baoyuan Wu , Long-Kai Huang , Qinghua Hu , Bingzhe Wu

Organizations are increasingly adopting and adapting Large Language Models (LLMs) hosted on public repositories such as HuggingFace. Although these adaptations often improve performance on specialized downstream tasks, recent evidence…

人工智能 · 计算机科学 2025-11-04 Mina Taraghi , Yann Pequignot , Amin Nikanjam , Mohamed Amine Merzouk , Foutse Khomh

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

机器学习 · 计算机科学 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic

Recent deep learning-based methods for lossy image compression achieve competitive rate-distortion performance through extensive end-to-end training and advanced architectures. However, emerging applications increasingly prioritize semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Ruiqi Shen , Haotian Wu , Wenjing Zhang , Jiangjing Hu , Deniz Gunduz

Real-life applications of action recognition often require a fine-grained understanding of subtle movements, e.g., in sports analytics, user interactions in AR/VR, and surgical videos. Although fine-grained actions are more costly to…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Mubarak Shah

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

计算与语言 · 计算机科学 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

We measure procedural-skill SFT contribution across three Qwen3.5 dense scales (0.8B, 2B, 4B) on a 200-task / 40-skill holdout, with Claude Haiku 4.5 as a frontier reference. The corpus is 353 rows of (task + procedural-skill block, Opus…

机器学习 · 计算机科学 2026-05-15 Igor Strozzi

Prompt-conditioned foundation segmenters have emerged as a dominant paradigm for image segmentation, where explicit spatial prompts (e.g., points, boxes, masks) guide mask decoding. However, many real-world deployments require fully…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Huiyao Zhang , Jin Bai , Rui Guo , JianWen Tan , HongFei Wang , Ye Li