English
Related papers

Related papers: Can Generalist Foundation Models Outcompete Specia…

200 papers

Prompt tuning is a promising method to fine-tune a pre-trained language model without retraining its large-scale parameters. Instead, it attaches a soft prompt to the input text, whereby downstream tasks can be well adapted by merely…

Computation and Language · Computer Science 2024-12-12 Pengxiang Lan , Enneng Yang , Yuting Liu , Guibing Guo , Jianzhe Zhao , Xingwei Wang

Prompts play a critical role in unleashing the power of language and vision foundation models for specific tasks. For the first time, we introduce prompting into depth foundation models, creating a new paradigm for metric depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Haotong Lin , Sida Peng , Jingxiao Chen , Songyou Peng , Jiaming Sun , Minghuan Liu , Hujun Bao , Jiashi Feng , Xiaowei Zhou , Bingyi Kang

One of the most powerful and enduring ideas in written discourse analysis is that genres can be described in terms of the moves which structure a writer's purpose. Considerable research has sought to identify these distinct communicative…

Computation and Language · Computer Science 2024-11-05 Danni Yu , Marina Bondi , Ken Hyland

This comprehensive review delves into the pivotal role of prompt engineering in unleashing the capabilities of Large Language Models (LLMs). The development of Artificial Intelligence (AI), from its inception in the 1950s to the emergence…

Computation and Language · Computer Science 2025-06-18 Banghao Chen , Zhaofeng Zhang , Nicolas Langrené , Shengxin Zhu

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Promptable segmentation foundation models such as SAM3 have demonstrated strong generalization capabilities through interactive and concept-based prompting. However, their direct applicability to medical image segmentation remains limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Chongcong Jiang , Tianxingjian Ding , Chuhan Song , Jiachen Tu , Ziyang Yan , Yihua Shao , Zhenyi Wang , Yuzhang Shang , Tianyu Han , Yu Tian

Universal segmentation models offer significant potential in addressing a wide range of tasks by effectively leveraging discrete annotations. As the scope of tasks and modalities expands, it becomes increasingly important to generate and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yiwen Ye , Ziyang Chen , Jianpeng Zhang , Yutong Xie , Yong Xia

Medical dialogue generation relies on natural language generation techniques to enable online medical consultations. Recently, the widespread adoption of large-scale models in the field of natural language processing has facilitated rapid…

Computation and Language · Computer Science 2023-11-27 Zhijie Qu , Juan Li , Zerui Ma , Jianqiang Li

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant…

Computation and Language · Computer Science 2024-07-25 Shubham Vatsal , Harsh Dubey

This research investigates the use of customized GPT models to enhance prompting proficiency among architecture students when generating AI-driven images. Prompt engineering is increasingly essential in architectural education due to the…

Human-Computer Interaction · Computer Science 2025-04-28 Juan David Salazar Rodriguez , Sam Conrad Joyce , Julfendi

Large Language models (LLMs) have emerged as powerful tools for addressing challenges across diverse domains. Notably, recent studies have demonstrated that large language models significantly enhance the efficiency of biomolecular analysis…

Computation and Language · Computer Science 2025-03-07 Jiyue Jiang , Zikang Wang , Yuheng Shan , Heyan Chai , Jiayi Li , Zixian Ma , Xinrui Zhang , Yu Li

[Context]: Companies are increasingly recognizing the importance of automating Requirements Engineering (RE) tasks due to their resource-intensive nature. The advent of GenAI has made these tasks more amenable to automation, thanks to its…

Software Engineering · Computer Science 2023-11-08 Krishna Ronanki , Beatriz Cabrero-Daniel , Jennifer Horkoff , Christian Berger

Large Language Models, particularly decoder-only generative models such as GPT, are increasingly used to automate Software Engineering tasks. These models are primarily guided through natural language prompts, making prompt engineering a…

Software Engineering · Computer Science 2026-01-06 Alexander Korn , Lea Zaruchas , Chetan Arora , Andreas Metzger , Sven Smolka , Fanyu Wang , Andreas Vogelsang

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Fine-tuning pre-trained language models (PLMs), e.g., SciBERT, generally requires large numbers of annotated data to achieve state-of-the-art performance on a range of NLP tasks in the scientific domain. However, obtaining the fine-tune…

Computation and Language · Computer Science 2025-12-30 Jiawei Liu , Zi Xiong , Yi Jiang , Yongqiang Ma , Wei Lu , Yong Huang , Qikai Cheng

There have been many recent investigations into prompt-based training of transformer language models for new text genres in low-resource settings. The prompt-based training approach has been found to be effective in generalizing pre-trained…

Computation and Language · Computer Science 2023-06-13 Jennifer D'Souza , Moussab Hrou , Sören Auer

Federated Prompt Tuning (FPT) is an efficient method for cross-client collaborative fine-tuning of large Vision-Language Models (VLMs). However, models tuned using FPT are vulnerable to adversarial attacks, leading to misclassification in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Kun Zhai , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

Graph-structured data underpins applications from citation analysis and social-network modeling to molecular design and knowledge-graph construction, and Large Language Models (LLMs) are increasingly used as prompt-driven graph…

Social and Information Networks · Computer Science 2026-05-20 Zihe Wei , Sheng Xiang , Ying Zhang , Changjun Jiang

LLMs have become increasingly capable at accomplishing a range of specialized-tasks and can be utilized to expand equitable access to medical knowledge. Most medical LLMs have involved extensive fine-tuning, leveraging specialized medical…