English
Related papers

Related papers: Large Language Models for Zero-Shot Multicultural …

200 papers

Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on complex, knowledge-intensive tasks is limited due to the…

Computation and Language · Computer Science 2024-06-10 Jitai Hao , WeiWei Sun , Xin Xin , Qi Meng , Zhumin Chen , Pengjie Ren , Zhaochun Ren

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Parameter Efficient Fine-Tuning (PEFT) methods have emerged as effective and promising approaches for fine-tuning pre-trained language models. Compared with Full parameter Fine-Tuning (FFT), PEFT achieved comparable task performance with a…

Machine Learning · Computer Science 2025-06-10 Tongzhou Yu , Zhuhao Zhang , Guanghui Zhu , Shen Jiang , Meikang Qiu , Yihua Huang

This paper delves into the pressing need in Parameter-Efficient Fine-Tuning (PEFT) for Large Language Models (LLMs). While LLMs possess remarkable capabilities, their extensive parameter requirements and associated computational demands…

Computation and Language · Computer Science 2023-11-23 Chengyu Wang , Junbing Yan , Wei Zhang , Jun Huang

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these…

Computation and Language · Computer Science 2024-03-26 Yida Mu , Ben P. Wu , William Thorne , Ambrose Robinson , Nikolaos Aletras , Carolina Scarton , Kalina Bontcheva , Xingyi Song

Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raman Dutt , Linus Ericsson , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

Language Models (LMs) such as BERT, have been shown to perform well on the task of identifying Named Entities (NE) in text. A BERT LM is typically used as a classifier to classify individual tokens in the input text, or to classify spans of…

Computation and Language · Computer Science 2024-03-04 Edward Whittaker , Ikuo Kitagishi

Inferring nationality from personal names is a critical capability for equity and bias monitoring, personalization, and a valuable tool in biomedical and sociological research. However, existing name-based nationality classifiers are…

Computation and Language · Computer Science 2026-04-22 Cong Ming , Ruixin Shi , Yifan Hu

Multimodal large language models (MLLMs) have achieved remarkable performance across diverse vision-and-language tasks. However, their potential in face recognition remains underexplored. In particular, the performance of open-source MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hatef Otroshi Shahreza , Sébastien Marcel

Recent advancements in the field of Natural Language Processing, particularly the development of large-scale language models that are pretrained on vast amounts of knowledge, are creating novel opportunities within the realm of Knowledge…

Computation and Language · Computer Science 2023-10-06 Anisa Rula , Jennifer D'Souza

Large Vision-Language Models (LVLMs) have demonstrated impressive performance on vision-language reasoning tasks. However, their potential for zero-shot fine-grained image classification, a challenging task requiring precise differentiation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Md. Atabuzzaman , Andrew Zhang , Chris Thomas

Large language models (LLMs) face the challenges in fine-tuning and deployment due to their high memory demands and computational costs. While parameter-efficient fine-tuning (PEFT) methods aim to reduce the memory usage of the optimizer…

Machine Learning · Computer Science 2023-10-31 Jeonghoon Kim , Jung Hyun Lee , Sungdong Kim , Joonsuk Park , Kang Min Yoo , Se Jung Kwon , Dongsoo Lee

Recent advancements in event-based zero-shot object recognition have demonstrated promising results. However, these methods heavily depend on extensive training and are inherently constrained by the characteristics of CLIP. To the best of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Zongyou Yu , Qiang Qu , Xiaoming Chen , Chen Wang

The detection of hate speech has become increasingly important in combating online hostility and its real-world consequences. Despite recent advancements, there is limited research addressing hate speech detection in Devanagari-scripted…

Computation and Language · Computer Science 2024-12-30 Rushendra Sidibomma , Pransh Patwa , Parth Patwa , Aman Chadha , Vinija Jain , Amitava Das

Named entity recognition (NER) is evolving from a sequence labeling task into a generative paradigm with the rise of large language models (LLMs). We conduct a systematic evaluation of open-source LLMs on both flat and nested NER tasks. We…

Computation and Language · Computer Science 2026-01-27 Qi Zhan , Yile Wang , Hui Huang

Despite the impressive zero-shot capabilities of Vision-Language Models (VLMs), they often struggle in downstream tasks with distribution shifts from the pre-training data. Few-Shot Adaptation (FSA-VLM) has emerged as a key solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 SuBeen Lee , GilHan Park , WonJun Moon , Hyun Seok Seong , Jae-Pil Heo

Tags are pivotal in facilitating the effective distribution of multimedia content in various applications in the contemporary Internet era, such as search engines and recommendation systems. Recently, large language models (LLMs) have…

Information Retrieval · Computer Science 2023-04-07 Chen Li , Yixiao Ge , Jiayong Mao , Dian Li , Ying Shan

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Adapting pretrained large language models (LLMs) to various downstream tasks in tens or hundreds of human languages is computationally expensive. Parameter-efficient fine-tuning (PEFT) significantly reduces the adaptation cost, by tuning…

Computation and Language · Computer Science 2024-08-02 Chu-Cheng Lin , Xinyi Wang , Jonathan H. Clark , Han Lu , Yun Zhu , Chenxi Whitehouse , Hongkun Yu