English
Related papers

Related papers: Compact Prompting in Instruction-tuned LLMs for Jo…

200 papers

Aligning Large Language Models (LLMs) is crucial for enhancing their safety and utility. However, existing methods, primarily based on preference datasets, face challenges such as noisy labels, high annotation costs, and privacy concerns.…

Machine Learning · Computer Science 2025-01-28 Hao Sun , Mihaela van der Schaar

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Argument mining (AM) is the process of automatically extracting arguments, their components and/or relations amongst arguments and components from text. As the number of platforms supporting online debate increases, the need for AM becomes…

Computation and Language · Computer Science 2024-02-20 Deniz Gorur , Antonio Rago , Francesca Toni

The auditory system plays a substantial role in shaping the overall human perceptual experience. While prevailing large language models (LLMs) and visual language models (VLMs) have shown their promise in solving a wide variety of language…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Jinhua Liang , Xubo Liu , Wenwu Wang , Mark D. Plumbley , Huy Phan , Emmanouil Benetos

Large language models~(LLMs) exhibit exceptional performance in language tasks, yet their auto-regressive inference is limited due to high computational requirements and is sub-optimal due to the exposure bias. Inspired by speculative…

Computation and Language · Computer Science 2024-03-14 Hongyi Yuan , Keming Lu , Fei Huang , Zheng Yuan , Chang Zhou

Derivative-free prompt learning has emerged as a lightweight alternative to prompt tuning, which only requires model inference to optimize the prompts. However, existing work did not take full advantage of the over-parameterized…

Computation and Language · Computer Science 2022-10-24 Yekun Chai , Shuohuan Wang , Yu Sun , Hao Tian , Hua Wu , Haifeng Wang

Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is…

Computation and Language · Computer Science 2024-12-25 Shuzhang Cai , Twumasi Mensah-Boateng , Xander Kuksov , Jing Yuan , Shaojie Tang

Prompt-based fine-tuning has become an essential method for eliciting information encoded in pre-trained language models for a variety of tasks, including text classification. For multi-class classification tasks, prompt-based fine-tuning…

Computation and Language · Computer Science 2024-10-04 Zhiwen You , Kanyao Han , Haotian Zhu , Bertram Ludäscher , Jana Diesner

Argument Mining (AM) involves identifying and extracting Argumentative Components (ACs) and their corresponding Argumentative Relations (ARs). Most of the prior works have broken down these tasks into multiple sub-tasks. Existing end-to-end…

Computation and Language · Computer Science 2025-10-21 Nilmadhab Das , Vishal Choudhary , V. Vijaya Saradhi , Ashish Anand

Large Language Models (LLMs) are increasingly vulnerable to adversarial prompts that exploit semantic ambiguities to bypass safety mechanisms, resulting in harmful or inappropriate outputs. Such attacks, including jailbreaking and prompt…

Cryptography and Security · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang

Large Language Models have advanced clinical text classification, but their opaque predictions remain a critical barrier to practical adoption in research and clinical settings where investigators and physicians need to understand which…

Computation and Language · Computer Science 2025-11-18 Karthikeyan K , Raghuveer Thirukovalluru , David Carlson

The safety alignment of Large Language Models (LLMs) is vulnerable to both manual and automated jailbreak attacks, which adversarially trigger LLMs to output harmful content. However, current methods for jailbreaking LLMs, which nest entire…

Cryptography and Security · Computer Science 2024-11-13 Xirui Li , Ruochen Wang , Minhao Cheng , Tianyi Zhou , Cho-Jui Hsieh

Handling and digesting a huge amount of information in an efficient manner has been a long-term demand in modern society. Some solutions to map key points (short textual summaries capturing essential information and filtering redundancies)…

Computation and Language · Computer Science 2022-11-29 Ahnaf Mozib Samin , Behrooz Nikandish , Jingyan Chen

Transforming a dynamic hypothesis into a causal loop diagram (CLD) is crucial for System Dynamics Modelling. Extracting key variables and causal relationships from text to build a CLD is often challenging and time-consuming for novice…

Machine Learning · Computer Science 2025-03-31 Ning-Yuan Georgia Liu , David R. Keith

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Large language models (LLMs) offer significant potential to accelerate systematic literature reviews (SLRs), yet current approaches often rely on brittle, manually crafted prompts that compromise reliability and reproducibility. This…

Computation and Language · Computer Science 2025-09-03 Teo Susnjak

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

Computation and Language · Computer Science 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

Current RAG retrievers are designed primarily for human readers, emphasizing complete, readable, and coherent paragraphs. However, Large Language Models (LLMs) benefit more from precise, compact, and well-structured input, which enhances…

Computation and Language · Computer Science 2026-01-28 Qianchi Zhang , Hainan Zhang , Liang Pang , Yongxin Tong , Hongwei Zheng , Zhiming Zheng

Large Language Models (LLMs), particularly smaller variants, still struggle with complex reasoning tasks. While inference-time prompting can guide reasoning, existing methods often rely on sequential queries. Ensemble approaches offer a…

Computation and Language · Computer Science 2025-10-28 Gregory Kang Ruey Lau , Wenyang Hu , Diwen Liu , Jizhuo Chen , See-Kiong Ng , Bryan Kian Hsiang Low

Recently, Multimodal Large Language Models (MLLMs) have achieved significant success across multiple disciplines due to their exceptional instruction-following capabilities and extensive world knowledge. However, whether these MLLMs possess…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yian Li , Wentao Tian , Yang Jiao , Jingjing Chen , Tianwen Qian , Bin Zhu , Na Zhao , Yu-Gang Jiang