中文
相关论文

相关论文: Automatic Prompt Engineering with No Task Cues and…

200 篇论文

Deep neural network models have helped named entity (NE) recognition achieve amazing performance without handcrafting features. However, existing systems require large amounts of human annotated training data. Efforts have been made to…

信息检索 · 计算机科学 2020-10-06 Ying Luo , Hai Zhao , Junlang Zhan

Large Language Models (LLMs) can perform various natural language processing tasks with suitable instruction prompts. However, designing effective prompts manually is challenging and time-consuming. Existing methods for automatic prompt…

计算与语言 · 计算机科学 2024-04-04 Viet-Tung Do , Van-Khanh Hoang , Duy-Hung Nguyen , Shahab Sabahi , Jeff Yang , Hajime Hotta , Minh-Tien Nguyen , Hung Le

Large language models can perform new tasks in a zero-shot fashion, given natural language prompts that specify the desired behavior. Such prompts are typically hand engineered, but can also be learned with gradient-based methods from…

计算与语言 · 计算机科学 2022-12-21 Weijia Shi , Xiaochuang Han , Hila Gonen , Ari Holtzman , Yulia Tsvetkov , Luke Zettlemoyer

Prompt Engineering (PE) has emerged as a critical technique for guiding Large Language Models (LLMs) in solving intricate tasks. Its importance is highlighted by its potential to significantly enhance the efficiency and effectiveness of…

机器学习 · 计算机科学 2023-11-06 Yifan Luo , Yiming Tang , Chengfeng Shen , Zhennan Zhou , Bin Dong

Enterprise relational databases increasingly contain vast amounts of non-semantic data - IP addresses, product identifiers, encoded keys, and timestamps - that challenge traditional semantic analysis. This paper introduces a novel…

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms…

计算与语言 · 计算机科学 2025-07-28 Rithesh Murthy , Ming Zhu , Liangwei Yang , Jielin Qiu , Juntao Tan , Shelby Heinecke , Caiming Xiong , Silvio Savarese , Huan Wang

AI-Integrated programming is emerging as a foundational paradigm for building intelligent systems with large language models (LLMs). Recent approaches such as Meaning Typed Programming (MTP) automate prompt generation by leveraging the…

Contrastively trained text-image models have the remarkable ability to perform zero-shot classification, that is, classifying previously unseen images into categories that the model has never been explicitly trained to identify. However,…

Task-free online continual learning has recently emerged as a realistic paradigm for addressing continual learning in dynamic, real-world environments, where data arrive in a non-stationary stream without clear task boundaries and can only…

机器学习 · 计算机科学 2026-04-07 Seoyoung Park , Haemin Lee , Hankook Lee

One of the biggest bottlenecks in building accurate, high coverage neural open IE systems is the need for large labelled corpora. The diversity of open domain corpora and the variety of natural language expressions further exacerbate this…

计算与语言 · 计算机科学 2021-03-08 Jialong Tang , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Xinyan Xiao , Hua Wu

Masked language models like BERT can perform text classification in a zero-shot fashion by reformulating downstream tasks as text infilling. However, this approach is highly sensitive to the template used to prompt the model, yet…

计算与语言 · 计算机科学 2022-10-27 Mozes van de Kar , Mengzhou Xia , Danqi Chen , Mikel Artetxe

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

软件工程 · 计算机科学 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

A growing variety of prompt engineering techniques has been proposed for Large Language Models (LLMs), yet systematic evaluation of each technique on individual software engineering (SE) tasks remains underexplored. In this study, we…

Prompt learning is a new paradigm for utilizing pre-trained language models and has achieved great success in many tasks. To adopt prompt learning in the NER task, two kinds of methods have been explored from a pair of symmetric…

计算与语言 · 计算机科学 2023-05-29 Yongliang Shen , Zeqi Tan , Shuhui Wu , Wenqi Zhang , Rongsheng Zhang , Yadong Xi , Weiming Lu , Yueting Zhuang

Prompt design and engineering has rapidly become essential for maximizing the potential of large language models. In this paper, we introduce core concepts, advanced techniques like Chain-of-Thought and Reflection, and the principles behind…

软件工程 · 计算机科学 2024-05-07 Xavier Amatriain

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

计算与语言 · 计算机科学 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

Automated feature engineering plays a critical role in improving predictive model performance for tabular learning tasks. Traditional automated feature engineering methods are limited by their reliance on pre-defined transformations within…

机器学习 · 计算机科学 2026-05-12 Nikhil Abhyankar , Parshin Shojaee , Chandan K. Reddy

Recent advances in Large Language Models (LLMs) have shown promise in automating discourse annotation for conversations. While manually designing tree annotation schemes significantly improves annotation quality for humans and models, their…

计算与语言 · 计算机科学 2025-06-04 Kseniia Petukhova , Ekaterina Kochmar

Interpretability and explainability of neural networks is continuously increasing in importance, especially within safety-critical domains and to provide the social right to explanation. Concept based explanations align well with how humans…

机器学习 · 计算机科学 2023-09-11 Rishabh Jain

Developing effective prompts demands significant cognitive investment to generate reliable, high-quality responses from Large Language Models (LLMs). By deploying case-specific prompt engineering techniques that streamline frequently…

计算与语言 · 计算机科学 2026-04-30 Valentin Romanov , Steven A Niederer