English
Related papers

Related papers: GREATERPROMPT: A Unified, Customizable, and High-P…

200 papers

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignment between the pre-trained knowledge in LLMs and the actual…

Computation and Language · Computer Science 2023-10-27 Siqi Ouyang , Lei Li

With the capabilities of understanding and executing natural language instructions, Large language models (LLMs) can potentially act as a powerful tool for textual data augmentation. However, the quality of augmented data depends heavily on…

Computation and Language · Computer Science 2024-04-30 Yichuan Li , Kaize Ding , Jianling Wang , Kyumin Lee

Large Language Models (LLMs) have become integral to a wide spectrum of applications, ranging from traditional computing tasks to advanced artificial intelligence (AI) applications. This widespread adoption has spurred extensive research…

Computation and Language · Computer Science 2024-05-14 Xu Wang , Cheng Li , Yi Chang , Jindong Wang , Yuan Wu

Traditional methods for evaluating the robustness of large language models (LLMs) often rely on standardized benchmarks, which can escalate costs and limit evaluations across varied domains. This paper introduces a novel framework designed…

Computation and Language · Computer Science 2024-12-03 Aihua Pei , Zehua Yang , Shunan Zhu , Ruoxi Cheng , Ju Jia

Prompt optimization algorithms for Large Language Models (LLMs) excel in multi-step reasoning but still lack effective uncertainty estimation. This paper introduces a benchmark dataset to evaluate uncertainty metrics, focusing on Answer,…

Machine Learning · Computer Science 2024-12-30 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot…

Computation and Language · Computer Science 2024-02-29 Haoxiang Guan , Jiyan He , Shuxin Zheng , En-Hong Chen , Weiming Zhang , Nenghai Yu

Optimization problems seek to find the best solution to an objective under a set of constraints, and have been widely investigated in real-world applications. Modeling and solving optimization problems in a specific domain typically require…

Optimization and Control · Mathematics 2024-07-12 Jihai Zhang , Wei Wang , Siyan Guo , Li Wang , Fangquan Lin , Cheng Yang , Wotao Yin

In the realm of Large Language Models (LLMs), prompt optimization is crucial for model performance. Although previous research has explored aspects like rephrasing prompt contexts, using various prompting techniques (like in-context…

Computation and Language · Computer Science 2024-11-19 Jia He , Mukund Rungta , David Koleczek , Arshdeep Sekhon , Franklin X Wang , Sadid Hasan

Schema matching is the process of identifying correspondences between the elements of two given schemata, essential for database management systems, data integration, and data warehousing. For datasets across different scenarios, the…

Databases · Computer Science 2025-03-07 Longyu Feng , Huahang Li , Chen Jason Zhang

While integrating external tools into large language models (LLMs) enhances their ability to access real-time information and domain-specific services, existing approaches focus narrowly on functional tool selection following user…

Computation and Language · Computer Science 2025-05-23 Zihao Cheng , Hongru Wang , Zeming Liu , Yuhang Guo , Yuanfang Guo , Yunhong Wang , Haifeng Wang

LLMs have demonstrated commendable performance across diverse domains. Nevertheless, formulating high-quality prompts to assist them in their work poses a challenge for non-AI experts. Existing research in prompt engineering suggests…

Computation and Language · Computer Science 2024-09-23 Ming Wang , Yuanzhong Liu , Xiaoyu Liang , Yijie Huang , Daling Wang , Xiaocui Yang , Sijia Shen , Shi Feng , Xiaoming Zhang , Chaofeng Guan , Yifei Zhang

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

Software Engineering · Computer Science 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

Large Language Models (LLMs) have shown remarkable success, and their multimodal expansions (MLLMs) further unlock capabilities spanning images, videos, and other modalities beyond text. However, despite this shift, prompt optimization…

Machine Learning · Computer Science 2026-02-20 Yumin Choi , Dongki Kim , Jinheon Baek , Sung Ju Hwang

In large-scale industrial LLM systems, prompt templates often expand to thousands of tokens as teams iteratively incorporate sections such as task instructions, few-shot examples, and heuristic rules to enhance robustness and coverage. This…

Computation and Language · Computer Science 2025-10-09 Zhentao Xu , Fengyi Li , Albert Chen , Xiaofeng Wang

This research focuses on how Large Language Models (LLMs) can help with (path) planning for mobile embodied agents such as robots, in a human-in-the-loop and interactive manner. A novel framework named LLM A*, aims to leverage the…

Robotics · Computer Science 2025-05-16 Hengjia Xiao , Peng Wang , Mingzhe Yu , Mattia Robbiani

While model serving has unlocked unprecedented capabilities, the high cost of serving large-scale models continues to be a significant barrier to widespread accessibility and rapid innovation. Compiler optimizations have long driven…

Machine Learning · Computer Science 2026-02-05 Annabelle Sujun Tang , Christopher Priebe , Rohan Mahapatra , Lianhui Qin , Hadi Esmaeilzadeh

Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive…

Human-Computer Interaction · Computer Science 2024-02-12 Ben Wang , Jiqun Liu , Jamshed Karimnazarov , Nicolas Thompson

Linking (aligning) biomedical concepts across diverse data sources enables various integrative analyses, but it is challenging due to the discrepancies in concept naming conventions. Various strategies have been developed to overcome this…

Information Retrieval · Computer Science 2024-05-14 Yuzhang Xie , Jiaying Lu , Joyce Ho , Fadi Nahab , Xiao Hu , Carl Yang