English
Related papers

Related papers: Evaluating the Practical Effectiveness of LLM-Driv…

200 papers

Context: Large language models (LLMs) are observed to have a significant positive impact on various software engineering (SE) activities. With improved accessibility, the adoption of powerful LLMs in industry has surged recently. However,…

Software Engineering · Computer Science 2026-04-30 Krishna Ronanki , Beatriz Cabrero-Daniel , Tomas Herda , Stefan Sitkovich , Jennifer Horkoff , Christian Berger

Despite the success, the process of fine-tuning large-scale PLMs brings prohibitive adaptation costs. In fact, fine-tuning all the parameters of a colossal model and retaining separate instances for different tasks are practically…

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not be optimal and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yulei Qin , Yuncheng Yang , Pengcheng Guo , Gang Li , Hang Shao , Yuchen Shi , Zihan Xu , Yun Gu , Ke Li , Xing Sun

When complex SQL queries suffer slow executions despite query optimization, DBAs typically invoke automated query rewriting tools to recommend ``lean'' equivalents that are conducive to faster execution. The rewritings are usually achieved…

Databases · Computer Science 2025-09-03 Sriram Dharwada , Himanshu Devrani , Jayant Haritsa , Harish Doraiswamy

The advent of Large Language Models (LLMs) provides an opportunity to change the way queries are processed, moving beyond the constraints of conventional SQL-based database systems. However, using an LLM to answer a prediction query is…

Information Retrieval · Computer Science 2024-09-04 Ziyu Li , Wenjie Zhao , Asterios Katsifodimos , Rihan Hai

Instruction tuning is a crucial technique for aligning language models with humans' actual goals in the real world. Extensive research has highlighted the quality of instruction data is essential for the success of this alignment. However,…

Artificial Intelligence · Computer Science 2024-10-15 Chenglin Li , Qianglong Chen , Zhi Li , Feng Tao , Yicheng Li , Hao Chen , Fei Yu , Yin Zhang

Query optimization, which finds the optimized execution plan for a given query, is a complex planning and decision-making problem within the exponentially growing plan space in database management systems (DBMS). Traditional optimizers…

Databases · Computer Science 2025-02-11 Jie Tan , Kangfei Zhao , Rui Li , Jeffrey Xu Yu , Chengzhi Piao , Hong Cheng , Helen Meng , Deli Zhao , Yu Rong

Given a replicated database, a divergent design tunes the indexes in each replica differently in order to specialize it for a specific subset of the workload. This specialization brings significant performance gains compared to the common…

Databases · Computer Science 2013-07-22 Quoc Trung Tran , Ivo Jimenez , Rui Wang , Neoklis Polyzotis , Anastasia Ailamaki

Understanding the semantics of columns in relational tables is an important pre-processing step for indexing data lakes in order to provide rich data search. An approach to establishing such understanding is column type annotation (CTA)…

Computation and Language · Computer Science 2025-03-05 Keti Korini , Christian Bizer

Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable…

Artificial Intelligence · Computer Science 2024-11-12 Yinggang Sun , Ziming Guo , Haining Yu , Chuanyi Liu , Xiang Li , Bingxuan Wang , Xiangzhan Yu , Tiancheng Zhao

Instruction Tuning (IT), the process of training large language models (LLMs) using instruction-response pairs, has emerged as the predominant method for transforming base pre-trained LLMs into open-domain conversational agents. While IT…

Computation and Language · Computer Science 2024-07-16 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Ramaneswaran S , Deepali Aneja , Zeyu Jin , Ramani Duraiswami , Dinesh Manocha

Foundational large language models (LLMs) can be instruction-tuned to perform open-domain question answering, facilitating applications like chat assistants. While such efforts are often carried out in a single language, we empirically…

Computation and Language · Computer Science 2024-02-01 Pinzhen Chen , Shaoxiong Ji , Nikolay Bogoychev , Andrey Kutuzov , Barry Haddow , Kenneth Heafield

LLMs are commonly used in retrieval-augmented applications to execute user instructions based on data from external sources. For example, modern search engines use LLMs to answer queries based on relevant search results; email plugins…

Cryptography and Security · Computer Science 2025-03-07 Sahar Abdelnabi , Aideen Fay , Giovanni Cherubin , Ahmed Salem , Mario Fritz , Andrew Paverd

There have been a flurry of recent proposals on learned benefit estimators for index tuning. Although these learned estimators show promising improvement over what-if query optimizer calls in terms of the accuracy of estimated index…

Databases · Computer Science 2026-01-28 Chenning Wu , Sifan Chen , Wentao Wu , Yinan Jing , Zhenying He , Kai Zhang , X. Sean Wang

Instruction tuning is a standard technique employed to align large language models to end tasks and user preferences after the initial pretraining phase. Recent research indicates the critical role of data engineering in instruction tuning…

Computation and Language · Computer Science 2024-04-17 Wei Liu , Weihao Zeng , Keqing He , Yong Jiang , Junxian He

General-purpose large language models (LLMs) are increasingly deployed in verticals such as telecommunications, where adaptation is hindered by scarce, low-information-density corpora and tight mobile/edge constraints. We propose Data…

Machine Learning · Computer Science 2025-11-11 Zhicheng Zhou , Jing Li , Suming Qiu , Junjie Huang , Linyuan Qiu , Zhijie Sun

Instruction tuning is critical for adapting large language models (LLMs) to downstream tasks, and recent studies have demonstrated that small amounts of human-curated data can outperform larger datasets, challenging traditional data scaling…

Computation and Language · Computer Science 2025-03-07 Jinlong Pang , Jiaheng Wei , Ankit Parag Shah , Zhaowei Zhu , Yaxuan Wang , Chen Qian , Yang Liu , Yujia Bao , Wei Wei

Collecting labeled datasets in finance is challenging due to scarcity of domain experts and higher cost of employing them. While Large Language Models (LLMs) have demonstrated remarkable performance in data annotation tasks on general…

Computation and Language · Computer Science 2024-03-28 Toyin Aguda , Suchetha Siddagangappa , Elena Kochkina , Simerjot Kaur , Dongsheng Wang , Charese Smiley , Sameena Shah

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven