English
Related papers

Related papers: SyntheT2C: Generating Synthetic Data for Fine-Tuni…

200 papers

Knowledge graphs use nodes, relationships, and properties to represent arbitrarily complex data. When stored in a graph database, the Cypher query language enables efficient modeling and querying of knowledge graphs. However, using Cypher…

Machine Learning · Computer Science 2024-12-16 Makbule Gulcin Ozsoy , Leila Messallem , Jon Besga , Gianandrea Minneci

Graph databases like Neo4j are gaining popularity for handling complex, interconnected data, over traditional relational databases in modeling and querying relationships. While translating natural language into SQL queries is…

Computation and Language · Computer Science 2025-01-27 Aman Tiwari , Shiva Krishna Reddy Malay , Vikas Yadav , Masoud Hashemi , Sathwik Tejaswi Madhusudhan

Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. However, conventional NLI datasets…

Computation and Language · Computer Science 2025-01-29 Deren Lei , Yaxi Li , Siyao Li , Mengya Hu , Rui Xu , Ken Archer , Mingyu Wang , Emily Ching , Alex Deng

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Large Language Models (LLMs) have shown outstanding breakthroughs in code generation. Recent work improves code LLMs by training on synthetic data generated by some powerful LLMs, which can be challenging to scale due to the dependence on a…

Computation and Language · Computer Science 2025-02-11 Yunfan Shao , Linyang Li , Yichuan Ma , Peiji Li , Demin Song , Qinyuan Cheng , Shimin Li , Xiaonan Li , Pengyu Wang , Qipeng Guo , Hang Yan , Xipeng Qiu , Xuanjing Huang , Dahua Lin

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Rising demand for mental health support has increased interest in using Large Language Models (LLMs) for counseling. However, adapting LLMs to this high-risk safety-critical domain is hindered by the scarcity of real-world counseling data…

Computation and Language · Computer Science 2026-04-23 Aishik Mandal , Hiba Arnaout , Clarissa W. Ong , Juliet Bockhorst , Kate Sheehan , Rachael Moldow , Tanmoy Chakraborty , Iryna Gurevych

Document-level knowledge graph (KG) construction faces a fundamental scaling challenge: existing methods either rely on expensive large language models (LLMs), making them economically nonviable for large-scale corpora, or employ smaller…

Recent advancements in large language models (LLMs) have led to the development of highly potent models like OpenAI's ChatGPT. These models have exhibited exceptional performance in a variety of tasks, such as question answering, essay…

Computation and Language · Computer Science 2023-04-12 Ruixiang Tang , Xiaotian Han , Xiaoqian Jiang , Xia Hu

In Machine Translation, Large Language Models (LLMs) have generally underperformed compared to conventional encoder-decoder systems and thus see limited adoption. However, LLMs excel at modeling contextual information, making them a natural…

Computation and Language · Computer Science 2026-03-24 Ireh Kim , Tesia Sker , Chanwoo Kim

Large Language Models (LLMs) have revolutionized the ability to understand and generate text, enabling significant progress in automatic knowledge graph construction from text (Text2KG). Many Text2KG methods, however, rely on iterative LLM…

Computation and Language · Computer Science 2025-12-04 Faezeh Faez , Marzieh S. Tahaei , Yaochen Hu , Ali Pourranjbar , Mahdi Biparva , Mark Coates , Yingxue Zhang

We introduce G2T-LLM, a novel approach for molecule generation that uses graph-to-tree text encoding to transform graph-based molecular structures into a hierarchical text format optimized for large language models (LLMs). This encoding…

Machine Learning · Computer Science 2024-10-04 Zhaoning Yu , Xiangyang Xu , Hongyang Gao

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

Computation and Language · Computer Science 2024-01-09 Jean Kaddour , Qi Liu

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

Synthetic data offers a promising path to train models while preserving data privacy. Differentially private (DP) finetuning of large language models (LLMs) as data generator is effective, but is impractical when computation resources are…

Computation and Language · Computer Science 2025-07-18 Bowen Tan , Zheng Xu , Eric Xing , Zhiting Hu , Shanshan Wu

Large Language Models (LLMs) such as Gemma-2B have shown strong performance in various natural language processing tasks. However, general-purpose models often lack the domain expertise required for cybersecurity applications. This work…

Cryptography and Security · Computer Science 2026-01-13 Vasanth Iyer , Leonardo Bobadilla , S. S. Iyengar

Considering query variance in information retrieval (IR) experiments is beneficial for retrieval effectiveness. Especially ranking ensembles based on different topically related queries retrieve better results than rankings based on a…

Information Retrieval · Computer Science 2024-11-07 Timo Breuer
‹ Prev 1 2 3 10 Next ›