English
Related papers

Related papers: Pretrained Language Models for Text Generation: A …

200 papers

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

This work explores expanding the capabilities of large language models (LLMs) pretrained on text to generate 3D meshes within a unified model. This offers key advantages of (1) leveraging spatial knowledge already embedded in LLMs, derived…

Machine Learning · Computer Science 2024-11-15 Zhengyi Wang , Jonathan Lorraine , Yikai Wang , Hang Su , Jun Zhu , Sanja Fidler , Xiaohui Zeng

Large Language Models offer new opportunities to devise automated implementation generation methods that can tackle problem solving activities beyond traditional methods, which require algorithmic specifications and can use only static…

Computation and Language · Computer Science 2025-01-06 Hashmath Shaik , Alex Doboli

Large Language Models (LLMs) have revolutionized the field of Natural Language Generation (NLG) by demonstrating an impressive ability to generate human-like text. However, their widespread usage introduces challenges that necessitate…

Computation and Language · Computer Science 2024-06-28 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

Artificial Intelligence · Computer Science 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

AI is widely thought to be poised to transform business, yet current perceptions of the scope of this transformation may be myopic. Recent progress in natural language processing involving transformer language models (TLMs) offers a…

Computation and Language · Computer Science 2021-10-26 Ross Gruetzemacher , David Paradice

The networking field is characterized by its high complexity and rapid iteration, requiring extensive expertise to accomplish network tasks, ranging from network design, configuration, diagnosis and security. The inherent complexity of…

Networking and Internet Architecture · Computer Science 2024-04-30 Chang Liu , Xiaohui Xie , Xinggong Zhang , Yong Cui

Natural Language Processing (NLP) is an important branch of artificial intelligence that studies how to enable computers to understand, process, and generate human language. Text classification is a fundamental task in NLP, which aims to…

Computation and Language · Computer Science 2024-03-18 Xiaonan Xu , Zheng Xu , Zhipeng Ling , Zhengyu Jin , ShuQian Du

Developers frequently use APIs to implement certain functionalities, such as parsing Excel Files, reading and writing text files line by line, etc. Developers can greatly benefit from automatic API usage sequence generation based on natural…

Software Engineering · Computer Science 2022-04-08 Mohammad Abdul Hadi , Imam Nur Bani Yusuf , Ferdian Thung , Kien Gia Luong , Jiang Lingxiao , Fatemeh H. Fard , David Lo

Building a dialogue system that can communicate naturally with humans is a challenging yet interesting problem of agent-based computing. The rapid growth in this area is usually hindered by the long-standing problem of data scarcity as…

Computation and Language · Computer Science 2021-04-23 Munazza Zaib , Quan Z. Sheng , Wei Emma Zhang

The neural boom that has sparked natural language processing (NLP) research through the last decade has similarly led to significant innovations in data-to-text generation (DTG). This survey offers a consolidated view into the neural DTG…

Computation and Language · Computer Science 2024-04-03 Mandar Sharma , Ajay Gogineni , Naren Ramakrishnan

Generating text from structured data is challenging because it requires bridging the gap between (i) structure and natural language (NL) and (ii) semantically underspecified input and fully specified NL output. Multilingual generation…

Computation and Language · Computer Science 2020-11-12 Angela Fan , Claire Gardent

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely…

Researchers have relegated natural language processing tasks to Transformer-type models, particularly generative models, because these models exhibit high versatility when performing generation and classification tasks. As the size of these…

Computation and Language · Computer Science 2025-04-04 Fabio Yáñez-Romero , Andrés Montoyo , Armando Suárez , Yoan Gutiérrez , Ruslan Mitkov

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

Computation and Language · Computer Science 2024-10-18 Sahar Iravani , Tim . O . F Conrad

As the core component of Natural Language Processing (NLP) system, Language Model (LM) can provide word representation and probability indication of word sequences. Neural Network Language Models (NNLMs) overcome the curse of dimensionality…

Computation and Language · Computer Science 2019-06-14 Kun Jing , Jungang Xu

Large Language Models (LLMs) have revolutionized the domain of natural language processing (NLP) with remarkable capabilities of generating human-like text responses. However, despite these advancements, several works in the existing…

Computation and Language · Computer Science 2023-10-25 Soumya Suvra Ghosal , Souradip Chakraborty , Jonas Geiping , Furong Huang , Dinesh Manocha , Amrit Singh Bedi

Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the…

Computation and Language · Computer Science 2023-03-15 Yuansong Zhu , Yu Zhao

Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. This advancement has resulted in more fluent, coherent and even properties…

Computation and Language · Computer Science 2022-03-11 Wei Li , Wenhao Wu , Moye Chen , Jiachen Liu , Xinyan Xiao , Hua Wu