中文
相关论文

相关论文: Generative Pre-Trained Transformer for Design Conc…

200 篇论文

Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase…

计算与语言 · 计算机科学 2023-11-28 Haotian Luo , Yixin Liu , Peidong Liu , Xianggen Liu

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

人机交互 · 计算机科学 2024-09-04 Aron E. Owen , Jonathan C. Roberts

Design inspiration is crucial for establishing the direction of a design as well as evoking feelings and conveying meanings during the conceptual design process. Many practice designers use text-based searches on platforms like Pinterest to…

人机交互 · 计算机科学 2024-07-18 Ye Wang , Nicole B. Damen , Thomas Gale , Voho Seo , Hooman Shayani

We explore the application of transformer-based language models to automated theorem proving. This work is motivated by the possibility that a major limitation of automated theorem provers compared to humans -- the generation of original…

机器学习 · 计算机科学 2020-09-09 Stanislas Polu , Ilya Sutskever

The advancement of the Natural Language Processing field has enabled the development of language models with a great capacity for generating text. In recent years, Neuroscience has been using these models to better understand cognitive…

神经元与认知 · 定量生物学 2024-10-01 Bruno Bianchi , Alfredo Umfurer , Juan Esteban Kamienkowski

Generative Pre-trained Transformer 4 (GPT-4) is the fourth-generation language model in the GPT series, developed by OpenAI, which promises significant advancements in the field of natural language processing (NLP). In this research…

计算与语言 · 计算机科学 2023-05-08 Jawid Ahmad Baktash , Mursal Dawodi

This work presents a generative pre-trained transformer (GPT) designed for modeling financial time series. The GPT functions as an order generation engine within a discrete event simulator, enabling realistic replication of limit order book…

交易与市场微观结构 · 定量金融 2024-11-26 Aaron Wheeler , Jeffrey D. Varner

The virtuosity of language models like GPT-3 opens a new world of possibility for human-AI collaboration in writing. In this paper, we present a framework in which generative language models are conceptualized as multiverse generators. This…

人机交互 · 计算机科学 2021-02-16 Laria Reynolds , Kyle McDonell

Concept generation is a creative step in the conceptual design phase, where designers often turn to brainstorming, mindmapping, or crowdsourcing design ideas to complement their own knowledge of the domain. Recent advances in natural…

计算与语言 · 计算机科学 2023-06-06 Kevin Ma , Daniele Grandi , Christopher McComb , Kosa Goucher-Lambert

We evaluated the capability of a generative pre-trained transformer (GPT-4) to automatically generate high-quality learning objectives (LOs) in the context of a practically oriented university course on Artificial Intelligence. Discussions…

人工智能 · 计算机科学 2023-07-03 Pragnya Sridhar , Aidan Doyle , Arav Agarwal , Christopher Bogart , Jaromir Savelka , Majd Sakr

Generating responses following a desired style has great potentials to extend applications of open-domain dialogue systems, yet is refrained by lacking of parallel data for training. In this work, we explore the challenging task with…

计算与语言 · 计算机科学 2020-10-07 Ze Yang , Wei Wu , Can Xu , Xinnian Liang , Jiaqi Bai , Liran Wang , Wei Wang , Zhoujun Li

Generative concept representations have three major advantages over discriminative ones: they can represent uncertainty, they support integration of learning and reasoning, and they are good for unsupervised and semi-supervised learning. We…

机器学习 · 计算机科学 2018-11-19 Daniel T. Chang

The quality of artificially generated texts has considerably improved with the advent of transformers. The question of using these models to generate learning data for supervised learning tasks naturally arises. In this article, this…

计算与语言 · 计算机科学 2021-10-26 Vincent Claveau , Antoine Chaffin , Ewa Kijak

This study presents a thorough examination of various Generative Pretrained Transformer (GPT) methodologies in sentiment analysis, specifically in the context of Task 4 on the SemEval 2017 dataset. Three primary strategies are employed: 1)…

计算与语言 · 计算机科学 2023-07-25 Kiana Kheiri , Hamid Karimi

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

机器学习 · 计算机科学 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

One challenge for dialogue agents is to recognize feelings of the conversation partner and respond accordingly. In this work, RoBERTa-GPT2 is proposed for empathetic dialogue generation, where the pre-trained auto-encoding RoBERTa is…

计算与语言 · 计算机科学 2021-09-08 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes

Autoregressive transformers have revolutionized generative models in language processing and shown substantial promise in image and video generation. However, these models face significant challenges when extended to 3D generation tasks due…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Jinzhi Zhang , Feng Xiong , Mu Xu

The mathematical formula is the human language to describe nature and is the essence of scientific research. Finding mathematical formulas from observational data is a major demand of scientific research and a major challenge of artificial…

机器学习 · 计算机科学 2024-04-10 Yanjie Li , Weijun Li , Lina Yu , Min Wu , Jingyi Liu , Wenqiang Li , Meilan Hao , Shu Wei , Yusong Deng

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

Automatic question generation aims at the generation of questions from a context, with the corresponding answers being sub-spans of the given passage. Whereas, most of the methods mostly rely on heuristic rules to generate questions, more…

计算与语言 · 计算机科学 2019-11-07 Tassilo Klein , Moin Nabi