English
Related papers

Related papers: Generative Pre-Trained Transformers for Biological…

200 papers

Recent advances in Large Language Models (LLMs) have presented new opportunities for integrating Artificial General Intelligence (AGI) into biological research and education. This study evaluated the capabilities of leading LLMs, including…

Computation and Language · Computer Science 2023-11-15 Xinyu Gong , Jason Holmes , Yiwei Li , Zhengliang Liu , Qi Gan , Zihao Wu , Jianli Zhang , Yusong Zou , Yuxi Teng , Tian Jiang , Hongtu Zhu , Wei Liu , Tianming Liu , Yajun Yan

Pre-trained Language Models recently gained traction in the Natural Language Processing (NLP) domain for text summarization, generation and question-answering tasks. This stems from the innovation introduced in Transformer models and their…

Computation and Language · Computer Science 2022-11-01 Kenneth Ezukwoke , Anis Hoayek , Mireille Batton-Hubert , Xavier Boucher , Pascal Gounet , Jerome Adrian

Generative artificial intelligence (AI), and in particular Large Language Models (LLMs), have exploded in popularity and attention since the release to the public of ChatGPT's Generative Pre-trained Transformer (GPT)-3.5 model in November…

Computers and Society · Computer Science 2024-07-25 Daniel Hopp

Biologically Inspired Design (BID), or Biomimicry, is a problem-solving methodology that applies analogies from nature to solve engineering challenges. For example, Speedo engineers designed swimsuits based on shark skin. Finding relevant…

Computation and Language · Computer Science 2023-12-21 Hen Emuna , Nadav Borenstein , Xin Qian , Hyeonsu Kang , Joel Chan , Aniket Kittur , Dafna Shahaf

Generating human language through non-invasive brain-computer interfaces (BCIs) has the potential to unlock many applications, such as serving disabled patients and improving communication. Currently, however, generating language via BCIs…

Computation and Language · Computer Science 2025-11-04 Ziyi Ye , Qingyao Ai , Yiqun Liu , Maarten de Rijke , Min Zhang , Christina Lioma , Tuukka Ruotsalo

We consider small-data, large-scale decision problems in which a firm must make many operational decisions simultaneously (e.g., across a large product portfolio) while observing only a few, potentially noisy, data points per instance.…

Machine Learning · Computer Science 2026-02-04 Zishi Zhang , Jinhui Han , Ming Hu , Yijie Peng

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

Computation and Language · Computer Science 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

With a broad range of emerging applications in 6G networks, wireless traffic prediction has become a critical component of network management. However, the dynamically shifting distribution of wireless traffic in non-stationary 6G networks…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Chengming Hu , Hao Zhou , Di Wu , Xi Chen , Jun Yan , Xue Liu

Generative AI increasingly supports educational design tasks, e.g., through Large Language Models (LLMs), demonstrating the capability to design assessment questions that are aligned with pedagogical frameworks (e.g., Bloom's taxonomy).…

Artificial Intelligence · Computer Science 2026-05-15 Chris Davis Jaldi , Anmol Saini , Shan Zhang , Noah Schroeder , Cogan Shimizu , Eleni Ilkou

In traditional human living environment landscape design, the establishment of three-dimensional models is an essential step for designers to intuitively present the spatial relationships of design elements, as well as a foundation for…

Human-Computer Interaction · Computer Science 2024-04-26 Ran Chen , Zeke Lian , Yueheng He , Xiao Ling , Fuyu Yang , Xueqi Yao , Xingjian Yi , Jing Zhao

Recent advances in Generative Artificial Intelligence, particularly Large Language Models (LLMs), have stimulated growing interest in automating or assisting Business Process Modeling tasks using natural language. Several approaches have…

Software Engineering · Computer Science 2026-04-16 João Bettencourt , Sérgio Guerreiro

As artificial intelligence (AI) continues to evolve from a back-end computational tool into an interactive, generative collaborator, its integration into early-stage design processes demands a rethinking of traditional workflows in…

Human-Computer Interaction · Computer Science 2025-07-25 Zhangqi Liu

Generative models for structure-based molecular design hold significant promise for drug discovery, with the potential to speed up the hit-to-lead development cycle, while improving the quality of drug candidates and reducing costs. Data…

Machine Learning · Statistics 2022-04-25 Lucian Chan , Rajendra Kumar , Marcel Verdonk , Carl Poelking

Robotic assembly tasks remain an open challenge due to their long horizon nature and complex part relations. Behavior trees (BTs) are increasingly used in robot task planning for their modularity and flexibility, but creating them manually…

Robotics · Computer Science 2025-06-19 Jicong Ao , Fan Wu , Yansong Wu , Abdalla Swikir , Sami Haddadin

Decision trees are a crucial class of models offering robust predictive performance and inherent interpretability across various domains, including healthcare, finance, and logistics. However, current tree induction methods often face…

Machine Learning · Computer Science 2025-03-19 Tennison Liu , Nicolas Huynh , Mihaela van der Schaar

Combining large language models with evolutionary computation algorithms represents a promising research direction leveraging the remarkable generative and in-context learning capabilities of LLMs with the strengths of evolutionary…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Tobias Preintner , Weixuan Yuan , Adrian König , Thomas Bäck , Elena Raponi , Niki van Stein

We consider controllable DNA sequence design, where sequences are generated by conditioning on specific biological properties. While language models (LMs) such as GPT and BERT have achieved remarkable success in natural language generation,…

Machine Learning · Computer Science 2025-12-10 Xingyu Su , Xiner Li , Yuchao Lin , Ziqian Xie , Degui Zhi , Shuiwang Ji

Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general…

Computation and Language · Computer Science 2023-04-04 Renqian Luo , Liai Sun , Yingce Xia , Tao Qin , Sheng Zhang , Hoifung Poon , Tie-Yan Liu

Unifying image understanding and generation has gained growing attention in recent research on multimodal models. Although design choices for image understanding have been extensively studied, the optimal model architecture and training…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jiuhai Chen , Zhiyang Xu , Xichen Pan , Yushi Hu , Can Qin , Tom Goldstein , Lifu Huang , Tianyi Zhou , Saining Xie , Silvio Savarese , Le Xue , Caiming Xiong , Ran Xu