English
Related papers

Related papers: Exploring the Protein Sequence Space with Global G…

200 papers

Researchers have recently started investigating deep neural networks for dialogue applications. In particular, generative sequence-to-sequence (Seq2Seq) models have shown promising results for unstructured tasks, such as word-level dialogue…

Computation and Language · Computer Science 2016-11-21 Iulian Vlad Serban , Ryan Lowe , Laurent Charlin , Joelle Pineau

The rapid advancement of artificial intelligence (AI) has reshaped the field of natural language processing (NLP), with models like OpenAI ChatGPT and DeepSeek AI. Although ChatGPT established a strong foundation for conversational AI,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Simrandeep Singh , Shreya Bansal , Abdulmotaleb El Saddik , Mukesh Saini

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

Computation and Language · Computer Science 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

The introduction of ChatGPT has led to a significant increase in the utilization of Large Language Models (LLMs) for addressing downstream tasks. There's an increasing focus on cost-efficient training and deployment within this context.…

As a primary means of information acquisition, information retrieval (IR) systems, such as search engines, have integrated themselves into our daily lives. These systems also serve as components of dialogue, question-answering, and…

Computation and Language · Computer Science 2025-09-18 Yutao Zhu , Huaying Yuan , Shuting Wang , Jiongnan Liu , Wenhan Liu , Chenlong Deng , Haonan Chen , Zheng Liu , Zhicheng Dou , Ji-Rong Wen

This paper takes an exploratory approach to examine the use of ChatGPT for pattern mining. It proposes an eight-step collaborative process that combines human insight with AI capabilities to extract patterns from known uses. The paper…

Artificial Intelligence · Computer Science 2024-12-24 Michael Weiss

In 2022, with the release of ChatGPT, large-scale language models gained widespread attention. ChatGPT not only surpassed previous models in terms of parameters and the scale of its pretraining corpus but also achieved revolutionary…

Artificial Intelligence · Computer Science 2024-11-13 Yiming Ju , Huanhuan Ma

Generative machine learning models are increasingly being used to design novel proteins for therapeutic and biotechnological applications. However, the current methods mostly focus on the design of proteins with a fixed backbone structure,…

Biomolecules · Quantitative Biology 2025-03-04 Petr Kouba , Joan Planas-Iglesias , Jiri Damborsky , Jiri Sedlar , Stanislav Mazurenko , Josef Sivic

Natural Language Processing is one of the leading application areas in the current resurgence of Artificial Intelligence, spearheaded by Artificial Neural Networks. We show that despite their many successes at performing linguistic tasks,…

Computation and Language · Computer Science 2022-05-17 Csaba Veres

Recent efforts have evaluated large language models (LLMs) in areas such as commonsense reasoning, mathematical reasoning, and code generation. However, to the best of our knowledge, no work has specifically investigated the performance of…

Computation and Language · Computer Science 2024-05-17 Xuanfan Ni , Piji Li

Deep generative models of molecules have grown immensely in popularity, trained on relevant datasets, these models are used to search through chemical space. The downstream utility of generative models for the inverse design of novel…

Machine Learning · Computer Science 2023-05-11 Daniel Flam-Shepherd , Kevin Zhu , Alán Aspuru-Guzik

Computational biology and bioinformatics provide vast data gold-mines from protein sequences, ideal for Language Models taken from NLP. These LMs reach for new prediction frontiers at low inference costs. Here, we trained two…

The rapid development of deep learning techniques, improved computational power, and the availability of vast training data have led to significant advancements in pre-trained models and large language models (LLMs). Pre-trained models…

Software Engineering · Computer Science 2024-04-04 Yuan Huang , Yinan Chen , Xiangping Chen , Junqi Chen , Rui Peng , Zhicao Tang , Jinbo Huang , Furen Xu , Zibin Zheng

ChatGPT is a large language model (LLM) created by OpenAI that has been carefully trained on a large amount of data. It has revolutionized the field of natural language processing (NLP) and has pushed the boundaries of LLM capabilities.…

Computation and Language · Computer Science 2023-07-18 Salman Mohamadi , Ghulam Mujtaba , Ngan Le , Gianfranco Doretto , Donald A. Adjeroh

Generative Large Language Models (LLMs) hold significant promise in healthcare, demonstrating capabilities such as passing medical licensing exams and providing clinical knowledge. However, their current use as information retrieval tools…

Recent advances in protein language models (PLMs) have demonstrated remarkable capabilities in understanding protein sequences. However, the extent to which different model architectures capture antibody-specific biological properties…

Machine Learning · Computer Science 2025-12-11 Mengren , Liu , Yixiang Zhang , Yiming , Zhang

In recent years, Natural Language Processing (NLP) models have achieved phenomenal success in linguistic and semantic tasks like text classification, machine translation, cognitive dialogue systems, information retrieval via Natural…

Computation and Language · Computer Science 2021-05-18 Sushant Singh , Ausif Mahmood

Adeno-associated viral (AAV) vectors are widely used delivery platforms in gene therapy, and the design of improved capsids is key to expanding their therapeutic potential. A central challenge in AAV bioengineering, as in protein design…

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

Latent representation alignment has become a foundational technique for constructing multimodal large language models (MLLM) by mapping embeddings from different modalities into a shared space, often aligned with the embedding space of…

Machine Learning · Computer Science 2025-03-06 Dong Shu , Bingbing Duan , Kai Guo , Kaixiong Zhou , Jiliang Tang , Mengnan Du