English
Related papers

Related papers: Large Language Model is Secretly a Protein Sequenc…

200 papers

Autonomous tuning of particle accelerators is an active and challenging field of research with the goal of enabling novel accelerator technologies cutting-edge high-impact applications, such as physics discovery, cancer research and…

Computation and Language · Computer Science 2024-05-16 Jan Kaiser , Annika Eichler , Anne Lauscher

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Hyperparameter optimization is a crucial problem in Evolutionary Computation. In fact, the values of the hyperparameters directly impact the trajectory taken by the optimization process, and their choice requires extensive reasoning by…

Neural and Evolutionary Computing · Computer Science 2024-08-06 Leonardo Lucio Custode , Fabio Caraffini , Anil Yaman , Giovanni Iacca

While Genetic Improvement (GI) is a useful paradigm to improve functional and nonfunctional aspects of software, existing techniques tended to use the same set of mutation operators for differing objectives, due to the difficulty of writing…

Software Engineering · Computer Science 2023-04-20 Sungmin Kang , Shin Yoo

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

Software Engineering · Computer Science 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Directed evolution is an iterative laboratory process of designing proteins with improved function by iteratively synthesizing new protein variants and evaluating their desired property with expensive and time-consuming biochemical…

Machine Learning · Computer Science 2025-09-08 Matouš Soldát , Jiří Kléma

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine…

Machine Learning · Computer Science 2025-05-02 Yayati Jadhav , Amir Barati Farimani

The recent development of Large Language Models (LLMs) has been accompanied by an effervescence of novel ideas and methods to better optimize the loss of deep learning models. Claims from those methods are myriad: from faster convergence to…

Machine Learning · Computer Science 2025-09-03 Andrei Semenov , Matteo Pagliardini , Martin Jaggi

At the intersection of the rapidly growing biological data landscape and advancements in Natural Language Processing (NLP), protein language models (PLMs) have emerged as a transformative force in modern research. These models have achieved…

Biomolecules · Quantitative Biology 2025-02-12 Lei Wang , Xudong Li , Han Zhang , Jinyi Wang , Dingkang Jiang , Zhidong Xue , Yan Wang

Large Language Models (LLMs) have demonstrated impressive capabilities across numerous fields, presenting an opportunity to revolutionize optimization problem-solving, a crucial, ubiquitous, and complex domain. This paper explores the…

Computation and Language · Computer Science 2025-02-05 Soheil Abbasloo

Optimization is ubiquitous. While derivative-based algorithms have been powerful tools for various problems, the absence of gradient imposes challenges on many real-world applications. In this work, we propose Optimization by PROmpting…

Machine Learning · Computer Science 2024-04-16 Chengrun Yang , Xuezhi Wang , Yifeng Lu , Hanxiao Liu , Quoc V. Le , Denny Zhou , Xinyun Chen

The 21st century is presenting humankind with unprecedented environmental and medical challenges. The ability to design novel proteins tailored for specific purposes could transform our ability to respond timely to these issues. Recent…

Biomolecules · Quantitative Biology 2022-08-24 Noelia Ferruz , Birte Höcker

Automated planning is concerned with developing efficient algorithms to generate plans or sequences of actions to achieve a specific goal in a given environment. Emerging Large Language Models (LLMs) can answer questions, write high-quality…

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

Information Retrieval · Computer Science 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

Rule-based adaptation is a foundational approach to self-adaptation, characterized by its human readability and rapid response. However, building high-performance and robust adaptation rules is often a challenge because it essentially…

Computation and Language · Computer Science 2024-07-03 Yusei Ishimizu , Jialong Li , Jinglue Xu , Jinyu Cai , Hitoshi Iba , Kenji Tei

Protein language models (PLMs) have shown promise in improving the understanding of protein sequences, contributing to advances in areas such as function prediction and protein engineering. However, training these models from scratch…

Machine Learning · Computer Science 2024-12-19 Shivasankaran Vanaja Pandi , Bharath Ramsundar

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard

Recent advances in large language models (LLMs) have sparked growing interest in integrating language-driven techniques into trajectory prediction. By leveraging their semantic and reasoning capabilities, LLMs are reshaping how autonomous…

Computation and Language · Computer Science 2025-10-08 Yi Xu , Ruining Yang , Yitian Zhang , Jianglin Lu , Mingyuan Zhang , Yizhou Wang , Lili Su , Yun Fu