English
Related papers

Related papers: ICE-SEARCH: A Language Model-Driven Feature Select…

200 papers

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Xingyu Wu , Sheng-hao Wu , Jibin Wu , Liang Feng , Kay Chen Tan

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

Machine Learning · Computer Science 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

Large Language Models (LLMs) offer a promising avenue for scientific discovery, yet their application to symbolic regression is often constrained by inefficient search strategies and coarse feedback signals. Current methods typically guide…

Machine Learning · Computer Science 2026-05-29 Evgeny S. Saveliev , Samuel Holt , Nabeel Seedat , David L. Bentley , Jim Weatherall , Mihaela van der Schaar

We propose In-Context Clustering (ICC), a flexible LLM-based procedure for clustering data from diverse distributions. Unlike traditional clustering algorithms constrained by predefined similarity measures, ICC flexibly captures complex…

Machine Learning · Computer Science 2025-10-10 Ying Wang , Mengye Ren , Andrew Gordon Wilson

Machine learning (ML) research has yielded powerful tools for training accurate prediction models despite complex multivariate associations (e.g. interactions and heterogeneity). In fields such as medicine, improved interpretability of ML…

Machine Learning · Computer Science 2021-04-28 Robert Zhang , Rachael Stolzenberg-Solomon , Shannon M. Lynch , Ryan J. Urbanowicz

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

Computation and Language · Computer Science 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

Multi-objective discrete optimization problems, such as molecular design, pose significant challenges due to their vast and unstructured combinatorial spaces. Traditional evolutionary algorithms often get trapped in local optima, while…

Machine Learning · Computer Science 2025-10-09 Nian Ran , Zhongzheng Li , Yue Wang , Qingsong Ran , Xiaoyuan Zhang , Shikun Feng , Richard Allmendinger , Xiaoguang Zhao

Automated algorithm discovery in scientific computing faces fundamental challenges: vast design spaces with expensive evaluations, domain-specific physical constraints requiring expert knowledge, and the necessity for interpretable…

Artificial Intelligence · Computer Science 2025-11-18 He Wang , Liang Zeng

With the increasing number of samples, the manual clustering of COVID-19 and medical disease data samples becomes time-consuming and requires highly skilled labour. Recently, several algorithms have been used for clustering medical datasets…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Bryar A. Hassan , Tarik A. Rashid , Hozan K. Hamarashid

Optimization algorithms are widely employed to tackle complex problems, but designing them manually is often labor-intensive and requires significant expertise. Global placement is a fundamental step in electronic design automation (EDA).…

Neural and Evolutionary Computing · Computer Science 2025-04-28 Xufeng Yao , Jiaxi Jiang , Yuxuan Zhao , Peiyu Liao , Yibo Lin , Bei Yu

Click-Through Rate (CTR) prediction holds a paramount position in recommender systems. The prevailing ID-based paradigm underperforms in cold-start scenarios due to the skewed distribution of feature frequency. Additionally, the utilization…

Information Retrieval · Computer Science 2024-11-28 Xingmei Wang , Weiwen Liu , Xiaolong Chen , Qi Liu , Xu Huang , Yichao Wang , Xiangyang Li , Yasheng Wang , Zhenhua Dong , Defu Lian , Ruiming Tang

Large Language Models (LLMs) have demonstrated remarkable improvements in reasoning and planning through increased test-time compute, often by framing problem-solving as a search process. While methods like Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-06-06 Nathan Herr , Tim Rocktäschel , Roberta Raileanu

Evolutionary computation (EC), as a powerful optimization algorithm, has been applied across various domains. However, as the complexity of problems increases, the limitations of EC have become more apparent. The advent of large language…

Neural and Evolutionary Computing · Computer Science 2024-05-24 Jinyu Cai , Jinglue Xu , Jialong Li , Takuto Ymauchi , Hitoshi Iba , Kenji Tei

Language models (LMs) can perform complex reasoning either end-to-end, with hidden latent state, or compositionally, with transparent intermediate state. Composition offers benefits for interpretability and safety, but may need workflow…

Computation and Language · Computer Science 2023-01-06 Justin Reppert , Ben Rachbach , Charlie George , Luke Stebbing , Jungwon Byun , Maggie Appleton , Andreas Stuhlmüller

Instruction tuning has underscored the significant potential of large language models (LLMs) in producing more human controllable and effective outputs in various domains. In this work, we focus on the data selection problem for…

Machine Learning · Computer Science 2025-09-01 Yang Wu , Huayi Zhang , Yizheng Jiao , Lin Ma , Xiaozhong Liu , Jinhong Yu , Dongyu Zhang , Dezhi Yu , Wei Xu

State of the art Symbolic Regression (SR) methods currently build specialized models, while the application of Large Language Models (LLMs) remains largely unexplored. In this work, we introduce the first comprehensive framework that…

Computation and Language · Computer Science 2024-09-27 Matteo Merler , Katsiaryna Haitsiukevich , Nicola Dainese , Pekka Marttinen

Large Language Models (LLMs) have achieved significant progress across various fields and have exhibited strong potential in evolutionary computation, such as generating new solutions and automating algorithm design. Surrogate-assisted…

Neural and Evolutionary Computing · Computer Science 2024-06-18 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Retrieval-Augmented Large Language Models (LLMs), which integrate external knowledge, have shown remarkable performance in medical domains, including clinical diagnosis. However, existing RAG methods often struggle to tailor retrieval…

Computation and Language · Computer Science 2025-10-16 Jiawei He , Mingyi Jia , Zhihao Jia , Junwen Duan , Yan Song , Jianxin Wang

The biomedical field relies heavily on concept linking in various areas such as literature mining, graph alignment, information retrieval, question-answering, data, and knowledge integration. Although large language models (LLMs) have made…

Computation and Language · Computer Science 2023-07-04 Qinyong Wang , Zhenxiang Gao , Rong Xu

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao