English
Related papers

Related papers: Elo-Evolve: A Co-evolutionary Framework for Langua…

200 papers

This paper develops an adaptive observation-based efficient reinforcement learning (RL) approach for systems with uncertain drift dynamics. A novel concurrent learning adaptive extended observer (CL-AEO) is first designed to jointly…

Dynamical Systems · Mathematics 2020-11-25 Maopeng Ran , Lihua Xie

Large language models (LLMs) have shown remarkable capabilities in various natural language understanding tasks. With only a few demonstration examples, these LLMs can quickly adapt to target tasks without expensive gradient updates. Common…

Computation and Language · Computer Science 2023-11-14 Yue Yu , Jiaming Shen , Tianqi Liu , Zhen Qin , Jing Nathan Yan , Jialu Liu , Chao Zhang , Michael Bendersky

Adaptive Large Neighborhood Search (ALNS) is a prominent metaheuristic and a widely adopted approach for production and logistics optimization. However, it has long relied on hand-crafted components built on expert experience, which makes…

Neural and Evolutionary Computing · Computer Science 2026-05-20 Shaohua Yu , Tianyu Chen , Linyan Liu , Jakob Puchinger

The ability of large language models (LLMs) to execute complex instructions is essential for their real-world applications. However, several recent studies indicate that LLMs struggle with challenging instructions. In this paper, we propose…

Machine Learning · Computer Science 2024-10-11 Julian Katz-Samuels , Zheng Li , Hyokun Yun , Priyanka Nigam , Yi Xu , Vaclav Petricek , Bing Yin , Trishul Chilimbi

Post-training techniques combined with inference-time scaling significantly enhance the reasoning and alignment capabilities of large language models (LLMs). However, a fundamental tension arises: inference-time methods benefit from diverse…

Machine Learning · Computer Science 2026-05-12 Changhao Li , Yuchen Zhuang , Chenxiao Gao , Haotian Sun , Rushi Qiang , Chao Zhang , Bo Dai

Adapting pre-trained language models (PLMs) for time-series text classification amidst evolving domain shifts (EDS) is critical for maintaining accuracy in applications like stance detection. This study benchmarks the effectiveness of…

Reward-based alignment methods for large language models (LLMs) face two key limitations: vulnerability to reward hacking, where models exploit flaws in the reward signal; and reliance on brittle, labor-intensive prompt engineering when…

Computation and Language · Computer Science 2025-05-20 Zae Myung Kim , Chanwoo Park , Vipul Raheja , Suin Kim , Dongyeop Kang

Evaluating LLMs' instruction-following ability in multi-topic dialogues is essential yet challenging. Existing benchmarks are limited to a fixed number of turns, susceptible to saturation and failing to account for users' interactive…

Computation and Language · Computer Science 2026-01-09 Qi Jia , Ye Shen , Xiujie Song , Kaiwei Zhang , Shibo Wang , Dun Pei , Xiangyang Zhu , Guangtao Zhai

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

While Reinforcement Learning (RL) has advanced LLM reasoning, applying it to long-context scenarios is hindered by sparsity of outcome rewards. This limitation fails to penalize ungrounded "lucky guesses," leaving the critical process of…

Artificial Intelligence · Computer Science 2026-04-21 Xin Guan , Zijian Li , Shen Huang , Pengjun Xie , Jingren Zhou , Jiuxin Cao

We introduce CodeEvolve, an open-source framework that couples large language models with island-based evolutionary search for end-to-end algorithmic discovery. CodeEvolve integrates inspiration-based crossover, meta-prompting, and…

Artificial Intelligence · Computer Science 2026-05-29 Henrique Assumpção , Diego Ferreira , Leandro Campos , Fabricio Murai

Large language models (LLMs) excel at general question-answering (Q&A) but often fall short in specialized domains due to a lack of domain-specific knowledge. Commercial companies face the dual challenges of privacy protection and resource…

Artificial Intelligence · Computer Science 2024-08-26 Shenglin Zhang , Pengtian Zhu , Minghua Ma , Jiagang Wang , Yongqian Sun , Dongwen Li , Jingyu Wang , Qianying Guo , Xiaolei Hua , Lin Zhu , Dan Pei

Latent-variable energy-based models (LVEBMs) assign a single normalized energy to joint pairs of observed data and latent variables, offering expressive generative modeling while capturing hidden structure. We recast maximum-likelihood…

Machine Learning · Computer Science 2025-10-20 Shiqin Tang , Shuxin Zhuang , Rong Feng , Runsheng Yu , Hongzong Li , Youzhi Zhang

The paradigm shift from item-centric ranking to answer-centric synthesis is redefining the role of search engines. While recent industrial progress has applied generative techniques to closed-set item ranking in e-commerce, research and…

Computation and Language · Computer Science 2026-03-12 Wei Wu , Peilun Zhou , Liyi Chen , Qimeng Wang , Chengqiang Lu , Yan Gao , Yi Wu , Yao Hu , Hui Xiong

Nowadays, Large Language Models (LLMs) have shown exceptional performance in sequential recommendations, and the adoption of LLM-based recommender systems (LLMRec) is becoming increasingly widespread in existing e-commerce platforms.…

Information Retrieval · Computer Science 2025-11-21 Hao Liu , Le Wu , Min Hou , Han Wu , Kun Zhang , Xin Li , Si Wei

Benchmark Design in Black-Box Optimization (BBO) is a fundamental yet open-ended topic. Early BBO benchmarks are predominantly human-crafted, introducing expert bias and constraining diversity. Automating this design process can relieve the…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Chen Wang , Sijie Ma , Zeyuan Ma , Yue-Jiao Gong

We propose Evolutionary Dynamic Loss (EDL), a framework that learns a transferable classification loss in the probability space using unlimited synthetic prediction-label pairs, without accessing real samples during the main loss…

Machine Learning · Computer Science 2026-05-06 Meng Xiang , Yan Pei

In this work, we propose a novel approach for reinforcement learning driven by evolutionary computation. Our algorithm, dubbed as Evolutionary-Driven Reinforcement Learning (evo-RL), embeds the reinforcement learning algorithm in an…

Personalized alignment is essential for enabling large language models (LLMs) to engage effectively in user-centric dialogue. While recent prompt-based and offline optimization methods offer preliminary solutions, they fall short in…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Xingyu Sui , Yulin Hu , Jiahe Guo , Haixiao Liu , Biye Li , Yanyan Zhao , Bing Qin , Ting Liu

Large Language Models (LLMs) are used for Register-Transfer Level (RTL) code generation, but they face two main challenges: functional correctness and Power, Performance, and Area (PPA) optimization. Iterative, feedback-based methods…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Kyungjun Min , Kyumin Cho , Junhwan Jang , Seokhyeong Kang