English
Related papers

Related papers: Same Signal, Opposite Meaning: Direction-Informed …

200 papers

The performance of an optimizer on large-scale deep learning models depends critically on fine-tuning the learning rate, often requiring an extensive grid search over base learning rates, schedules, and other hyperparameters. In this paper,…

Machine Learning · Computer Science 2025-06-11 Ruichen Jiang , Ali Kavis , Aryan Mokhtari

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

Machine Learning · Computer Science 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

Large language models (LLMs) have achieved remarkable progress, with post-training playing a crucial role in enhancing their reasoning capabilities. Among post-training paradigms, supervised fine-tuning (SFT) is widely used: it leverages…

Computation and Language · Computer Science 2026-05-27 Lisong Sun , Li Wang , Chen Zhang , Jinyang Wu , Kui Zhang , Tianhao Peng , Wenjun Wu

Generative Adversarial Imitation Learning (GAIL) trains a generative policy to mimic a demonstrator. It uses on-policy Reinforcement Learning (RL) to optimize a reward signal derived from a GAN-like discriminator. A major drawback of GAIL…

Machine Learning · Computer Science 2024-10-30 Tianjiao Luo , Tim Pearce , Huayu Chen , Jianfei Chen , Jun Zhu

Reward hacking arises when a model improves a proxy reward by exploiting shortcuts rather than solving the intended task. We study this failure mode through the geometry of reinforcement learning updates in language models and argue that…

Machine Learning · Computer Science 2026-05-26 Wenlong Deng , Jiaji Huang , Kaan Ozkara , Yushu Li , Christos Thrampoulidis , Xiaoxiao Li , Youngsuk Park

Test-Time Adaptation (TTA) enables pre-trained models to adjust to distribution shift by learning from unlabeled test-time streams. However, existing methods typically treat these streams as independent samples, overlooking the supervisory…

Machine Learning · Computer Science 2026-01-30 Young Kyung Kim , Oded Schlesinger , Qiangqiang Wu , J. Matías Di Martino , Guillermo Sapiro

The design of high-fidelity quantum gates is difficult because it requires the optimization of two competing effects, namely maximizing gate speed and minimizing leakage out of the qubit subspace. We propose a deep reinforcement learning…

Quantum Physics · Physics 2024-04-26 Emily Wright , Rogério de Sousa

Mainstream LLM research has primarily focused on enhancing their generative capabilities. However, even the most advanced LLMs experience uncertainty in their outputs, often producing varied results on different runs or when faced with…

Computation and Language · Computer Science 2024-07-17 Jihyun Janice Ahn , Ryo Kamoi , Lu Cheng , Rui Zhang , Wenpeng Yin

The use of Reinforcement Learning (RL) agents in practical applications requires the consideration of suboptimal outcomes, depending on the familiarity of the agent with its environment. This is especially important in safety-critical…

Machine Learning · Computer Science 2021-12-07 Frederik Schubert , Theresa Eimer , Bodo Rosenhahn , Marius Lindauer

Self-imitation learning is a Reinforcement Learning (RL) method that encourages actions whose returns were higher than expected, which helps in hard exploration and sparse reward problems. It was shown to improve the performance of…

Machine Learning · Computer Science 2020-12-23 Johan Ferret , Olivier Pietquin , Matthieu Geist

Static analysis is effective for discovering software vulnerabilities but notoriously suffers from incomplete source--sink specifications and excessive false positives (FPs). We present \textsc{AdaTaint}, an LLM-driven taint analysis…

Software Engineering · Computer Science 2025-11-07 Shiyin Lin

Safe reinforcement learning in nonstationary environments requires safety mechanisms that adapt as environmental conditions change. Standard safe reinforcement learning methods often assume fixed constraints or stable environmental…

Machine Learning · Computer Science 2026-05-20 Timofey Tomashevskiy

Lane change decision-making is a complex task due to intricate vehicle-vehicle and vehicle-infrastructure interactions. Existing algorithms for lane-change control often depend on vehicles with a certain level of autonomy (e.g., autonomous…

Systems and Control · Electrical Eng. & Systems 2024-12-09 Ke Sun , Huan Yu

This paper establishes directionality reinforcement learning (DRL) technique to propose the complete decentralized multi-agent reinforcement learning method which can achieve cooperation based on each agent's learning: no communication and…

Multiagent Systems · Computer Science 2021-10-13 Fumito Uwano , Keiki Takadama

In cold-start scenarios, the scarcity of collaborative signals for new items exacerbates the Matthew effect, which undermines platform diversity and remains a persistent challenge in real-world recommender systems. Existing methods…

Information Retrieval · Computer Science 2026-03-25 Hai Zhu , Yantao Yu , Lei Shen , Bing Wang , Xiaoyi Zeng

LLM systems must make control decisions in addition to generating outputs: whether to answer, clarify, retrieve, call tools, repair, or escalate. In many current architectures, these decisions remain implicit within generation, entangling…

Artificial Intelligence · Computer Science 2026-04-02 Wei Sun

We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing conventional fixed-schedule continuation with real-time, state-conditioned parameter decisions. At…

Computational Engineering, Finance, and Science · Computer Science 2026-05-18 Shaoliang Yang , Jun Wang , Yunsheng Wang

Training vision-language models on cognitively-plausible amounts of data requires rethinking how models integrate multimodal information. Within the constraints of the Vision track for the BabyLM Challenge 2025, we propose a lightweight…

Artificial Intelligence · Computer Science 2025-10-10 Bianca-Mihaela Ganescu , Suchir Salhan , Andrew Caines , Paula Buttery

Time-varying fast fading channels present a major challenge in the design of wireless communication systems. Pilot Symbol Assisted Modulation (PSAM) has been introduced to mitigate the effects of fading and allow coherent demodulation. Our…

Information Theory · Computer Science 2016-08-09 Khalid Zeineddine , Hussein Hammoud , Ibrahim Abou-Faycal

Long-tail motion forecasting is a core challenge for autonomous driving, where rare yet safety-critical events-such as abrupt maneuvers and dense multi-agent interactions-dominate real-world risk. Existing approaches struggle in these…

Computational Engineering, Finance, and Science · Computer Science 2025-11-11 Bin Rao , Chengyue Wang , Haicheng Liao , Qianfang Wang , Yanchen Guan , Jiaxun Zhang , Xingcheng Liu , Meixin Zhu , Kanye Ye Wang , Zhenning Li