English
Related papers

Related papers: Trend-Based SAC Beam Control Method with Zero-Shot…

200 papers

This paper develops an accurate force control algorithm for series elastic actuators (SEAs) based on a novel force estimation scheme, called transmission force observer (TFOB). The proposed method is designed to improve an inferior force…

Robotics · Computer Science 2019-02-15 Chan Lee , Jinoh Lee , Sehoon Oh

Biaxial motion control systems are used extensively in manufacturing and printing industries. To improve throughput and reduce machine cost, lightweight materials are being proposed in structural components but may result in higher…

Systems and Control · Electrical Eng. & Systems 2024-04-09 Meng Yuan , Ye Wang , Chris Manzie , Zhezhuang Xu , Tianyou Chai

This study focuses on implementing a real-time control system for a particle accelerator facility that performs high energy physics experiments. A critical operating parameter in this facility is beam loss, which is the fraction of…

In this paper, we consider the problem of minimum-time optimal control for a dynamical system with initial state uncertainties and propose a sequential convex programming (SCP) solution framework. We seek to minimize the expected terminal…

Optimization and Control · Mathematics 2024-09-17 Kazuya Echigo , Abhishek Cauligi , Behçet Açıkmeşe

Active reconfigurable intelligent surfaces (RISs) can improve the performance of integrated sensing and communication (ISAC), and therefore enable simultaneous data transmission and target sensing. However, when the line-of-sight (LoS) link…

Signal Processing · Electrical Eng. & Systems 2024-10-17 Ahmed Magbool , Vaibhav Kumar , Mark F. Flanagan

We present temporally abstract actor-critic (TAAC), a simple but effective off-policy RL algorithm that incorporates closed-loop temporal abstraction into the actor-critic framework. TAAC adds a second-stage binary policy to choose between…

Machine Learning · Computer Science 2021-10-13 Haonan Yu , Wei Xu , Haichao Zhang

As terminal agents scale to long-horizon, multi-turn workflows, a key bottleneck is not merely limited context length, but the accumulation of noisy terminal observations in the interaction history. Retaining raw observations preserves…

Computation and Language · Computer Science 2026-05-18 Jincheng Ren , Siwei Wu , Yizhi Li , Kang Zhu , Shu Xu , Boyu Feng , Ruibin Yuan , Wei Zhang , Riza Batista-Navarro , Jian Yang , Chenghua Lin

Cryo Focused Ion-Beam Scanning Electron Microscopy (cryo FIB-SEM) enables three-dimensional and nanoscale imaging of biological specimens via a slice and view mechanism. The FIB-SEM experiments are, however, limited by a slow (typically,…

Using communications signals for dynamic target sensing is an important component of integrated sensing and communications (ISAC). In this paper, we propose to utilize the beam squint effect to realize fast non-cooperative dynamic target…

Signal Processing · Electrical Eng. & Systems 2024-02-07 Hongliang Luo , Feifei Gao , Hai Lin , Shaodan Ma , H. Vincent Poor

A novel balanced air-biased coherent detection scheme for capturing ultrabroadband terahertz (THz) waveforms is implemented. The balanced detection scheme allows for coherent detection at the full repetition rate of the laser system without…

Event cameras are increasingly popular in robotics due to beneficial features such as low latency, energy efficiency, and high dynamic range. Nevertheless, their downstream task performance is greatly influenced by the optimization of bias…

Robotics · Computer Science 2024-08-14 Gokul B. Nair , Michael Milford , Tobias Fischer

We present a new asynchronous quasi-delay-insensitive (QDI) block carry lookahead adder with redundancy carry (BCLARC) realized using delay-insensitive dual-rail data encoding and 4-phase return-to-zero (RTZ) and 4-phase return-to-one (RTO)…

Hardware Architecture · Computer Science 2019-03-25 P. Balasubramanian , D. L. Maskell , N. E. Mastorakis

Soft Actor-Critic (SAC) is considered the state-of-the-art algorithm in continuous action space settings. It uses the maximum entropy framework for efficiency and stability, and applies a heuristic temperature Lagrange term to tune the…

Machine Learning · Computer Science 2021-12-07 Yaosheng Xu , Dailin Hu , Litian Liang , Stephen McAleer , Pieter Abbeel , Roy Fox

We report results of the beam commissioning and first operation of the 1.3 GHz superconducting RF electron linear accelerator at Fermilab Accelerator Science and Technology (FAST) facility. Construction of the linac was completed and the…

Fluid-driven elastomeric actuators (FEAs) are among the most popular actuators in the emerging field of soft robotics. Intrinsically compliant, with continuum of motion, large strokes, little friction, and high power-to-weight ratio, they…

Applied Physics · Physics 2018-10-16 Bratislav Svetozarevic , Moritz Begle , Stefan Caranovic , Zoltan Nagy , Arno Schlueter

While Cram\'er-Rao lower bound is an important metric in sensing functions in integrated sensing and communications (ISAC) designs, its optimization usually involves a computationally expensive solution such as semidefinite relaxation. In…

Information Theory · Computer Science 2025-02-06 Tianyu Fang , Nhan Thanh Nguyen , Markku Juntti

Next generation wireless networks will exploit the large amount of spectrum available at millimeter wave (mmWave) frequencies. Design of mmWave systems, however, is challenging due to strict power, cost and hardware constraints at higher…

Information Theory · Computer Science 2019-01-30 Nitin Jonathan Myers , Amine Mezghani , Robert W. Heath

Connectionist Temporal Classification (CTC) model is a very efficient method for modeling sequences, especially for speech data. In order to use CTC model as an Automatic Speech Recognition (ASR) task, the beam search decoding with an…

Computation and Language · Computer Science 2023-06-28 Minkyu Jung , Ohhyeok Kwon , Seunghyun Seo , Soonshin Seo

Control Barrier Functions (CBFs) have emerged as a prominent approach to designing safe navigation systems of robots. Despite their popularity, current CBF-based methods exhibit some limitations: optimization-based safe control techniques…

Robotics · Computer Science 2026-03-17 Junjun Xie , Shuhao Zhao , Liang Hu , Huijun Gao

By using variational Monte Carlo and auxiliary-field quantum Monte Carlo methods, we perform an accurate finite-size scaling of the $s$-wave superconducting order parameter and the pairing correlations for the negative-$U$ Hubbard model at…

Strongly Correlated Electrons · Physics 2018-09-12 Seher Karakuzu , Kazuhiro Seki , Sandro Sorella