中文
相关论文

相关论文: PIDformer: Transformer Meets Control Theory

200 篇论文

A key limitation in using various modern methods of machine learning in developing feedback control policies is the lack of appropriate methodologies to analyze their long-term dynamics, in terms of making any sort of guarantees (even…

机器学习 · 计算机科学 2021-06-17 Sean Gillen , Katie Byl

We present a full review of PID passivity-based controllers (PBC) applied to power electronic converters, discussing limitations, unprecedented merits and potential improvements in terms of large-signal stability, robustness and…

系统与控制 · 电气工程与系统科学 2021-09-24 Daniele Zonetti , Gilbert Bergna-Diaz , Romeo Ortega , Nima Monshizadeh

Microgrids are increasingly recognized as a key technology for the integration of distributed energy resources into the power network, allowing local clusters of load and distributed energy resources to operate autonomously. However,…

最优化与控制 · 数学 2021-06-22 Jeremy Watson , Yemi Ojo , Khaled Laib , Ioannis Lestas

Transformers have significantly impacted domains like natural language processing, computer vision, and robotics, where they improve performance compared to other neural networks. This survey explores how transformers are used in…

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model relations between elements of a sequence in parallel…

机器学习 · 计算机科学 2025-02-20 Jaemu Heo , Eldor Fozilov , Hyunmin Song , Taehwan Kim

Self-attention is the key mechanism of transformers, which are the essential building blocks of modern foundation models. Recent studies have shown that pure self-attention suffers from an increasing degree of rank collapse as depth…

机器学习 · 计算机科学 2024-11-04 Xinyi Wu , Amir Ajorlou , Yifei Wang , Stefanie Jegelka , Ali Jadbabaie

Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Kai Han , Yunhe Wang , Hanting Chen , Xinghao Chen , Jianyuan Guo , Zhenhua Liu , Yehui Tang , An Xiao , Chunjing Xu , Yixing Xu , Zhaohui Yang , Yiman Zhang , Dacheng Tao

Large language models exhibit sophisticated capabilities, yet understanding how they work internally remains a central challenge. A fundamental obstacle is that training selects for behavior, not circuitry, so many weight configurations can…

机器学习 · 计算机科学 2026-02-27 Joshua S. Schiffman

Soft robotics holds transformative potential for enabling adaptive and adaptable systems in dynamic environments. However, the interplay between morphological and control complexities and their collective impact on task performance remains…

机器人学 · 计算机科学 2025-03-27 Yue Xie , Kai-fung Chu , Xing Wang , Fumiya Iida

Navigation problems under unknown varying conditions are among the most important and well-studied problems in the control field. Classic model-based adaptive control methods can be applied only when a convenient model of the plant or…

The PID controller remains the most widely adopted control architecture, with groundbreaking success across extensive implications. However, optimal parameter tuning for PID controller remains a critical challenge. Existing theories…

系统与控制 · 电气工程与系统科学 2025-07-17 Zimao Sheng , Hongan Yang , Jiakang Wang , Tong Zhang

Robust controllers that stabilize dynamical systems even under disturbances and noise are often formulated as solutions of nonsmooth, nonconvex optimization problems. While methods such as gradient sampling can handle the nonconvexity and…

最优化与控制 · 数学 2023-05-01 Steffen W. R. Werner , Michael L. Overton , Benjamin Peherstorfer

Transformers trained in low precision can suffer forward-error amplification. We give a first-order, module-wise theory that predicts when and where errors grow. For self-attention we derive a per-layer bound that factorizes into three…

机器学习 · 计算机科学 2025-10-28 Jinwoo Baek

The remarkable capability of Transformers to do reasoning and few-shot learning, without any fine-tuning, is widely conjectured to stem from their ability to implicitly simulate a multi-step algorithms -- such as gradient descent -- with…

机器学习 · 计算机科学 2024-10-14 Khashayar Gatmiry , Nikunj Saunshi , Sashank J. Reddi , Stefanie Jegelka , Sanjiv Kumar

Learning-based simulation of multi-object rigid-body dynamics remains difficult because contact is discontinuous and errors compound over long horizons. Most existing methods remain tied to mesh connectivity and vertex-level message…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Zhiyang Dou , Minghao Guo , Haixu Wu , Doug Roble , Tuur Stuyck , Wojciech Matusik

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

机器学习 · 计算机科学 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati

This paper proposes a new Active Disturbance Rejection based robust trajectory tracking controller design method in state space. It can compensate not only matched but also mismatched disturbances. Robust state and control input references…

系统与控制 · 计算机科学 2019-03-15 Emre Sariyildiz , Rahim Mutlu , Chuanlin Zhang

Generative AI, in particular large transformer models, are increasingly driving HPC system design in science and industry. We analyze performance characteristics of such transformer models and discuss their sensitivity to the transformer…

In this work, we investigate grid-forming control for power systems containing three-phase and single-phase converters connected to unbalanced distribution and transmission networks, investigate self-balancing between single-phase…

系统与控制 · 电气工程与系统科学 2022-11-15 Shahin S. Nudehi , Dominic Groß

Since most industrial control applications use PID controllers, PID tuning and anti-windup measures are significant problems. This paper investigates tuning the feedback gains of a PID controller via back-calculation and automatic…

系统与控制 · 电气工程与系统科学 2022-07-05 Athindran Ramesh Kumar , Peter J. Ramadge