English
Related papers

Related papers: Input Convex Encoder-Only Transformer for Fast and…

200 papers

Transformer and its variants have shown great potential for various vision tasks in recent years, including image classification, object detection and segmentation. Meanwhile, recent studies also reveal that with proper architecture design,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Xinghao Chen , Siwei Li , Yijing Yang , Yunhe Wang

Convolutional Neural Networks (CNNs) rely on fixed-size kernels scanning local patches, which limits their ability to capture global context or long-range dependencies without very deep architectures. Vision Transformers (ViTs), in turn,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Gijs Joppe Moens , Regina Beets-Tan , Eduardo H. P. Pooch

This paper presents the input convex neural network architecture. These are scalar-valued (potentially deep) neural networks with constraints on the network parameters such that the output of the network is a convex function of (some of)…

Machine Learning · Computer Science 2017-06-15 Brandon Amos , Lei Xu , J. Zico Kolter

Computing the receding horizon optimal control of nonlinear hybrid systems is typically prohibitively slow, limiting real-time implementation. To address this challenge, we propose a layered Model Predictive Control (MPC) architecture for…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Zachary Olkin , Aaron D. Ames

Active feedback stabilization of the dominant resistive wall mode (RWM) for an ITER H-mode scenario at high plasma pressure using infinite-horizon model predictive control (MPC) is presented. The MPC approach is closely-related to…

Systems and Control · Electrical Eng. & Systems 2020-07-17 Samo Gerksic , Bostjan Pregelj , Marco Ariola

Forecasting power consumptions of integrated electrical, heat or gas network systems is essential in order to operate more efficiently the whole energy network. Multi-energy systems are increasingly seen as a key component of future energy…

Machine Learning · Computer Science 2025-03-11 Corneliu Arsene , Alessandra Parisio

The goal of Inverse Optimal Control (IOC) is to identify the underlying objective function based on observed optimal trajectories. It provides a powerful framework to model expert's behavior, and a data-driven way to design an objective…

Optimization and Control · Mathematics 2022-04-28 Han Zhang , Axel Ringh , Weihan Jiang , Shaoyuan Li , Xiaoming Hu

In-Memory Computing (IMC) represents a paradigm shift in deep learning acceleration by mitigating data movement bottlenecks and leveraging the inherent parallelism of memory-based computations. The efficient deployment of Convolutional…

Hardware Architecture · Computer Science 2025-11-10 Eleni Bougioukou , Theodore Antonakopoulos

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

The rapid evolution of Internet of Things (IoT) technology has led to a significant increase in the number of IoT devices, applications, and services. This surge in IoT devices, along with their widespread presence, has made them a prime…

Machine Learning · Computer Science 2025-04-22 Hassan Wasswa , Aziida Nanyonga , Timothy Lynar

To efficiently deploy robotic systems in society, mobile robots must move autonomously and safely through complex environments. Nonlinear model predictive control (MPC) methods provide a natural way to find a dynamically feasible trajectory…

A key challenge in tuning Model Predictive Control (MPC) cost function parameters is to ensure that the system performance stays consistently above a certain threshold. To address this challenge, we propose a novel method, COAT-MPC,…

Machine Learning · Computer Science 2025-03-25 Albert Gassol Puigjaner , Manish Prajapat , Andrea Carron , Andreas Krause , Melanie N. Zeilinger

This work introduces a formulation of model predictive control (MPC) which adaptively reasons about the complexity of the model based on the task while maintaining feasibility and stability guarantees. Existing MPC implementations often…

Robotics · Computer Science 2024-11-07 Joseph Norby , Ardalan Tajbakhsh , Yanhao Yang , Aaron M. Johnson

Existing online video segmentation models typically combine a per-frame segmenter with complex specialized tracking modules. While effective, these modules introduce significant architectural complexity and computational overhead. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Narges Norouzi , Idil Esen Zulfikar , Niccolò Cavagnero , Tommie Kerssies , Bastian Leibe , Gijs Dubbelman , Daan de Geus

In this work, we propose a cross-layer framework for optimizing user association, packet offloading rates, and bandwidth allocation for Mission-Critical Internet-of-Things (MC-IoT) services with short packets in Mobile Edge Computing (MEC)…

Networking and Internet Architecture · Computer Science 2019-07-26 Changyang She , Yifan Duan , Guodong Zhao , Tony Q. S. Quek , Yonghui Li , Branka Vucetic

Output reference tracking can be improved by iteratively learning from past data to inform the design of feedforward control inputs for subsequent tracking attempts. This process is called iterative learning control (ILC). This article…

Systems and Control · Electrical Eng. & Systems 2021-08-18 Isaac A Spiegel , Nard Strijbosch , Tom Oomen , Kira Barton

CFD acceleration for virtual nuclear reactors or digital twin technology is a primary goal in the nuclear industry. This study compares advanced convolutional neural network (CNN) architectures for accelerating unsteady computational fluid…

Machine Learning · Computer Science 2025-02-12 Sangam Khanal , Shilaj Baral , Joongoo Jeon

In-context learning is a promising approach for offline reinforcement learning (RL) to handle online tasks, which can be achieved by providing task prompts. Recent works demonstrated that in-context RL could emerge with self-improvement in…

Machine Learning · Computer Science 2024-06-03 Sili Huang , Jifeng Hu , Hechang Chen , Lichao Sun , Bo Yang

Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map…

Machine Learning · Computer Science 2021-10-27 Alexander Scheinker