English
Related papers

Related papers: Finite Sample Analysis of Tensor Decomposition for…

200 papers

We introduce a simple method to estimate the system parameters in continuous dynamical systems from the time series. In this method, we construct a modified system by introducing some constants (controlling constants) into the given…

Chaotic Dynamics · Physics 2009-11-10 P. Palaniyandi , M. Lakshmanan

We present a novel analysis of the dynamics of tensor power iterations in the overcomplete regime where the tensor CP rank is larger than the input dimension. Finding the CP decomposition of an overcomplete tensor is NP-hard in general. We…

Machine Learning · Computer Science 2015-09-16 Anima Anandkumar , Rong Ge , Majid Janzamin

The problem of testing whether a signal lies within a given subspace, also named matched subspace detection, has been well studied when the signal is represented as a vector. However, the matched subspace detection methods based on vectors…

Numerical Analysis · Computer Science 2018-04-24 Cuiping Li , Xiao-Yang Liu , Yue Sun

We consider the problem of learning the dynamics of a linear system when one has access to data generated by an auxiliary system that shares similar (but not identical) dynamics, in addition to data from the true system. We use a weighted…

Machine Learning · Statistics 2025-01-20 Lei Xin , Lintao Ye , George Chiu , Shreyas Sundaram

Recently, efficient fine-tuning of large-scale pre-trained models has attracted increasing research interests, where linear probing (LP) as a fundamental module is involved in exploiting the final representations for task-dependent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Mingze Gao , Qilong Wang , Zhenyi Lin , Pengfei Zhu , Qinghua Hu , Jingbo Zhou

Learning generative probabilistic models is a core problem in machine learning, which presents significant challenges due to the curse of dimensionality. This paper proposes a joint dimensionality reduction and non-parametric density…

Machine Learning · Statistics 2022-06-22 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Growing model complexities in load modeling have created high dimensionality in parameter estimations, and thereby substantially increasing associated computational costs. In this paper, a tensor-based method is proposed for identifying…

Optimization and Control · Mathematics 2020-03-10 You Lin , Yishen Wang , Jianhui Wang , Siqi Wang , Di Shi

Efficient and interpretable spatial analysis is crucial in many fields such as geology, sports, and climate science. Tensor latent factor models can describe higher-order correlations for spatial data. However, they are computationally…

Machine Learning · Computer Science 2020-08-18 Jung Yeon Park , Kenneth Theo Carr , Stephan Zheng , Yisong Yue , Rose Yu

This article provides next step towards solving speed bottleneck of any system that intensively uses convolutions operations (e.g. CNN). Method described in the article is applied on deformable part models (DPM) algorithm. Method described…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 D. V. Parkhomenko , I. L. Mazurenko

The identification of nonlinear dynamics from observations is essential for the alignment of the theoretical ideas and experimental data. The last, in turn, is often corrupted by the side effects and noise of different natures, so…

Machine Learning · Computer Science 2020-06-08 Anna Shalova , Ivan Oseledets

During the training of Large Language Models (LLMs), tensor data is periodically "checkpointed" to persistent storage to allow recovery of work done in the event of failure. The volume of data that must be copied during each checkpoint,…

Machine Learning · Computer Science 2025-05-16 Daniel Waddington , Cornel Constantinescu

Spatiotemporal dynamics models are fundamental for various domains, from heat propagation in materials to oceanic and atmospheric flows. However, currently available neural network-based spatiotemporal modeling approaches fall short when…

Machine Learning · Computer Science 2025-02-11 Valerii Iakovlev , Harri Lähdesmäki

The increasing penetration of power-electronic-interfaced devices is expected to have a significant effect on the overall system inertia and a crucial impact on the system dynamics. In the future, the reduction of inertia will have drastic…

Systems and Control · Computer Science 2019-04-05 Johannes Schiffer , Petros Aristidou , Romeo Ortega

Numerical modelling of several coupled passive linear dynamical systems (LDS) is considered. Since such component systems may arise from partial differential equations, transfer function descriptions, lumped systems, measurement data, etc.,…

Optimization and Control · Mathematics 2019-11-12 Juha Kuortti , Jarmo Malinen , Tom Gustafsson

We provide a new estimation method for conditional moment models via the martingale difference divergence (MDD).Our MDD-based estimation method is formed in the framework of a continuum of unconditional moment restrictions. Unlike the…

Econometrics · Economics 2024-04-18 Kunyang Song , Feiyu Jiang , Ke Zhu

Latent linear dynamical systems with Bernoulli observations provide a powerful modeling framework for identifying the temporal dynamics underlying binary time series data, which arise in a variety of contexts such as binary decision-making…

Machine Learning · Statistics 2023-07-28 Iris R. Stone , Yotam Sagiv , Il Memming Park , Jonathan W. Pillow

Modeling dynamical systems plays a crucial role in capturing and understanding complex physical phenomena. When physical models are not sufficiently accurate or hardly describable by analytical formulas, one can use generic function…

Machine Learning · Computer Science 2021-06-23 Armand Jordana , Justin Carpentier , Ludovic Righetti

This paper introduces an algorithm to select demonstration examples for in-context learning of a query set. Given a set of $n$ examples, how can we quickly select $k$ out of $n$ to best serve as the conditioning for downstream inference?…

Machine Learning · Computer Science 2025-11-05 Ziniu Zhang , Zhenshuo Zhang , Dongyue Li , Lu Wang , Jennifer Dy , Hongyang R. Zhang

Identification of a linear time-invariant dynamical system from partial observations is a fundamental problem in control theory. Particularly challenging are systems exhibiting long-term memory. A natural question is how learn such systems…

Machine Learning · Computer Science 2022-03-08 Holden Lee

Originally introduced in the fluid mechanics community, dynamic mode decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of nonlinear systems. However, existing DMD theory deals primarily with sequential time…

Numerical Analysis · Mathematics 2014-12-17 Jonathan H. Tu , Clarence W. Rowley , Dirk M. Luchtenburg , Steven L. Brunton , J. Nathan Kutz