English
Related papers

Related papers: Stochastic algorithms with descent guarantees for …

200 papers

Independent component analysis (ICA) is a method to extract a set of time-series data using ``statistical independency" of each component. We applied ICA to extract gravitational wave (GW) signals directly from the detector data. Our idea…

General Relativity and Quantum Cosmology · Physics 2025-05-06 Rika Shimomura , Yuuichi Tabe , Hisaaki Shinkai

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

Nonlinear independent component analysis (ICA) provides an appealing framework for unsupervised feature learning, but the models proposed so far are not identifiable. Here, we first propose a new intuitive principle of unsupervised deep…

Machine Learning · Statistics 2016-05-23 Aapo Hyvarinen , Hiroshi Morioka

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

Constraint Acquisition (CA) systems can be used to assist in the modeling of constraint satisfaction problems. In (inter)active CA, the system is given a set of candidate constraints and posts queries to the user with the goal of finding…

Artificial Intelligence · Computer Science 2023-07-13 Dimos Tsouros , Senne Berden , Tias Guns

We propose a frequency domain method based on robust independent component analysis (RICA) to address the multichannel Blind Source Separation (BSS) problem of convolutive speech mixtures in highly reverberant environments. We impose…

Machine Learning · Computer Science 2014-08-04 Zaid Albataineh , Fathi M. Salem

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

One important feature of complex systems are problem domains that have many local minima and substructure. Biological systems manage these local minima by switching between different subsystems depending on their environmental or…

Neural and Evolutionary Computing · Computer Science 2022-08-25 Ankit Grover , Vaishali Yadav , Bradly Alicea

We propose an ICA contrast based on the density estimation of the observed signal and its marginals by means of wavelets. The risk of the associated moment estimator is linked with approximation properties in Besov spaces. It is shown to…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

Two types of spatiotemporal chaos exhibited by ensembles of coupled nonlinear oscillators are analyzed using independent component analysis (ICA). For diffusively coupled complex Ginzburg-Landau oscillators that exhibit smooth amplitude…

Chaotic Dynamics · Physics 2007-06-13 H. Asano , H. Nakao

Methods for analysis of principal components in discrete data have existed for some time under various names such as grade of membership modelling, probabilistic latent semantic analysis, and genotype inference with admixture. In this paper…

Machine Learning · Computer Science 2012-07-19 Wray L. Buntine , Aleks Jakulin

In this paper we study the effect of stochastic errors on two constrained incremental sub-gradient algorithms. We view the incremental sub-gradient algorithms as decentralized network optimization algorithms as applied to minimize a sum of…

Optimization and Control · Mathematics 2008-06-09 S Sundhar Ram , A Nedich , V. V. Veeravalli

In April 2020, KAGRA conducted its first science observation in combination with the GEO~600 detector (O3GK) for two weeks. According to the noise budget estimation, suspension control noise in the low frequency band and acoustic noise in…

Instrumentation and Methods for Astrophysics · Physics 2022-06-14 KAGRA collaboration , H. Abe , T. Akutsu , M. Ando , A. Araya , N. Aritomi , H. Asada , Y. Aso , S. Bae , Y. Bae , R. Bajpai , K. Cannon , Z. Cao , E. Capocasa , M. Chan , C. Chen , D. Chen , K. Chen , Y. Chen , C-Y. Chiang , Y-K. Chu , S. Eguchi , M. Eisenmann , Y. Enomoto , R. Flaminio , H. K. Fong , Y. Fujii , Y. Fujikawa , Y. Fujimoto , I. Fukunaga , D. Gao , G. -G. Ge , S. Ha , I. P. W. Hadiputrawan , S. Haino , W. -B. Han , K. Hasegawa , K. Hattori , H. Hayakawa , K. Hayama , Y. Himemoto , N. Hirata , C. Hirose , T-C. Ho , B-H. Hsieh , H-F. Hsieh , C. Hsiung , H-Y. Huang , P. Huang , Y-C. Huang , Y. -J. Huang , D. C. Y. Hui , S. Ide , K. Inayoshi , Y. Inoue , K. Ito , Y. Itoh , C. Jeon , H. -B. Jin , k. Jung , P. Jung , K. Kaihotsu , T. Kajita , M. Kakizaki , M. Kamiizumi , N. Kanda , T. Kato , K. Kawaguchi , C. Kim , J. Kim , J. C. Kim , Y. -M. Kim , N. Kimura , T. Kiyota , Y. Kobayashi , K. Kohri , K. Kokeyama , A. K. H. Kong , N. Koyama , C. Kozakai , J. Kume , Y. Kuromiya , S. Kuroyanagi , K. Kwak , E. Lee , H. W. Lee , R. Lee , M. Leonardi , K. L. Li , P. Li , L. C. -C. Lin , C-Y. Lin , E. T. Lin , F-K. Lin , F-L. Lin , H. L. Lin , G. C. Liu , L. -W. Luo , M. Ma'arif , E. Majorana , Y. Michimura , N. Mio , O. Miyakawa , K. Miyo , S. Miyoki , Y. Mori , S. Morisaki , N. Morisue , Y. Moriwaki , K. Nagano , K. Nakamura , H. Nakano , M. Nakano , Y. Nakayama , T. Narikawa , L. Naticchioni , L. Nguyen Quynh , W. -T. Ni , T. Nishimoto , A. Nishizawa , S. Nozaki , Y. Obayashi , W. Ogaki , J. J. Oh , K. Oh , M. Ohashi , T. Ohashi , M. Ohkawa , H. Ohta , Y. Okutani , K. Oohara , S. Oshino , S. Otabe , K. -C. Pan , A. Parisi , J. Park , F. E. Peña Arellano , S. Saha , Y. Saito , K. Sakai , T. Sawada , Y. Sekiguchi , L. Shao , Y. Shikano , H. Shimizu , K. Shimode , H. Shinkai , T. Shishido , A. Shoda , K. Somiya , I. Song , R. Sugimoto , J. Suresh , T. Suzuki , T. Suzuki , T. Suzuki , H. Tagoshi , H. Takahashi , R. Takahashi , S. Takano , H. Takeda , M. Takeda , K. Tanaka , T. Tanaka , T. Tanaka , S. Tanioka , A. Taruya , T. Tomaru , T. Tomura , L. Trozzo , T. Tsang , J-S. Tsao , S. Tsuchida , T. Tsutsui , D. Tuyenbayev , N. Uchikata , T. Uchiyama , A. Ueda , T. Uehara , K. Ueno , G. Ueshima , T. Ushiba , M. H. P. M. van Putten , J. Wang , T. Washimi , C. Wu , H. Wu , T. Yamada , K. Yamamoto , T. Yamamoto , K. Yamashita , R. Yamazaki , Y. Yang , S. Yeh , J. Yokoyama , T. Yokozawa , T. Yoshioka , H. Yuzurihara , S. Zeidler , M. Zhan , H. Zhang , Y. Zhao , Z. -H. Zhu

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

In the Reverse Engineering and Hardware Assurance domain, a majority of the data acquisition is done through electron microscopy techniques such as Scanning Electron Microscopy (SEM). However, unlike its counterparts in optical imaging,…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Ronald Wilson , Navid Asadizanjani , Domenic Forte , Damon L. Woodard

Recently, an extension of independent component analysis (ICA) from one to multiple datasets, termed independent vector analysis (IVA), has been the subject of significant research interest. IVA has also been shown to be a generalization of…

Machine Learning · Computer Science 2016-08-11 Matthew Anderson , Geng-Shen Fu , Ronald Phlypo , Tülay Adalı

Stochastic optimization is an important task in many optimization problems where the tasks are not expressible as convex optimization problems. In the case of non-convex optimization problems, various different stochastic algorithms like…

Neural and Evolutionary Computing · Computer Science 2015-06-29 Jayanta Basak

We propose a new inference framework, named MOSAIC, for change-point detection in dynamic networks with the simultaneous low-rank and sparse-change structure. We establish the minimax rate of detection boundary, which relies on the sparsity…

Machine Learning · Statistics 2025-09-09 Yingying Fan , Jingyuan Liu , Jinchi Lv , Ao Sun