English
Related papers

Related papers: Blessing of High-Order Dimensionality: from Non-Co…

200 papers

Signal to Noise Ratio (SNR) is an important index for wireless communications. There are many methods for increasing SNR. In CDMA systems, spreading sequences are used. We consider the frequency-selective wide-sense-stationary…

Information Theory · Computer Science 2016-10-17 Hirofumi Tsuda , Ken Umeno

We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and…

Methodology · Statistics 2024-01-09 Jungmin Shin , Seung Jun Shin , Sungwan Bang

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

Modern supervised learning techniques, particularly those using deep nets, involve fitting high dimensional labelled data sets with functions containing very large numbers of parameters. Much of this work is empirical. Interesting phenomena…

Machine Learning · Statistics 2018-05-30 Partha P Mitra

Stochastic gradient descent (SGD) is widely used in machine learning. Although being commonly viewed as a fast but not accurate version of gradient descent (GD), it always finds better solutions than GD for modern neural networks. In order…

Machine Learning · Computer Science 2018-08-17 Robert Kleinberg , Yuanzhi Li , Yang Yuan

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

An unknown-position sensor can be localized if there are three or more anchors making time-of-arrival (TOA) measurements of a signal from it. However, the location errors can be very large due to the fact that some of the measurements are…

Information Theory · Computer Science 2016-11-17 Hongyang Chen , Kenneth W. K. Lui , Zizhuo Wang , H. C. So , H. Vincent Poor

The landmark multi-dimensional scaling (LMDS) is a leading method that embeds new points to an existing coordinate system based on observed distance information. It has long been known as a variant of Nystr\"{o}m algorithm. It was recently…

Optimization and Control · Mathematics 2025-09-16 Ting Ouyang , Lingchen Kong , Houduo Qi

As Wireless Sensor Networks are penetrating into the industrial domain, many research opportunities are emerging. One such essential and challenging application is that of node localization. A feed-forward neural network based methodology…

Networking and Internet Architecture · Computer Science 2016-10-17 Shiu Kumar , Ronesh Sharma , Edwin Vans

Training stability is a persistent challenge in the pre-training of large language models (LLMs), particularly for architectures such as Post-Norm Transformers, which are prone to gradient explosion and dissipation. In this paper, we…

Computation and Language · Computer Science 2025-02-26 Ya Wang , Zhijian Zhuo , Yutao Zeng , Xun Zhou , Jian Yang , Xiaoqing Li

We consider the problem of locating a nearest descriptor system of prescribed reduced order to a descriptor system with large order with respect to the ${\mathcal L}_\infty$ norm. Widely employed approaches such as the balanced truncation…

Numerical Analysis · Mathematics 2023-09-18 Emre Mengi

Hybrid localization in GNSS-challenged environments using measured ranges and angles is becoming increasingly popular, in particular with the advent of multimodal communication systems. Here, we address the hybrid network localization…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Claudia Soares , Filipa Valdeira , Joao Gomes

We propose a new algorithm for minimizing regularized empirical loss: Stochastic Dual Newton Ascent (SDNA). Our method is dual in nature: in each iteration we update a random subset of the dual variables. However, unlike existing methods…

Machine Learning · Computer Science 2015-02-10 Zheng Qu , Peter Richtárik , Martin Takáč , Olivier Fercoq

In this paper, we study the target tracking problem in wireless sensor networks (WSNs) using quantized sensor measurements under limited bandwidth availability. At each time step of tracking, the available bandwidth $R$ needs to be…

Applications · Statistics 2015-05-30 Engin Masazade , Ruixin Niu , Pramod K. Varshney

Stochastic descent methods (of the gradient and mirror varieties) have become increasingly popular in optimization. In fact, it is now widely recognized that the success of deep learning is not only due to the special deep architecture of…

Machine Learning · Computer Science 2019-01-21 Navid Azizan , Babak Hassibi

Bilevel optimization (BLO) problem, where two optimization problems (referred to as upper- and lower-level problems) are coupled hierarchically, has wide applications in areas such as machine learning and operations research. Recently, many…

Optimization and Control · Mathematics 2025-05-19 Xiaotian Jiang , Ioannis Tsaknakis , Prashant Khanduri , Mingyi Hong

Distributed cooperative localization in wireless networks is a challenging problem since it typically requires solving a large-scale nonconvex and nonsmooth optimization problem. In this paper, we reformulate the classic cooperative…

Optimization and Control · Mathematics 2023-08-08 Mei Zhang , Zhiguo Wang , Feng Yin , Xiaojing Shen

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

Semi-supervised object detection (SSOD) aims to facilitate the training and deployment of object detectors with the help of a large amount of unlabeled data. Though various self-training based and consistency-regularization based SSOD…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Binghui Chen , Pengyu Li , Xiang Chen , Biao Wang , Lei Zhang , Xian-Sheng Hua

In this paper, we consider a bilevel polynomial optimization problem where the objective and the constraint functions of both the upper and the lower level problems are polynomials. We present methods for finding its global minimizers and…

Optimization and Control · Mathematics 2016-01-14 V. Jeyakumar , J. B. Lasserre , G. Li , T. S. Pham