English
Related papers

Related papers: Partially adaptive filtering using randomized proj…

200 papers

In this paper, the design of universal compressive sensing filter based on normal filters including the lowpass, highpass, bandpass, and bandstop filters with different cutoff frequencies (or bandwidth) has been developed to enable signal…

Computational Engineering, Finance, and Science · Computer Science 2008-11-18 Lianlin Li , Wenji Zhang , Yin Xiang , Fang Li

In supervised learning, we typically leverage a fully labeled dataset to design methods for function estimation or prediction. In many practical situations, we are able to obtain alternative feedback, possibly at a low cost. A broad goal is…

Machine Learning · Statistics 2020-10-27 Yichong Xu , Sivaraman Balakrishnan , Aarti Singh , Artur Dubrawski

High-level Computer-Aided Process Planning (CAPP) generates manufacturing process plans from part specifications. It suffers from limited dataset availability in industry, reducing model generalization. We propose a semi-supervised learning…

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed…

Statistics Theory · Mathematics 2015-03-13 Jan Johannes , Maik Schwarz

Large language models (LLMs) have revolutionized the role of AI, yet pose potential social risks. To steer LLMs towards human preference, alignment technologies have been introduced and gained increasing attention. Nevertheless, existing…

Computation and Language · Computer Science 2024-10-01 Shitong Duan , Xiaoyuan Yi , Peng Zhang , Yan Liu , Zheng Liu , Tun Lu , Xing Xie , Ning Gu

This article develops a general-purpose adaptive sampler that approximates the target density by a mixture of multivariate t densities. The adaptive sampler is based on reversible proposal distributions each of which has the mixture of…

Methodology · Statistics 2013-08-22 Minh-Ngoc Tran , Michael K. Pitt , Robert Kohn

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

We argue that a form of the valuable information provided by the auxiliary information is its implied data clustering information. For instance, considering hashtags as auxiliary information, we can hypothesize that an Instagram image will…

Machine Learning · Computer Science 2022-02-21 Yao-Hung Hubert Tsai , Tianqin Li , Weixin Liu , Peiyuan Liao , Ruslan Salakhutdinov , Louis-Philippe Morency

With the rapid scaling of large language models (LLMs), serving numerous low-rank adaptations (LoRAs) concurrently has become increasingly impractical, leading to unaffordable costs and necessitating more parameter-efficient finetuning…

Machine Learning · Computer Science 2024-05-28 Sheng Wang , Boyang Xue , Jiacheng Ye , Jiyue Jiang , Liheng Chen , Lingpeng Kong , Chuan Wu

Partial-label learning is a popular weakly supervised learning setting that allows each training example to be annotated with a set of candidate labels. Previous studies on partial-label learning only focused on the classification setting…

Machine Learning · Computer Science 2023-06-16 Xin Cheng , Deng-Bao Wang , Lei Feng , Min-Ling Zhang , Bo An

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

Analysis and design of filtered-x adaptive algorithms are conventionally done by assuming that the transfer function in the secondary path is a discrete-time system. However, in real systems such as active noise control, the secondary path…

Information Theory · Computer Science 2013-08-16 Masaaki Nagahara , Ken-ichi Hamaguchi , Yutaka Yamamoto

We introduce a framework for Data Assimilation (DA) in which the data is split into multiple sets corresponding to low-rank projections of the state space. Algorithms are developed that assimilate some or all of the projected data,…

Computation · Statistics 2020-05-19 John Maclean , Erik S Van Vleck

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

Learning discriminative global features plays a vital role in semantic segmentation. And most of the existing methods adopt stacks of local convolutions or non-local blocks to capture long-range context. However, due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Lin Song , Yanwei Li , Zeming Li , Gang Yu , Hongbin Sun , Jian Sun , Nanning Zheng

The understanding of nonlinear, high dimensional flows, e.g, atmospheric and ocean flows, is critical to address the impacts of global climate change. Data Assimilation techniques combine physical models and observational data, often in a…

This paper examines the problem of locating outlier columns in a large, otherwise low-rank, matrix. We propose a simple two-step adaptive sensing and inference approach and establish theoretical guarantees for its performance; our results…

Information Theory · Computer Science 2015-06-22 Xingguo Li , Jarvis Haupt

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi

In a broad and fundamental type of ''inverse problems'' in science, one infers a spatially distributed physical attribute based on observations of processes that are controlled by the spatial attribute in question. The data-generating field…

Methodology · Statistics 2014-09-09 Zepu Zhang