English
Related papers

Related papers: Information Redistribution Under Reductions in NP …

200 papers

Two-sample multiple testing problems of sparse spatial data are frequently arising in a variety of scientific applications. In this article, we develop a novel neighborhood-assisted and posterior-adjusted (NAPA) approach to incorporate both…

Methodology · Statistics 2023-08-01 Li Ma , Yin Xia , Lexin Li

The Survey Propagation (SP) algorithm for solving $k$-SAT problems has been shown recently as an instance of the Belief Propagation (BP) algorithm. In this paper, we show that for general constraint-satisfaction problems, SP may not be…

Information Theory · Computer Science 2008-01-31 Ronghui Tu , Yongyi Mao , Jiying Zhao

Efficient attention deployment in visual search is limited by human visual memory, yet this limitation can be offset by exploiting the environment's structure. This paper introduces a computational cognitive model that simulates how the…

Human-Computer Interaction · Computer Science 2024-09-16 Saku Sourulahti , Christian P Janssen , Jussi PP Jokinen

Neural networks (NNs) are making a large impact both on research and industry. Nevertheless, as NNs' accuracy increases, it is followed by an expansion in their size, required number of compute operations and energy consumption. Increase in…

Machine Learning · Computer Science 2021-12-21 Martin Ferianc , Anush Sankaran , Olivier Mastropietro , Ehsan Saboori , Quentin Cappart

Fine-tuning large pre-trained models with task-specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self-attention networks is redundant and not utilized effectively…

Computation and Language · Computer Science 2021-06-02 Jiaao Chen , Dinghan Shen , Weizhu Chen , Diyi Yang

Many data-fitting applications require the solution of an optimization problem involving a sum of large number of functions of high dimensional parameter. Here, we consider the problem of minimizing a sum of $n$ functions over a convex…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

The Information Retrieval research has used semantics to provide accurate search results, but the analysis of conceptual abstraction has mainly focused on information integration. We consider session-based query expansion in Geographical…

Information Retrieval · Computer Science 2020-04-02 Noemi Mauro , Liliana Ardissono , Laura Di Rocco , Michela Bertolotto , Giovanna Guerrini

We propose 'Hide-and-Seek' a general purpose data augmentation technique, which is complementary to existing data augmentation techniques and is beneficial for various visual recognition tasks. The key idea is to hide patches in a training…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Krishna Kumar Singh , Hao Yu , Aron Sarmasi , Gautam Pradeep , Yong Jae Lee

RNN models have achieved the state-of-the-art performance in a wide range of text mining tasks. However, these models are often regarded as black-boxes and are criticized due to the lack of interpretability. In this paper, we enhance the…

Computation and Language · Computer Science 2019-03-28 Mengnan Du , Ninghao Liu , Fan Yang , Shuiwang Ji , Xia Hu

Structured prediction requires searching over a combinatorial number of structures. To tackle it, we introduce SparseMAP: a new method for sparse structured inference, and its natural loss function. SparseMAP automatically selects only a…

Machine Learning · Statistics 2018-06-21 Vlad Niculae , André F. T. Martins , Mathieu Blondel , Claire Cardie

In the present work we have selected a collection of statistical and mathematical tools useful for the exploration of multivariate data and we present them in a form that is meant to be particularly accessible to a classically trained…

Statistics Theory · Mathematics 2010-09-01 Magnus Fontes

The remarkable success in neural networks provokes the selective rationalization. It explains the prediction results by identifying a small subset of the inputs sufficient to support them. Since existing methods still suffer from adopting…

Machine Learning · Computer Science 2024-07-22 Linan Yue , Qi Liu , Yichao Du , Li Wang , Weibo Gao , Yanqing An

Structural re-parameterization (Rep) methods has achieved significant performance improvement on traditional convolutional network. Most current Rep methods rely on prior knowledge to select the reparameterization operations. However, the…

Artificial Intelligence · Computer Science 2022-07-05 Xinyi Yu , Xiaowei Wang , Jintao Rong , Mingyang Zhang , Linlin Ou

In a dynamic environment, knowledge reduction of information systems with variations of object sets, attribute sets and attribute values is an important topic of rough set theory, and related family-based attribute reduction of dynamic…

Information Theory · Computer Science 2018-09-05 Mingjie Cai , Guangming Lang

The advent of online social networks has facilitated fast and wide spread of information. However, some users, especially members of minority groups, may be less likely to receive information spreading on the network, due to their…

Social and Information Networks · Computer Science 2025-12-18 Changan Liu , Xiaotian Zhou , Ahad N. Zehmakan , Zhongzhi Zhang

We study the identifiability of parameters and falsifiability of predictions under the process of model expansion in a Bayesian setting. Identifiability is represented by the closeness of the posterior to the prior distribution and…

Statistics Theory · Mathematics 2025-10-15 Collin Cademartori

Knowledge reduction of dynamic covering information systems involves with the time in practical situations. In this paper, we provide incremental approaches to computing the type-1 and type-2 characteristic matrices of dynamic coverings…

Information Theory · Computer Science 2023-11-30 Mingjie Cai

Dimensionality reduction is often used as an initial step in data exploration, either as preprocessing for classification or regression or for visualization. Most dimensionality reduction techniques to date are unsupervised; they do not…

Machine Learning · Statistics 2020-06-17 Jake S. Rhodes , Adele Cutler , Guy Wolf , Kevin R. Moon

In this paper we explore a relevant aspect of the interplay between two core elements of global optimization algorithms for nonconvex nonlinear programming problems, which we believe has been overlooked by past literature. The first one is…

Optimization and Control · Mathematics 2025-09-24 Julio González-Díaz , Brais González-Rodríguez , Ignacio Gómez-Casares