English
Related papers

Related papers: Output Space Search for Structured Prediction

200 papers

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

Machine Learning · Computer Science 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Motivated by Supervised Opinion Analysis, we propose a novel framework devoted to Structured Output Learning with Abstention (SOLA). The structure prediction model is able to abstain from predicting some labels in the structured output at a…

Machine Learning · Computer Science 2019-01-16 Alexandre Garcia , Slim Essid , Chloé Clavel , Florence d'Alché-Buc

In machine learning we often encounter structured output prediction problems (SOPPs), i.e. problems where the output space admits a rich internal structure. Application domains where SOPPs naturally occur include natural language…

Machine Learning · Computer Science 2021-06-03 Waleed Mustafa , Yunwen Lei , Antoine Ledent , Marius Kloft

Recently proposed models which learn to write computer programs from data use either input/output examples or rich execution traces. Instead, we argue that a novel alternative is to use a glass-box loss function, given as a program itself…

Machine Learning · Computer Science 2017-09-27 Konstantina Christakopoulou , Adam Tauman Kalai

Classification systems are often deployed in resource-constrained settings where labels must be assigned to inputs on a budget of time, memory, etc. Budgeted, sequential classifiers (BSCs) address these scenarios by processing inputs…

Neural and Evolutionary Computing · Computer Science 2022-09-08 Nolan H. Hamilton , Errin Fulp

This paper studies visual search using structured queries. The structure is in the form of a 2D composition that encodes the position and the category of the objects. The transformation of the position and the category of the objects leads…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Mert Kilickaya , Arnold W. M. Smeulders

We describe an adaptation and application of a search-based structured prediction algorithm "Searn" to unsupervised learning problems. We show that it is possible to reduce unsupervised learning to supervised learning and demonstrate a…

Machine Learning · Computer Science 2009-06-30 Hal Daumé

We describe a method for utilizing the known structure of input data to make learning more efficient. Our work is in the domain of programming languages, and we use deep neural networks to do program analysis. Computer programs include a…

Neural and Evolutionary Computing · Computer Science 2019-04-01 Zehra Sura , Tong Chen , Hyojin Sung

Various natural language processing tasks are structured prediction problems where outputs are constructed with multiple interdependent decisions. Past work has shown that domain knowledge, framed as constraints over the output space, can…

Computation and Language · Computer Science 2020-06-03 Xingyuan Pan , Maitrey Mehta , Vivek Srikumar

In many contexts, customized and weighted classification scores are designed in order to evaluate the goodness of the predictions carried out by neural networks. However, there exists a discrepancy between the maximization of such scores…

Machine Learning · Computer Science 2023-05-24 Francesco Marchetti , Sabrina Guastavino , Cristina Campi , Federico Benvenuto , Michele Piana

We propose a novel semi-supervised structured output prediction method based on local linear regression in this paper. The existing semi-supervise structured output prediction methods learn a global predictor for all the data points in a…

Machine Learning · Computer Science 2016-08-17 Ru-Ze Liang , Wei Xie , Weizhi Li , Xin Du , Jim Jing-Yan Wang , Jingbin Wang

By leveraging the kernel trick in the output space, kernel-induced losses provide a principled way to define structured output prediction tasks for a wide variety of output modalities. In particular, they have been successfully used in the…

Machine Learning · Statistics 2024-06-14 Tamim El Ahmad , Junjie Yang , Pierre Laforgue , Florence d'Alché-Buc

A discriminative structured analysis dictionary is proposed for the classification task. A structure of the union of subspaces (UoS) is integrated into the conventional analysis dictionary learning to enhance the capability of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Wen Tang , Ashkan Panahi , Hamid Krim , Liyi Dai

This paper proposes a reinforcement learning framework for performance-driven structural design that combines bottom-up design generation with learned strategies to efficiently search large combinatorial design spaces. Motivated by the…

Computational Engineering, Finance, and Science · Computer Science 2025-07-31 Chloe S. H. Hong , Keith J. Lee , Caitlin T. Mueller

Despite its importance, choosing the structural form of the kernel in nonparametric regression remains a black art. We define a space of kernel structures which are built compositionally by adding and multiplying a small number of base…

Machine Learning · Statistics 2013-05-15 David Duvenaud , James Robert Lloyd , Roger Grosse , Joshua B. Tenenbaum , Zoubin Ghahramani

Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016). Tu and Gimpel (2018) developed an efficient framework for energy-based models by training "inference networks" to…

Computation and Language · Computer Science 2020-10-13 Lifu Tu , Richard Yuanzhe Pang , Kevin Gimpel

This paper presents a novel decision-focused framework integrating the physical energy storage model into machine learning pipelines. Motivated by the model predictive control for energy storage, our end-to-end method incorporates the prior…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Ming Yi , Saud Alghumayjan , Bolun Xu

We present a dynamic model selection approach for resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our objective is to…

Machine Learning · Statistics 2017-04-26 Feng Nan , Venkatesh Saligrama

Stochastic structured prediction under bandit feedback follows a learning protocol where on each of a sequence of iterations, the learner receives an input, predicts an output structure, and receives partial feedback in form of a task loss…

Computation and Language · Computer Science 2017-04-24 Artem Sokolov , Julia Kreutzer , Christopher Lo , Stefan Riezler

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

Machine Learning · Computer Science 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani