English
Related papers

Related papers: Global-aware Beam Search for Neural Abstractive Su…

200 papers

A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spatial aspects to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Yichao Liu , Zongru Shao , Nico Hoffmann

Compositional explanations are a family of methods that aim to describe the spatial alignment between neurons' receptive field activations and concepts through logical rules, typically computed via a search over all possible concept…

Artificial Intelligence · Computer Science 2026-05-28 Biagio La Rosa , Leilani H. Gilpin

Optimization problems involving mixed variables (i.e., variables of numerical and categorical nature) can be challenging to solve, especially in the presence of mixed-variable constraints. Moreover, when the objective function is the result…

Optimization and Control · Mathematics 2024-12-12 Mengjia Zhu , Alberto Bemporad

This study mainly investigates two common decoding problems in neural keyphrase generation: sequence length bias and beam diversity. To tackle the problems, we introduce a beam search decoding strategy based on word-level and ngram-level…

Computation and Language · Computer Science 2023-10-31 Iftitahu Ni'mah , Vlado Menkovski , Mykola Pechenizkiy

In this paper we consider multi-objective optimization problems over a box. The problem is very relevant and several computational approaches have been proposed in the literature. They broadly fall into two main classes: evolutionary…

Optimization and Control · Mathematics 2022-12-08 Matteo Lapucci , Pierluigi Mansueto , Fabio Schoen

We consider the problem of using sentence compression techniques to facilitate query-focused multi-document summarization. We present a sentence-compression-based framework for the task, and design a series of learning-based compression…

Computation and Language · Computer Science 2016-06-27 Lu Wang , Hema Raghavan , Vittorio Castelli , Radu Florian , Claire Cardie

Learning algorithms become more powerful, often at the cost of increased complexity. In response, the demand for algorithms to be transparent is growing. In NLP tasks, attention distributions learned by attention-based deep learning models…

Computation and Language · Computer Science 2019-07-09 Joris Baan , Maartje ter Hoeve , Marlies van der Wees , Anne Schuth , Maarten de Rijke

Optical flow estimation is a fundamental task in computer vision. Recent direct-regression methods using deep neural networks achieve remarkable performance improvement. However, they do not explicitly capture long-term motion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shiyu Zhao , Long Zhao , Zhixing Zhang , Enyu Zhou , Dimitris Metaxas

In this paper we propose and analyze a distributed algorithm for achieving globally optimal decisions, either estimation or detection, through a self-synchronization mechanism among linearly coupled integrators initialized with local…

Information Theory · Computer Science 2016-11-15 Gesualdo Scutari , Sergio Barbarossa , Loreto Pescosolido

Graph neural networks (GNNs) have emerged as a powerful model to capture critical graph patterns. Instead of treating them as black boxes in an end-to-end fashion, attempts are arising to explain the model behavior. Existing works mainly…

Machine Learning · Computer Science 2024-02-22 Yi Nian , Yurui Chang , Wei Jin , Lu Lin

We present GLASSES: Global optimisation with Look-Ahead through Stochastic Simulation and Expected-loss Search. The majority of global optimisation approaches in use are myopic, in only considering the impact of the next function value; the…

Machine Learning · Statistics 2015-10-22 Javier González , Michael Osborne , Neil D. Lawrence

Representing a text as a graph for obtaining automatic text summarization has been investigated for over ten years. With the development of attention or Transformer on natural language processing (NLP), it is possible to make a connection…

Computation and Language · Computer Science 2022-07-27 Yuan-Ching Lin , Jinwen Ma

Professional summaries are written with document-level information, such as the theme of the document, in mind. This is in contrast with most seq2seq decoders which simultaneously learn to focus on salient content, while deciding what to…

Computation and Language · Computer Science 2021-05-26 Rahul Aralikatte , Shashi Narayan , Joshua Maynez , Sascha Rothe , Ryan McDonald

Recent years have witnessed the development of a large body of algorithms for community detection in complex networks. Most of them are based upon the optimization of objective functions, among which modularity is the most common, though a…

Social and Information Networks · Computer Science 2014-10-02 Stanislav Sobolevsky , Riccardo Campari , Alexander Belyi , Carlo Ratti

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Bingqing Wang , Zhe Feng , Liu Ren , Fei Liu

We propose a generalization of separability in the context of global optimization. Our results apply to objective functions implemented as differentiable computer programs. They are presented in the context of a simple branch and bound…

Optimization and Control · Mathematics 2023-05-10 Jens Deussen , Uwe Naumann

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

Current abstractive summarization models either suffer from a lack of clear interpretability or provide incomplete rationales by only highlighting parts of the source document. To this end, we propose the Summarization Program (SP), an…

Computation and Language · Computer Science 2023-02-03 Swarnadeep Saha , Shiyue Zhang , Peter Hase , Mohit Bansal

Fully supervised action segmentation works on frame-wise action recognition with dense annotations and often suffers from the over-segmentation issue. Existing works have proposed a variety of solutions such as boundary-aware networks,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Peiyao Wang , Haibin Ling

To resolve the semantic ambiguity in texts, we propose a model, which innovatively combines a knowledge graph with an improved attention mechanism. An existing knowledge base is utilized to enrich the text with relevant contextual concepts.…

Computation and Language · Computer Science 2024-01-30 Siyu Li , Lu Chen , Chenwei Song , Xinyi Liu