English
Related papers

Related papers: Leveraging BERT Language Models for Multi-Lingual …

200 papers

Determining the sustainability impact of companies is a highly complex subject which has garnered more and more attention over the past few years. Today, investors largely rely on sustainability-ratings from established rating-providers in…

Information Retrieval · Computer Science 2024-12-20 Fabian Billert , Stefan Conrad

Context: Sustainable corporate behavior is increasingly valued by society and impacts corporate reputation and customer trust. Hence, companies regularly publish sustainability reports to shed light on their impact on environmental, social,…

Information Retrieval · Computer Science 2024-02-29 Jannik Fischbach , Max Adam , Victor Dzhagatspanyan , Daniel Mendez , Julian Frattini , Oleksandr Kosenkov , Parisa Elahidoost

The growing importance of environmental, social, and governance data in regulatory and investment contexts has increased the need for accurate, interpretable, and internationally aligned representations of non-financial risks, particularly…

Computation and Language · Computer Science 2025-09-16 Tsuyoshi Iwata , Guillaume Comte , Melissa Flores , Ryoma Kondo , Ryohei Hisano

This study investigates the effectiveness of Large Language Models (LLMs) in interpreting existing literature through a systematic review of the relationship between Environmental, Social, and Governance (ESG) factors and financial…

Computation and Language · Computer Science 2024-10-29 Aaditya Shah , Shridhar Mehendale , Siddha Kanthi

Advances in Natural Language Processing (NLP) have revolutionized the way researchers and practitioners address crucial societal problems. Large language models are now the standard to develop state-of-the-art solutions for text detection…

Machine Learning · Computer Science 2022-05-20 Gaurav Verma , Rohit Mujumdar , Zijie J. Wang , Munmun De Choudhury , Srijan Kumar

Environmental, social, and governance (ESG) criteria are essential for evaluating corporate sustainability and ethical performance. However, professional ESG analysis is hindered by data fragmentation across unstructured sources, and…

Artificial Intelligence · Computer Science 2026-01-15 Yilei Zhao , Wentao Zhang , Lei Xiao , Yandan Zheng , Mengpu Liu , Wei Yang Bryan Lim

The automatic identification of propaganda has gained significance in recent years due to technological and social changes in the way news is generated and consumed. That this task can be addressed effectively using BERT, a powerful new…

Computation and Language · Computer Science 2020-03-27 Harish Tayyar Madabushi , Elena Kochkina , Michael Castelle

Environmental, Social, and Governance (ESG) reports are central to investment decision-making, yet their length, heterogeneous content, and lack of standardized structure make manual analysis costly and inconsistent. We present ESGLens, a…

Computation and Language · Computer Science 2026-04-23 Tsung-Yu Yang , Meng-Chi Chen

We propose a new uniform framework for text classification and ranking that can automate the process of identifying check-worthy sentences in political debates and speech transcripts. Our framework combines the semantic analysis of the…

Computation and Language · Computer Science 2022-11-22 Ting Su , Craig Macdonald , Iadh Ounis

Health departments have been deploying text classification systems for the early detection of foodborne illness complaints in social media documents such as Yelp restaurant reviews. Current systems have been successfully applied for…

Computation and Language · Computer Science 2020-10-13 Ziyi Liu , Giannis Karamanolakis , Daniel Hsu , Luis Gravano

Despite recent advances in deep learning-based language modelling, many natural language processing (NLP) tasks in the financial domain remain challenging due to the paucity of appropriately labelled data. Other issues that can limit task…

Computation and Language · Computer Science 2020-10-19 Tim Nugent , Nicole Stelea , Jochen L. Leidner

Information extraction is an important task in NLP, enabling the automatic extraction of data for relational database filling. Historically, research and data was produced for English text, followed in subsequent years by datasets in…

Computation and Language · Computer Science 2019-12-13 Taesun Moon , Parul Awasthy , Jian Ni , Radu Florian

Framing continues to remain one of the most extensively applied theories in political communication. Developments in computation, particularly with the introduction of transformer architecture and more so with large language models (LLMs),…

Computation and Language · Computer Science 2026-03-30 Vihang Jumle

Offensive language detection is an ever-growing natural language processing (NLP) application. This growth is mainly because of the widespread usage of social networks, which becomes a mainstream channel for people to communicate, work, and…

Computation and Language · Computer Science 2021-06-29 Ehab Hamdy

Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrated state-of-the-art performance on various NLP tasks. Recent work with the multilingual version of BERT has shown that the model performs very well in zero-shot and…

Computation and Language · Computer Science 2020-03-23 Phillip Keung , Yichao Lu , Vikas Bhardwaj

Recent work has shown the surprising ability of multi-lingual BERT to serve as a zero-shot cross-lingual transfer model for a number of language processing tasks. We combine this finding with a similarly-recently proposal on sentence-level…

Information Retrieval · Computer Science 2019-11-11 Peng Shi , Jimmy Lin

Over the last decade, several regulatory bodies have started requiring the disclosure of non-financial information from publicly listed companies, in light of the investors' increasing attention to Environmental, Social, and Governance…

Computation and Language · Computer Science 2024-01-17 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Andrea Passerini , Jacopo Staiano

Evaluation metrics are a key ingredient for progress of text generation systems. In recent years, several BERT-based evaluation metrics have been proposed (including BERTScore, MoverScore, BLEURT, etc.) which correlate much better with…

Computation and Language · Computer Science 2021-11-02 Marvin Kaster , Wei Zhao , Steffen Eger

Climate change has intensified the need for transparency and accountability in organizational practices, making Environmental, Social, and Governance (ESG) reporting increasingly crucial. Frameworks like the Global Reporting Initiative…

Computation and Language · Computer Science 2025-05-30 Shafiuddin Rehan Ahmed , Ankit Parag Shah , Quan Hung Tran , Vivek Khetan , Sukryool Kang , Ankit Mehta , Yujia Bao , Wei Wei

While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings have yet to be explored.…

Computation and Language · Computer Science 2022-03-09 Fangxiaoyu Feng , Yinfei Yang , Daniel Cer , Naveen Arivazhagan , Wei Wang