English
Related papers

Related papers: Gemma: Open Models Based on Gemini Research and Te…

200 papers

Large language models (LLMs) with instruction fine-tuning demonstrate superior generative capabilities. However, these models are resource-intensive. To alleviate this issue, we explore distilling knowledge from instruction-tuned LLMs into…

Computation and Language · Computer Science 2024-01-30 Minghao Wu , Abdul Waheed , Chiyu Zhang , Muhammad Abdul-Mageed , Alham Fikri Aji

The rapid advancement of Large Language Models (LLMs) and their potential integration into autonomous driving systems necessitates understanding their moral decision-making capabilities. While our previous study examined four prominent LLMs…

Computers and Society · Computer Science 2025-05-23 Muhammad Shahrul Zaim bin Ahmad , Kazuhiro Takemoto

Large Language Models represent state-of-the-art linguistic models designed to equip computers with the ability to comprehend natural language. With its exceptional capacity to capture complex contextual relationships, the LLaMA (Large…

Computation and Language · Computer Science 2023-12-18 Pierpaolo Basile , Elio Musacchio , Marco Polignano , Lucia Siciliani , Giuseppe Fiameni , Giovanni Semeraro

Large language models can generate responses that resemble emotional distress, and this raises concerns around model reliability and safety. We introduce a set of evaluations to investigate expressions of distress in LLMs, and find that…

Computation and Language · Computer Science 2026-03-12 Anna Soligo , Vladimir Mikulik , William Saunders

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language tasks, marking significant strides towards general artificial intelligence. While general artificial intelligence is leveraged by…

Computation and Language · Computer Science 2023-10-31 Yizhe Yang , Huashan Sun , Jiawei Li , Runheng Liu , Yinghao Li , Yuhang Liu , Heyan Huang , Yang Gao

We introduce EmbeddingGemma, a new lightweight, open text embedding model based on the Gemma 3 language model family. Our innovative training recipe strategically captures knowledge from larger models via encoder-decoder initialization and…

Large Language Models (LLMs) have become ubiquitous across various domains, transforming the way we interact with information and conduct research. However, most high-performing LLMs remain confined behind proprietary walls, hindering…

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Large language models (LLMs) are increasingly utilized to assist in scientific and academic writing, helping authors enhance the coherence of their articles. Previous studies have highlighted stereotypes and biases present in LLM outputs,…

Computation and Language · Computer Science 2024-07-01 Naseela Pervez , Alexander J. Titus

We introduce Gemma 3, a multimodal addition to the Gemma family of lightweight open models, ranging in scale from 1 to 27 billion parameters. This version introduces vision understanding abilities, a wider coverage of languages and longer…

Computation and Language · Computer Science 2025-03-26 Gemma Team , Aishwarya Kamath , Johan Ferret , Shreya Pathak , Nino Vieillard , Ramona Merhej , Sarah Perrin , Tatiana Matejovicova , Alexandre Ramé , Morgane Rivière , Louis Rouillard , Thomas Mesnard , Geoffrey Cideron , Jean-bastien Grill , Sabela Ramos , Edouard Yvinec , Michelle Casbon , Etienne Pot , Ivo Penchev , Gaël Liu , Francesco Visin , Kathleen Kenealy , Lucas Beyer , Xiaohai Zhai , Anton Tsitsulin , Robert Busa-Fekete , Alex Feng , Noveen Sachdeva , Benjamin Coleman , Yi Gao , Basil Mustafa , Iain Barr , Emilio Parisotto , David Tian , Matan Eyal , Colin Cherry , Jan-Thorsten Peter , Danila Sinopalnikov , Surya Bhupatiraju , Rishabh Agarwal , Mehran Kazemi , Dan Malkin , Ravin Kumar , David Vilar , Idan Brusilovsky , Jiaming Luo , Andreas Steiner , Abe Friesen , Abhanshu Sharma , Abheesht Sharma , Adi Mayrav Gilady , Adrian Goedeckemeyer , Alaa Saade , Alex Feng , Alexander Kolesnikov , Alexei Bendebury , Alvin Abdagic , Amit Vadi , András György , André Susano Pinto , Anil Das , Ankur Bapna , Antoine Miech , Antoine Yang , Antonia Paterson , Ashish Shenoy , Ayan Chakrabarti , Bilal Piot , Bo Wu , Bobak Shahriari , Bryce Petrini , Charlie Chen , Charline Le Lan , Christopher A. Choquette-Choo , CJ Carey , Cormac Brick , Daniel Deutsch , Danielle Eisenbud , Dee Cattle , Derek Cheng , Dimitris Paparas , Divyashree Shivakumar Sreepathihalli , Doug Reid , Dustin Tran , Dustin Zelle , Eric Noland , Erwin Huizenga , Eugene Kharitonov , Frederick Liu , Gagik Amirkhanyan , Glenn Cameron , Hadi Hashemi , Hanna Klimczak-Plucińska , Harman Singh , Harsh Mehta , Harshal Tushar Lehri , Hussein Hazimeh , Ian Ballantyne , Idan Szpektor , Ivan Nardini , Jean Pouget-Abadie , Jetha Chan , Joe Stanton , John Wieting , Jonathan Lai , Jordi Orbay , Joseph Fernandez , Josh Newlan , Ju-yeong Ji , Jyotinder Singh , Kat Black , Kathy Yu , Kevin Hui , Kiran Vodrahalli , Klaus Greff , Linhai Qiu , Marcella Valentine , Marina Coelho , Marvin Ritter , Matt Hoffman , Matthew Watson , Mayank Chaturvedi , Michael Moynihan , Min Ma , Nabila Babar , Natasha Noy , Nathan Byrd , Nick Roy , Nikola Momchev , Nilay Chauhan , Noveen Sachdeva , Oskar Bunyan , Pankil Botarda , Paul Caron , Paul Kishan Rubenstein , Phil Culliton , Philipp Schmid , Pier Giuseppe Sessa , Pingmei Xu , Piotr Stanczyk , Pouya Tafti , Rakesh Shivanna , Renjie Wu , Renke Pan , Reza Rokni , Rob Willoughby , Rohith Vallu , Ryan Mullins , Sammy Jerome , Sara Smoot , Sertan Girgin , Shariq Iqbal , Shashir Reddy , Shruti Sheth , Siim Põder , Sijal Bhatnagar , Sindhu Raghuram Panyam , Sivan Eiger , Susan Zhang , Tianqi Liu , Trevor Yacovone , Tyler Liechty , Uday Kalra , Utku Evci , Vedant Misra , Vincent Roseberry , Vlad Feinberg , Vlad Kolesnikov , Woohyun Han , Woosuk Kwon , Xi Chen , Yinlam Chow , Yuvein Zhu , Zichuan Wei , Zoltan Egyed , Victor Cotruta , Minh Giang , Phoebe Kirk , Anand Rao , Kat Black , Nabila Babar , Jessica Lo , Erica Moreira , Luiz Gustavo Martins , Omar Sanseviero , Lucas Gonzalez , Zach Gleicher , Tris Warkentin , Vahab Mirrokni , Evan Senter , Eli Collins , Joelle Barral , Zoubin Ghahramani , Raia Hadsell , Yossi Matias , D. Sculley , Slav Petrov , Noah Fiedel , Noam Shazeer , Oriol Vinyals , Jeff Dean , Demis Hassabis , Koray Kavukcuoglu , Clement Farabet , Elena Buchatskaya , Jean-Baptiste Alayrac , Rohan Anil , Dmitry , Lepikhin , Sebastian Borgeaud , Olivier Bachem , Armand Joulin , Alek Andreev , Cassidy Hardin , Robert Dadashi , Léonard Hussenot

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

Answering end user security questions is challenging. While large language models (LLMs) like GPT, LLAMA, and Gemini are far from error-free, they have shown promise in answering a variety of questions outside of security. We studied LLM…

Cryptography and Security · Computer Science 2025-10-29 Vijay Prakash , Kevin Lee , Arkaprabha Bhattacharya , Danny Yuxing Huang , Jessica Staddon

The exponential growth of information presents a significant challenge for researchers and professionals seeking to remain at the forefront of their fields and this paper introduces an innovative framework for automatically generating…

Computational Engineering, Finance, and Science · Computer Science 2025-10-30 Andrei Lazarev , Dmitrii Sedov

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

Computation and Language · Computer Science 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

Previous research has shown that journal article quality ratings from the cloud based Large Language Model (LLM) families ChatGPT and Gemini and the medium sized open weights LLM Gemma3 27b correlate moderately with expert research quality…

Digital Libraries · Computer Science 2026-02-18 Mike Thelwall , Ehsan Mohammadi

This paper examines the reasoning capabilities of Large Language Models (LLMs) from a novel perspective, focusing on their ability to operate within formally specified, rule-governed environments. We evaluate four LLMs (Gemini 2.5 Pro and…

Artificial Intelligence · Computer Science 2026-02-24 Maciej Świechowski , Adam Żychowski , Jacek Mańdziuk

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

While large multi-modal models (LMM) have shown notable progress in multi-modal tasks, their capabilities in tasks involving dense textual content remains to be fully explored. Dense text, which carries important information, is often found…

Computation and Language · Computer Science 2024-05-14 Shuo Zhang , Biao Yang , Zhang Li , Zhiyin Ma , Yuliang Liu , Xiang Bai

Proprietary Large Language Models (LLMs) such as GPT-4 and Gemini have demonstrated promising capabilities in clinical text summarization tasks. However, due to patient data privacy concerns and computational costs, many healthcare…