We present DictaLM, a large-scale language model tailored for Modern Hebrew. Boasting 7B parameters, this model is predominantly trained on Hebrew-centric data. As a commitment to promoting research and development in the Hebrew language, we release both the foundation model and the instruct-tuned model under a Creative Commons license. Concurrently, we introduce DictaLM-Rab, another foundation model geared towards Rabbinic/Historical Hebrew. These foundation models serve as ideal starting points for fine-tuning various Hebrew-specific tasks, such as instruction, Q&A, sentiment analysis, and more. This release represents a preliminary step, offering an initial Hebrew LLM model for the Hebrew NLP community to experiment with.
@article{arxiv.2309.14568,
title = {Introducing DictaLM -- A Large Generative Language Model for Modern Hebrew},
author = {Shaltiel Shmidman and Avi Shmidman and Amir David Nissan Cohen and Moshe Koppel},
journal= {arXiv preprint arXiv:2309.14568},
year = {2023}
}