Trained a language model from scratch on the Moroccan Darija language #554
ImadSaddik
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
After I bought my first PC with a dedicated GPU, I decided to train a language model from scratch to understand the Moroccan Darija, a language that most advanced models struggle with.
I got inspired by Andrej Karpathy's YouTube videos and this awesome repo by @rasbt. I shared my journey on my YouTube channel—here's the playlist. The code is also open for everyone to use. You can check it out in this repo.
Beta Was this translation helpful? Give feedback.
All reactions