GitHub - RajiaRani/Building_LLMs_from_Scrach: A complete learning repository focused on understanding and implementing the core building blocks of Large Language Models from scratch, from tokenization to Transformer architectures

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 50 Commits
00. Basic_Code		00. Basic_Code
01. Tokenizer		01. Tokenizer
02. Pipeline_for_PreProcessing		02. Pipeline_for_PreProcessing
03. Self_Attention		03. Self_Attention
04. GPT-2_Architecture		04. GPT-2_Architecture
05. Loss_Function		05. Loss_Function
06. Loading_The_GPT2_Weights		06. Loading_The_GPT2_Weights
07. Fine_Tuning		07. Fine_Tuning
08. MoE		08. MoE
.gitignore		.gitignore

About

A complete learning repository focused on understanding and implementing the core building blocks of Large Language Models from scratch, from tokenization to Transformer architectures