Skip to content

lutzroeder/models

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
gemma3
gemma3
 
 
gemma4
gemma4
 
 
gpt2
gpt2
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 

Repository files navigation

Models

Minimal implementations of open-weight models:

  • gemma4 - Gemma 4 in 270 lines only depending on JAX and SentencePiece.
  • gemma3 - Gemma 3 in 200 lines only depending on JAX and SentencePiece.
  • gpt2 - GPT-2 in 175 lines only depending on PyTorch.

About

A minimal version of GPT-2 using PyTorch and Gemma 3 using JAX.

Resources

Readme
Activity

Stars

49 stars

Watchers

1 watching

Forks

4 forks
Report repository

Releases

No releases published

Packages

 
 
 

Contributors

Languages