rasbt/LLMs-from-scratch

Jupyter Notebook

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

51/ 100

Activity

Stable

Score Breakdown

25
Issue Response
/ 25 pts
18
PR Merge Rate
/ 20 pts
1
External Contributions
/ 15 pts
4
Commit Distribution
/ 15 pts
0
Good First Issues
/ 10 pts
3
Complexity
/ 10 pts
0
CONTRIBUTING
/ 4 pts
0
Code of Conduct
/ 1 pts
0
No Penalty
Repo is code
0
No Penalty
Repo is active

Repository Stats

Stars
85.9k
Forks
13k
Open Issues
0
Lines of Code
113.6k
Contributors
59

Contributor Friendliness

Good First Issues
0
Help Wanted
0
Avg Issue Response
2h
Avg PR Merge Time
10h
Avg PR Review Time
2d
Issue Close Rate
100%

Project Info

Created
Jul 23, 2023
Age
2 years old
Last Push
20d ago
Size
15.7 MB

Contributors also worked on

labmlai/annotated_deep_learning_paper_implementations

Python

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

65.9k40
23

huggingface/transformers

Python

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

156.9k3.7k
74

slidevjs/slidev

TypeScript

Presentation Slides for Developers

44.4k328
66

ChrisTitusTech/winutil

PowerShell

Chris Titus Tech's Windows Utility - Install Programs, Tweaks, Fixes, and Updates

48k232
62

faif/python-patterns

Python

A collection of design patterns/idioms in Python

42.8k127
60

microsoft/qlib

Python

Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.

38.1k10k
58

schollz/croc

Go

Easily and securely send things from one computer to another :crocodile: :package:

34.3k121
48

ossu/computer-science

HTML

🎓 Path to a free self-taught education in Computer Science!

201.6k151
40

codecrafters-io/build-your-own-x

Markdown

Master programming by recreating your favorite technologies from scratch.

468.1k131
37

explosion/spaCy

Python

💫 Industrial-strength Natural Language Processing (NLP) in Python

33.3k688
36