# micrograduate

**Repository Path**: Zen07/micrograduate

## Basic Information

- **Project Name**: micrograduate
- **Description**: A self-contained course to learn the basics of neural networks: from backprop to GPT! 
- **Primary Language**: Python
- **License**: MIT
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-12-25
- **Last Updated**: 2025-12-25

## Categories & Tags

**Categories**: Uncategorized

**Tags**: forked

## README

<div align="center">

[![](./heading.png)](https://micrograduate-book.github.io)

</div>

[![GitHub stars](https://img.shields.io/github/stars/ckaraneen/micrograduate?style=social)](https://github.com/ckaraneen/micrograduate)<sup>⭐</sup>
[![X-Tweet Badge](https://img.shields.io/twitter/url?url=https://x.com)](https://x.com/ckaraneen/status/1893676057330409483)
[![Jupyter Book Badge](https://raw.githubusercontent.com/jupyter-book/jupyter-book/refs/heads/main/docs/images/badge.svg)](https://micrograduate-book.github.io)
[![MIT License Badge](https://img.shields.io/badge/License-MIT-success.svg)](https://opensource.org/licenses/MIT)

[![](./logo.gif)](https://micrograduate-book.github.io)

# Preface

A self-contained course to learn the basics of neural networks: from backprop to GPT! 

## 📖 Read 🌻

Visit [**micrograduate-book.github.io**](https://micrograduate-book.github.io).

## ⚡ Run ☄️

### 🌐 Online

| # | 📔 | 🔗 |
|----------|----------|-------------|
| 1 | [**micrograd**](https://micrograduate-book.github.io/micrograduate/micrograd.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/micrograd.ipynb) |
| 2 | [**makemore1**](https://micrograduate-book.github.io/micrograduate/makemore1.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/makemore1.ipynb) |
| 3 | [**makemore2**](https://micrograduate-book.github.io/micrograduate/makemore2.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/makemore2.ipynb) |
| 4 | [**makemore3**](https://micrograduate-book.github.io/micrograduate/makemore3.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/makemore3.ipynb) |
| 5 | [**makemore4**](https://micrograduate-book.github.io/micrograduate/makemore4.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/makemore4.ipynb) |
| 6 | [**makemore5**](https://micrograduate-book.github.io/micrograduate/makemore5.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/makemore5.ipynb) |
| 7 | [**picoGPT**](https://micrograduate-book.github.io/micrograduate/picogpt.html) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ckaraneen/micrograduate/blob/main/picogpt.ipynb) |

### 🏡 Locally

1. Clone repo:
```bash
git clone https://github.com/ckaraneen/micrograduate.git
```
2. Create and activate env:
```bash
cd micrograduate
conda env create --file environment.yaml
conda activate micrograduate-env
```

3. Install requirements:
```bash
uv pip install -r requirements.txt
```

4. Run notebooks in [Notebook Server](https://docs.jupyter.org/en/latest/running.html), [VSCode/Cursor](https://code.visualstudio.com/docs/datascience/jupyter-notebooks), etc.

## ✨ Acknowledgements 🙏

[**microgra∇uate**](https://micrograduate-book.github.io) builds on the works of [Andrej Karpathy](https://karpathy.ai/) (*check out* [Eureka Labs](https://eurekalabs.ai/)!) and [Jay Mody](https://jaykmody.com/):
- Neural Networks: Zero to Hero [lecture series](https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ) and [repo](https://github.com/karpathy/nn-zero-to-hero)
- [micrograd](https://github.com/karpathy/micrograd)
- [makemore](https://github.com/karpathy/makemore)
- [An Intuition for Attention](https://jaykmody.com/blog/attention-intuition/)
- [GPT in 60 lines of code](https://jaykmody.com/blog/gpt-from-scratch/)
- [picoGPT](https://github.com/jaykmody/pico-gpt)

It would not exist without their contributions. ❤️