From Scratch
Implementations of research papers, books, and algorithms to understand them from first principles.
pmpp-cuda
Implementation of experiments and code from Programming Massively Parallel Processors.
smol-Llama
Implementation of the Llama architecture from scratch in PyTorch.
smolGPT-2
Implemented GPT-2 and Byte Pair Encoding (BPE) from scratch using PyTorch.
smolGPT
Implementation of the original GPT architecture from scratch using PyTorch.
transformer
Implementation of the Transformer architecture from scratch.
Neural-Style-Transfer
Neural Style Transfer using a pretrained VGG-19 implemented in PyTorch.
micrograd
Tiny scalar-valued autograd engine and neural network library built from scratch.
Recurrent-Neural-Networks
Implementations of vanilla RNNs for sequence modeling.
mnist-mlp
Multi-layer perceptron trained on MNIST using PyTorch.
iris-pytorch-nn
Feedforward neural network trained on the Iris dataset using PyTorch.