EffNine · Open Toolkit

LLM TRAINING
& ENGINEERING
T O O L K I T

Learn LLMs. Build them. Train them. Evaluate them. Scale them.

Start here — pick one path

01 · START FROM ZERO
02 · BUILD SOMETHING 03 · PLAN A TRAINING RUN
All tools (VRAM, GPU, model, tokens, data, eval…)
CHECK MY GPU CALCULATE VRAM BROWSE KNOWLEDGE MODEL DESIGNER TOKEN BUDGET INFERENCE MEM DATA PIPELINE EVAL PLANNER

THE PATH

The full journey, end to end. Get a personalized roadmap →

0
Zero Knowledge
Programming, Linux, math fundamentals
1
Foundations
Python, NumPy, linear algebra, calculus
2
Machine Learning
Optimization, regularization, evaluation
3
Deep Learning
PyTorch, tensors, neural networks, training loops
4
Transformers
Attention, RoPE, decoder-only architecture
5
Tokenizers
BPE, SentencePiece, vocabulary design
6
Tiny LM
Train a character-level model from scratch
7
Small LLM
10M → 100M parameter transformer
8
Fine-Tuning
SFT, LoRA, QLoRA, DPO
9
Evaluation
Benchmarks, perplexity, contamination
10
Optimization
Mixed precision, memory, throughput
11
Multi-GPU
Data parallelism, FSDP, ZeRO
12
Deployment
Inference, serving, quantization

WHAT DO YOU WANT TO DO? — BY TASK

Learn LLMs
Follow the curriculum from zero
Build My Roadmap
Personalized learning path
Plan a Training Run
Configuration & estimates
Check My GPU
Hardware compatibility
Calculate VRAM
Memory requirements estimator
Training Methods
Pretraining, fine-tuning, LoRA
Model Designer
Architecture calculator
Hands-on Projects
Build real LLMs step by step
Troubleshoot
OOM, NaN, slow training

FEATURED INTERACTIVE TOOLS — BY TOOL

Calculator

VRAM Estimator

Estimate memory requirements for your training configuration. Shows weight, gradient, optimizer, and activation breakdown.
Database

GPU Architecture

Structured database of GPU architectures, specifications, and training suitability ratings.
Calculator

Model Designer

Design transformer architectures or reverse-engineer parameters from target size.
Decision Tree

Training Method Selector

Answer questions about your goal and hardware to get a recommended training approach.
Calculator

Token Budget

Calculate training steps or estimate token targets from model size using scaling heuristics.
Planner

Data Pipeline

Generate a customized dataset processing pipeline from collection to versioning.