Skip to content
Road to AI
GPTs and LLMs
Initializing search
Home
Neural Networks
Library
Blog
Road to AI
Home
Neural Networks
Neural Networks
Zero to Hero Series
Backpropagation
Backpropagation
Micrograd
Lecture Notes
Lecture Notes
Master Notes
Micrograd Functionality
Value Object Creation
Crux Node Backpropagation
Neurons Explaination
Expanding tanh and adding more operations
PyTorch Comparison
Multi-Layer Perceptron
Notebooks
Notebooks
Derivative Simple Function
Derivative Function with Multiple Inputs
Graph Visualisation
Value Object
Manual Backpropagation-0
Manual Backpropagation-1
Manual Backpropagation-2
Optimization Single Step Preview
Backpropagation Neuron
Backpropagation Neuron - Manual Calculation
Backward Function - Each operation
Backward Function - Entire Graph
Handing one node used multiple times
Expanding tanh into more operations
Implementing in PyTorch
Creating a MLP
Creating a Loss function
Collecting all parameters in Neural Net
Manual Gradient Descent Optimization
Language Model-1
Language Model-1
Makemore Part 1
Set A
Set A
Lecture Notes
Jupyter Notebook
Set B
Set B
Lecture Notes
Jupyter Notebook
Set C
Set C
Lecture Notes
Jupyter Notebook
Language Model-2
Language Model-2
Makemore Part 2
Set A
Set A
Lecture Notes
Jupyter Notebook
Set B
Set B
Lecture Notes
Jupyter Notebook
Set C
Set C
Lecture Notes
Jupyter Notebook
Language Model-3
Language Model-3
Makemore Part 3
Notes and Codes
Notes and Codes
Lecture Notes
Starter Code
Jupyter Notebook
Visualization Code
Language Model-4
Language Model-4
Makemore Part 4
Notes and Codes
Notes and Codes
Exercise 1
Exercise 2
Exercise 3
Final code
Language Model-5
Language Model-5
Makemore Part 5
Notes and Codes
Notes and Codes
Lecture Notes
Jupyter Notebook
GPT-1
GPT-1
Transformer Model-1
Codes Implemented
Codes Implemented
Notebook Implemented
Bigram Script Breakdown
GPT-2
GPT-2
Transformer Model-2
Implementation Notebooks
Implementation Notebooks
Section 0
Section 1(a)
Section 1(b)
Section 2(a)
GPT-Tokenizer
GPT-Tokenizer
Tokenizer
General MISC
General MISC
Intro to LLMs
Deep Dive into LLMs
Library
Library
Overview
AI Engineering
AI Engineering
Introduction to AI Engineering
Prompt Engineering
Retrieval Augmented Generation
AI Agents
Blog
Blog
Index
Categories
Categories
GPTs and LLMs
MCP
GPTs and LLMs
¶
October 7, 2025
in
GPTs and LLMs
16 min read
The Journey of Optimization
Continue reading
October 1, 2025
in
GPTs and LLMs
7 min read
Private GPT on Linux/WSL
Continue reading
Back to top
