Skip to main content

Explore Problems

Certifications Quiz Pricing

⌘K

Fine-Tuning & Model Customization

Course Contents

Prompting vs RAG vs Fine-Tuning — The Decision

Good Reasons to Fine-Tune

Bad Reasons to Fine-Tune

Fine-Tuning + RAG Together

Estimating Cost & Effort

How Training Actually Works (Backprop Recap)

The Memory Bottleneck & Memory Math

Numerical Precision & Quantization (GGUF/llama.cpp, GPTQ, AWQ)

Full Fine-Tuning vs PEFT

LoRA & QLoRA Explained

Fine-Tuning Hyperparameters & Tactics

Data Quality, Coverage & Quantity

Sourcing & Annotating Data

Synthetic Data Generation

Model Distillation

Cleaning, Dedup & Formatting

Hands-On: Build a Fine-Tuning Dataset

The Post-Training Pipeline: SFT → DPO → RL

Direct Preference Optimization (DPO)

Reasoning Fine-Tuning with GRPO

Model Merging (SLERP, TIES, DARE)

Evaluating a Fine-Tuned Model

Hands-On: Fine-Tune a Small Model with LoRA

Model Merging (SLERP, TIES, DARE)

Combine fine-tuned models into one with model merging — task vectors, interference, the ladder from linear merging to SLERP, TIES and DARE, mergekit in practice, and the limits of merging.

Loading...

Loading content...