LoRA Fine-Tune a Chat Model

Load a 4-bit Qwen model, attach LoRA adapters, format instructions, run SFT, and generate with the tuned model.

Easy1.7 hours20 steps

Overview

Load a 4-bit Qwen model, attach LoRA adapters, format instructions, run SFT, and generate with the tuned model.

What you'll learn

Fine-tuning Data formatting Inference

FULL WALKTHROUGH

Learn every step on its own page

This project is no longer compressed into a few chapters. Open the dedicated learning workspace for a lesson-by-lesson explanation with concepts, MathJax mathematics, code, tests, mistakes, checkpoints, and persistent navigation.

Open 20-step walkthrough →

Build progress

0 / 20 steps0%

Move the tracker as you finish the original Deep-ML steps. Reaching 100% unlocks the completion action and certificate.

Architecture

Work through the system one dependable layer at a time. Each stage feeds the next and remains independently testable.

01QLoRA→

02SFT→

03Quantization

∑

Mathematics & visual explanation

Translate the core equations into code, validate intermediate tensors, and compare the implementation with a small numerical reference.

objective(θ) = data_term(θ) + λ · regularization(θ)

The exact objective evolves with each milestone. Keep a notebook of shapes, invariants, and numerical checks.