← curriculum/phase 12 · Multimodal Ai

edit on github ↗

← all lessons in phase

phase 12 · 25 lessons

01Vision Transformer Patch Tokens
02Clip Contrastive Pretraining
03Blip2 Qformer Bridge
04Flamingo Gated Cross Attention
05Llava Visual Instruction Tuning
06Any Resolution Patch N Pack
07Open Weight Vlm Recipes
08Llava Onevision Single Multi Video
09Qwen Vl Family Dynamic Fps
10Internvl3 Native Multimodal
11Chameleon Early Fusion Tokens
12Emu3 Next Token For Generation
13Transfusion Autoregressive Diffusion
14Show O Discrete Diffusion Unified
15Janus Pro Decoupled Encoders
16Mio Any To Any Streaming
17Video Language Temporal Grounding
18Long Video Million Token
19Audio Language Whisper To Af3
20Omni Models Thinker Talker
21Embodied Vlas Openvla Pi0 Groot
22Document Diagram Understanding
23Colpali Vision Native Rag
24Multimodal Rag Cross Modal
25Multimodal Agents Computer Use

‹

›

phase 12 · lesson 05 of 25

Llava Visual Instruction Tuning

05-llava-visual-instruction-tuning·full lesson folder ↗

Flamingo Gated Cross Attention

complete & next →

Any Resolution Patch N Pack