← back to curriculum github ↗

phase 17

Infrastructure And Production

28 lessons · click any to read the docs

phase progress

0/ 28 lessons · 0%

Managed Llm Platforms

01-managed-llm-platforms

Inference Platform Economics

02-inference-platform-economics

Gpu Autoscaling Kubernetes

03-gpu-autoscaling-kubernetes

Vllm Serving Internals

04-vllm-serving-internals

Eagle3 Speculative Decoding

05-eagle3-speculative-decoding

Sglang Radixattention

06-sglang-radixattention

Tensorrt Llm Blackwell

07-tensorrt-llm-blackwell

Inference Metrics Goodput

08-inference-metrics-goodput

Production Quantization

09-production-quantization

Cold Start Mitigation

10-cold-start-mitigation

Multi Region Kv Locality

11-multi-region-kv-locality

12-edge-inference

Llm Observability

13-llm-observability

Prompt Semantic Caching

14-prompt-semantic-caching

16-model-routing

Disaggregated Prefill Decode

17-disaggregated-prefill-decode

Vllm Production Stack Lmcache

18-vllm-production-stack-lmcache

Shadow Canary Progressive

20-shadow-canary-progressive

Ab Testing Llm Features

21-ab-testing-llm-features

Load Testing Llm Apis

22-load-testing-llm-apis

Chaos Engineering Llm

24-chaos-engineering-llm

Security Secrets Audit

25-security-secrets-audit

Compliance Frameworks

26-compliance-frameworks

Self Hosted Serving Selection

28-self-hosted-serving-selection