Course curriculum

  • 1
    Foundations of LLMOps
    • What is LLMOps?
    • Why LLMOps Exists
    • LLM Application Lifecycle
    • Components of the LLMOps Stack
    • LLMOps Roles and Responsibilities
    • Hosted v/s Self Hosted LLM Models
    • Quiz
  • 2
    LLM Architecture & Model Choices
    • Real-World Problem Statement
    • Deep Dive into LLM Architecture
    • Hosted API Models vs Open-Source Models (vLLM)
    • Quiz
  • 3
    Building Production-Ready LLM Systems
    • Introduction
    • Environment Setup & Production Folder Structure
    • Config-Driven LLM & Embedding Management
    • Reliability, Guardrails & Governance Layer
    • Multi-LLM Integration & Provider Abstraction
    • Prompt Engineering with Version Control
    • End-to-End RAG Pipeline
    • Evaluation Layer: Structured Output & LLMOps Signals
    • Quiz
  • 4
    Production & Scaling in LLMOps
    • Hands On: Improve Reliability with Retrieval Grounding
    • Hands On: LLM Runtime patterns
    • Scaling Concepts
    • Cloud Deployment
    • Quiz
  • 5
    Monitoring, Evaluation & Guardrails
    • Monitoring Essentials
    • Evaluation - Measuring Answer Quality Over Time
    • Guardrails & Feedback Loop
    • Operational Signals - Drift, Governance, and Improvement
    • Quiz