Course curriculum
-
1
Overview of LLMOps
- Course Handouts
- Introduction to LLMOPs
- Important: Course Estimation and Resource Management
- CICD Pipelines
- Introduction to AWS Services
- Quiz
- Module Recap
-
2
AWS SageMaker for Data Scientists
- Introduction to SageMaker
- Setup SageMaker on AWS
- SageMaker Studio Walkthrough
- Quiz
- Module Recap
-
3
LangChain for Continuous Integration
- Introduction to LangChain
- LangChain for Continuous Integration
- Hand-on Session on LangChain (Part 1)
- Hand-on Session on LangChain (Part 2)
- Hand-on Session on LangChain (Part 3)
- Hand-on Session on LangChain (Part 4)
- Hand-on Session on LangChain (Part 5)
- Quiz
- Module recap
-
4
Langfuse for CICD
- Introduction to Langfuse
- Using Langfuse for Monitoring
- Hands-on Session on Langfuse (Part-1)
- Hands-on Session on Langfuse (Part-2)
- Hands-on Session on Langfuse (Part-3)
- Hands-on Session on Langfuse (Part-4)
- Quiz
- Module Recap
-
5
SageMaker Pipelines
- SageMaker Deep Dive
- SageMaker for Model Training
- Project Introduction
- Hands-on SageMaker Studio Dataset Creation
- Hands-on SageMaker Studio Training
- Hands-on Session on SageMaker Deployment
- SageMaker Training Pipelines
- Hands-on Pipeline Introduction
- Hands-on Model Training
- Hands-on Model Evaluation
- Hands-on Conditional Step Execution
- Hands-on Pipeline Execution
- Quiz
- Module Recap
-
6
Continuous Deployment
- CD for LLMs
- LLM Optimization
- Deployment Solutions
- Advance Deployment Solutions
- SageMaker End Points part-1
- SageMaker End Points part-2
- Project Overview
- LoRA Serving Multiple Adapters in One Model
- Quiz
- Module Recap
-
7
Kubernetes for Continuous Deployment
- Introduction to kubernetes
- Kubernetes Components
- Project Introduction
- Hands On - Kubernetes Installation
- Hands On - Kubernetes Setup
- Hands On - Deploying LoRAX in Kubernetes
- Autoscaling in Kubernetes
- Hands-on Session Autoscaling with HPA
- Quiz
- Module Recap
-
8
Real World Testing
- Introduction to Load Testing
- Project Overview
- Creating Virtual Users and Test Bench
- Hands-on Session with Locust
- Quiz
- Full Course Recap