Course curriculum
-
1
Introduction to the Course
- Introduction and Course Summary
-
2
Introduction to Finetuning LLMs
- Why and What is Finetuning LLMs?
- Course Handouts - Updated on 2024-12-09
- Quiz
-
3
Instruction Finetuning in Practice
- Module Overview
- Finetuning Process
- Data gathering and preprocessing
- Training
- Evaluation
- Setting up the runpod instance
- Full Finetuning LLM to follow instructions
- Limitations of Full Finetuning
- Quiz
-
4
Parameter-Efficient Finetuning (PEFT)
- Why Parameter Efficient Finetuning?
- What is Parameter Efficient Finetuning?
- Different types of PEFT methods
- Quiz
-
5
Prompt Learning PEFT Techniques
- Overview of Prompt Learning PEFT Techniques
- Prompt Tuning
- Text Classification on Twitter Complain Dataset using Prompt Tuning (Part-1)
- Text Classification on Twitter Complain Dataset using Prompt Tuning (Part-2)
- Prefix Tuning
- Adaptation Prompt tuning
- Adaptation Prompt Tuning for Product Ad Generation
- Quiz
-
6
Popular PEFT methods in practice
- LoRA and its variants
- Hinglish Instruct Finetuning using LoRA
- Assignment - LoRA
- Quantization and QLoRA
- Function Calling using QLoRA
- Assignment - QLoRA
- IA3 and Bottleneck adapters
- Natural Language to SQL query generation using IA3
- Quiz
- Share your experience!