Course curriculum

  • 1
    Introduction to the Course
    • Introduction and Course Summary
  • 2
    Introduction to Finetuning LLMs
    • Why and What is Finetuning LLMs?
    • Course Handouts - Updated on 2024-05-21
    • Quiz
  • 3
    Instruction Finetuning in Practice
    • Module Overview
    • Finetuning Process
    • Data gathering and preprocessing
    • Training
    • Evaluation
    • Setting up the runpod instance
    • Full Finetuning LLM to follow instructions
    • Limitations of Full Finetuning
    • Quiz
  • 4
    Parameter-Efficient Finetuning (PEFT)
    • Why Parameter Efficient Finetuning?
    • What is Parameter Efficient Finetuning?
    • Different types of PEFT methods
    • Quiz
  • 5
    Prompt Learning PEFT Techniques
    • Overview of Prompt Learning PEFT Techniques
    • Prompt Tuning
    • Text Classification on Twitter Complain Dataset using Prompt Tuning (Part-1)
    • Text Classification on Twitter Complain Dataset using Prompt Tuning (Part-2)
    • Prefix Tuning
    • Adaptation Prompt tuning
    • Adaptation Prompt Tuning for Product Ad Generation
    • Quiz
  • 6
    Popular PEFT methods in practice
    • LoRA and its variants
    • Hinglish Instruct Finetuning using LoRA
    • Assignment - LoRA
    • Quantization and QLoRA
    • Function Calling using QLoRA
    • Assignment - QLoRA
    • IA3 and Bottleneck adapters
    • Natural Language to SQL query generation using IA3
    • Quiz
    • Share your experience!