Fine Tuning Large Language Models

About this course

Fine-tune large language models for your domain. Over three days you will curate and clean raw data, understand the transformer architecture, tokenisation and word embeddings, and fine-tune models with PyTorch.

What you'll learn

• Clean and Curate Data for AI Fine-Tuning
• Establish guidelines for obtaining RAW Data
• Go from Drowning in Data to Clean Data
• Fine-Tune AI Models with PyTorch
• Understand AI architecture: Transformer model
• Describe tokenization and word embeddings
• Install and use AI frameworks like Llama-3
• Perform LoRA and QLoRA Fine-Tuning
• Explore model quantization and fine-tuning
• Deploy and Maximize AI Model Performance

Curriculum

Who it's for

Developers, ML engineers and data scientists with some Python experience.

Before you start

• Experience using Python is recommended