Step 1: TheoryResearch Paper
LoRA: Low-Rank Adaptation of LLMs
Study the core concepts and background material for this learning item.
Step 2: PracticeKaggle Workbook
Fine-tuning Gemma KerasNLP Exercise
Solve the challenges and apply your knowledge interactively.
Hard30 min estimated study
Overview
Fine-tune Gemma-2b parameters using low-rank adapters.
Learning Objectives
- Build LoRA adapter matrices
- Train open models with KerasNLP
Prerequisites
Item #71Word Vectors & Embeddings
LockedTracking Control
Completion Reward+300 XP
Study Checklist
Studied theory resource
Completed practice exercise