9  Fine-tuning with LoRA

Note

Status: not started

9.1 What I want to understand

• What is LoRA, and how is it different from full fine-tuning?
• How do I build training data without leaking test answers?
• Did it help on tasks it never saw?

9.2 What I tried

9.3 What I learned

9.4 Sources