8  Running Gemma locally

Note

Status: not started

8.1 What I want to understand

  • Which Gemma 4 sizes fit on my machines, at what speed?
  • What does quantization cost in quality?

8.2 What I tried

8.3 What I learned

8.4 Sources