5  Evaluation

Note

Status: not started

5.1 What I want to understand

  • How does SWE-Bench-style scoring work?
  • Can my local score predict the Kaggle score?
  • How many runs before a difference is real?

5.2 What I tried

5.3 What I learned

5.4 Sources