Is it correct that the validation set does not shift every week? I’d expect us to validate (partially) on new data from last week but this doesn’t appear to be the case.
No. Richard said, that they want to add more eras to the validation set every 6 months.
So, you don’t have to retrain your models every week.