maybe stupid question, but how do you upload the submission through the API with the new dataset?
I could do it without any hassle with the old dataset. Now I get this error:
ValueError: Test prediction ids do not match. IDs must match current tournament data exactly, including ordering. Make sure you are using the latest tournament data.
When I upload the same file manually, it works, so I guess something is wrong with my scripts…
The example script doesn’t contain automated submission either.
Add version=2 to the submission parameters, ala
submission_id = napi.upload_predictions("predictions.csv", model_id=model_id, version=2)
omg THANK YOU SO MUCH I SPENT LIKE TWO HOURS TRYING TO FIGURE THIS OUT.
Thought I was losing my mind last night. Thanks for posting this!
Looks like I was not the only one looking for this info.
anyway to upload new validation diagnostic using numerapi?
It’s almost the same command as uploading submissions (no version parameter necessary):
submission_id = napi.upload_diagnostics("predictions.csv", model_id=model_id)
thank you for saving a lot of my time