Lagacy Predictions

Tournament
1

Hello,

I tried today to upload my legacy predictions but the upload link is not there any more. Have it been removed or that was just an error?

Any one, please? Thank you.

2

We removed it but you can still upload legacy predictions just use the main upload button (works for new and legacy now).

1 Like
3

Thank you for your response, Richard.

I tried but and got the following error:
ā€œInvalid submission headers. Headers must be id and prediction.ā€

Have the expected format changed?

And I also, tried the suggested header: "id, ā€œprediction,ā€ then I got another error saying:
ā€œYou must provide predictions for ALL live IDs. Make sure you are using the latest live data.ā€

I had to upload my new model on the new data for now, but it is still experimental, and I would like to be able to upload my legacy prediction until I am comfortable with the new model.

Any suggestion, please? Once again, thank you Richard.

4

Hey, ihab, legacy predictions are still accepted; I am able to upload the old example predictions and an old legacy model is still successfully submitting. Although the recent switch stopped accepting some of the very old column names, the live IDs its checking havenā€™t changed between dataset versions. Are you sure that your legacy model is predicting on live IDs? I recommend double checking the live tournament data file and the example predictions files.

5

Hello @ark
Thank you for your reply.

I have been submitting predictions from my same models for many months now and have not changed anything at all.

All the sudden they stopped validating this week, coincidentally with the change on Numer.ai.

6

I had the same problem, the name of the columns of the submitting predictions has to be ā€˜idā€™, ā€˜predictionā€™

7

Apologies for this issue. Moving forward Iā€™ll be adding more tests to our system to prevent accidental depreciation of prediction headers in the future. @ihab Iā€™m going to DM you about the Live ID issue. The Live IDs havenā€™t changed so Iā€™d like to get more information on this.

8

Thank you @ark

I will respond to your DM now.

9

Hey @ark,
I responded to your DM but it bounced back undeliverable.

here is what I tried to email you:
I download the data every week as I always have, through the numerai api and not manually.
Also,I have not touched my models for quite some time.
My workflow for getting the data and generating my predictions have not changed for months. Thank you.