New data V4 gives the target for test data. Sounds good but I am worried

For years I thought Numerai uses your model’s prediction on test data to determine the meta-model contribution. That’s why you need to submit a huge file each round. No one knows the target on the test set, perfect plan.

Now it’s no longer required on model submission. How are they gonna know how good the model is? My answer to this is we are no longer needed. Their model is good enough and doesn’t need our model anymore.

completely wrong :slight_smile:

We weight models based on their stakes. We don’t need to know how good a model is on the test set. It’s not as strong of a signal as stake. We trust you.

5 Likes

They never used it to determine metamodel contribution – they use the size of your stake.

1 Like