Data download size

Feedback
1

Is there a way to download just the new data each week, instead of the whole 400MB?

And for Signals?

2

  1. It’s only a little time (minute or so to download) that’s wasted, since you can throw away the redundant portion (taking a bit more time).

  2. I think the whole interface/API for downloading is about to be overhauled, for the upcoming 10X of data. Maybe they’ll do something right.

3

This 600 KB file may be what you are looking for: https://numerai-public-datasets.s3-us-west-2.amazonaws.com/latest_numerai_live_data.csv.xz

The public datasets index is visible if you want to see what else numerai publishes each week.

2 Likes
4

Thanks @degerhan! That looks interesting, I’ll take a look.