# Legacy Data Expiration **URL:** \ **Category:** Tournament\ **Created:** [October 1, 2021, 3:29pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229 "2021-10-01T15:29:18Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![thekizoch](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/thekizoch/32/1403_2.png) [@thekizoch](https://forum.numer.ai/u/thekizoch)\ **Post date:** [October 1, 2021, 3:29pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/1 "2021-10-01T15:29:18Z")
Is there a timeline estimation for when the legacy dataset will be fully deprecated and unsubmittable? ---
**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\ **Post date:** [October 2, 2021, 2:40am UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/2 "2021-10-02T02:40:58Z")
i hope no. not everyone is ready to move to mass data set. ---
**Author:** ![jxtrbtk](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/jxtrbtk/32/2758_2.png) [@jxtrbtk](https://forum.numer.ai/u/jxtrbtk)\ **Post date:** [October 3, 2021, 9:47am UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/3 "2021-10-03T09:47:02Z")
up ! I’d like to know also… ---
**Author:** ![wigglemuse](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/wigglemuse/32/3094_2.png) [@wigglemuse](https://forum.numer.ai/u/wigglemuse)\ **Post date:** [October 3, 2021, 4:09pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/4 "2021-10-03T16:09:55Z")
They have said it would be many months at least, and you’ll get plenty of notice. There is no scheduled date (that has been made public anyway). I’m assuming they will wait until legacy data submissions have tapered off quite a bit… ---
**Author:** ![mic](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/mic/32/2949_2.png) [@mic](https://forum.numer.ai/u/mic)\ **Post date:** [October 3, 2021, 10:04pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/5 "2021-10-03T22:04:09Z")
and maybe the relative performance of legacy data submissions ---
**Author:** ![kmtk49](https://avatars.discourse-cdn.com/v4/letter/k/a9a28c/32.png) [@kmtk49](https://forum.numer.ai/u/kmtk49)\ **Post date:** [October 24, 2021, 1:34am UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/6 "2021-10-24T01:34:45Z")
FYI [http://forum.numer.ai/t/october-2021-updates/4384](http://forum.numer.ai/t/october-2021-updates/4384) ---
**Author:** ![dev0n](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/dev0n/32/3389_2.png) [@dev0n](https://forum.numer.ai/u/dev0n)\ **Post date:** [December 21, 2021, 9:25pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/7 "2021-12-21T21:25:13Z")
Do they have enough info to distinguish legacy uploads from new data uploads? I don’t think they do… If I’m right maybe we should have users tag their model bio with #legacy so they can see which models are still using legacy data. (I’ve gone ahead and done that for numer.ai/dev0n and numer.ai/dev1n) It would be a shame if they turned off legacy and were surprised by how much value the legacy models are still providing to the metamodel. ---
**Author:** ![yxbot](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/yxbot/32/2906_2.png) [@yxbot](https://forum.numer.ai/u/yxbot)\ **Post date:** [December 22, 2021, 11:07am UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/8 "2021-12-22T11:07:11Z")
in my view, the 6 millions dollar questions is whether new models are better than legacy models. if models trained on new data really do prove to be consistently outperforming models trained on legacy data, then for sure they can retire the legacy dataset and we should all be happy about it. However, my baseline assumption is that at least you need 1 year worth of live performance - i.e. 3 times the 20 round window - to decide that. So I think it is reasonable to at least keep the legacy dataset for 1 year. beyond that, it should be depend on new/legacy model’s relative performance, and meta model performance with/without legacy models. ---
**Author:** ![platemort](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/platemort/32/1143_2.png) [@platemort](https://forum.numer.ai/u/platemort)\ **Post date:** [December 22, 2021, 10:00pm UTC](https://forum.numer.ai/t/legacy-data-expiration/4229/9 "2021-12-22T22:00:00Z")
I agree that the relative performance needs to be evaluated over a long period. Here is a plot of the last 6 months of resolved rounds. The two models are different, but had similar performance until one model switched over to the super massive dataset. I would be interested if others are seeing different results, but this doesn’t look promising so far. ![image](https://canada1.discourse-cdn.com/flex009/uploads/numerai/original/2X/7/713275c722f3fadb5d9048cc8e0f5aa0d50cf465.jpeg)