# Is there a live model to track the example model of the new testset?

**URL:** <https://forum.numer.ai/t/is-there-a-live-model-to-track-the-example-model-of-the-new-testset/4231>\
**Category:** Tournament\
**Created:** [October 1, 2021, 6:35pm UTC](https://forum.numer.ai/t/is-there-a-live-model-to-track-the-example-model-of-the-new-testset/4231 "2021-10-01T18:35:29Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![nyuton](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/nyuton/32/687_2.png) [@nyuton](https://forum.numer.ai/u/nyuton)\
**Post date:** [October 1, 2021, 6:35pm UTC](https://forum.numer.ai/t/is-there-a-live-model-to-track-the-example-model-of-the-new-testset/4231/1 "2021-10-01T18:35:29Z")

</div>

Is there a live model to track the example model of the new testset?

---

<div class="post-metadata">

**Author:** ![rigrog](https://avatars.discourse-cdn.com/v4/letter/r/dec6dc/32.png) [@rigrog](https://forum.numer.ai/u/rigrog)\
**Post date:** [October 1, 2021, 9:20pm UTC](https://forum.numer.ai/t/is-there-a-live-model-to-track-the-example-model-of-the-new-testset/4231/2 "2021-10-01T21:20:28Z")

</div>

Over on the chat, someone said integration\_test\_7 switched to new (“super massive”) data on round 282, and then… switched back? Weird, if true.

Perhaps you could compare performance of “integration\_test\_N” (for every “N”) against performance of example\_predictions.csv (legacy version, and super-massive version). Just use 2 of your 50 model slots, to submit those (unstaked) from your account.

Or instead of example\_predictions.csv, you could run the example code that’s supposed to produce it.

Of course, if you were doing that, you would no longer _need_ integration\_test\_whatever.
