# Automated numerai submission with Notebook

**URL:** <https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716>\
**Category:** Tournament\
**Created:** [September 25, 2022, 10:19pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716 "2022-09-25T22:19:00Z")\
**Posts on this page:** 18\
**Page:** 1

<div class="post-metadata">

**Author:** ![zwk](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/zwk/32/2302_2.png) [@zwk](https://forum.numer.ai/u/zwk)\
**Post date:** [September 25, 2022, 10:19pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/1 "2022-09-25T22:19:00Z")

</div>

hello all, I’d like to share a new discovered platform [https://deepnote.com](https://deepnote) for those who are using jupyter notebook for weekly submission.  
The biggest advantage is that one can migrate easily the notebook to the cloud, together with all neccessary model files, scripts, environment variables, etc. All config takes about \<5 min.  
Once setup, one can schedual the notebook execution with the schedualer.  
In terms of pricing, under basic hardware environment (2.5G ram/5G space), it’s all free (it’s adequate for my prediction process). Of course, one can choose to upgrade to performing environment for demanded calculation (like model training) with full transparent hourly fees.  
Hopefully this can help people to alleviate the submission with physical machine.

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [October 22, 2022, 11:55pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/2 "2022-10-22T23:55:51Z")

</div>

Thanks for sharing. How is your experience after using it for a while ?

---

<div class="post-metadata">

**Author:** ![zwk](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/zwk/32/2302_2.png) [@zwk](https://forum.numer.ai/u/zwk)\
**Post date:** [October 23, 2022, 7:23pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/3 "2022-10-23T19:23:05Z")

</div>

It works smoothly since day one. It’s simple and easy to configurate if you are working with notebook.  
Once the job is scheduled, the life cannot be easier.

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [October 27, 2022, 7:41am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/4 "2022-10-27T07:41:48Z")

</div>

@zwk hi, your post coming at right timing. i start to use deepnote to submit my prediction daily for both main and signal. thanks

---

<div class="post-metadata">

**Author:** ![zwk](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/zwk/32/2302_2.png) [@zwk](https://forum.numer.ai/u/zwk)\
**Post date:** [October 27, 2022, 1:55pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/5 "2022-10-27T13:55:13Z")

</div>

Indeed! Glad it works well for you! The only missing point for schedular is to have webhook trigger, for which I have submitted a request to their Dev, hopefully can have it soon!

---

<div class="post-metadata">

**Author:** ![sunkay](https://avatars.discourse-cdn.com/v4/letter/s/6f9a4e/32.png) [@sunkay](https://forum.numer.ai/u/sunkay)\
**Post date:** [October 30, 2022, 1:28pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/6 "2022-10-30T13:28:24Z")

</div>

Thanks for sharing. It’s very easy to set up deepnote

---

<div class="post-metadata">

**Author:** ![mattiasl](https://avatars.discourse-cdn.com/v4/letter/m/85e7bf/32.png) [@mattiasl](https://forum.numer.ai/u/mattiasl)\
**Post date:** [November 14, 2022, 9:41am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/7 "2022-11-14T09:41:07Z")

</div>

I’m using google colab pro+ which also has a scheduler. It works very well. The only downside is that you need to download all the data and re-train the model every time (you can’t save/download a pickled model, and you need to redownload universe and targets from Numerai server every time you run it).

Files can be downloaded from and saved to your google drive but unfortunately google doesn’t allow you to do that without authenticating and giving permission in person when you start the notebook. Therefore the google drive seems to be inaccessible while using the scheduler.

Also, the google scheduler is limited to 13 days ahead (which is good enough for my purposes).

---

<div class="post-metadata">

**Author:** ![shatteredx](https://avatars.discourse-cdn.com/v4/letter/s/ee59a6/32.png) [@shatteredx](https://forum.numer.ai/u/shatteredx)\
**Post date:** [November 14, 2022, 2:39pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/8 "2022-11-14T14:39:55Z")

</div>

You may actually be able to auto-mount google drive per Colab notebook. It seems to work for me.

First, you need to create a blank notebook first (don’t copy or save as) that isn’t shared.

Then, mount Google drive using the file browser. After that, it should auto-mount. Not sure how reliable this method is but it seems to work right now.

> <https://stackoverflow.com/questions/52808143/colab-automatic-authentication-of-connection-to-google-drive-persistent-per-n>

Not sure if this works with the scheduler though.

---

<div class="post-metadata">

**Author:** ![mattiasl](https://avatars.discourse-cdn.com/v4/letter/m/85e7bf/32.png) [@mattiasl](https://forum.numer.ai/u/mattiasl)\
**Post date:** [November 15, 2022, 2:29am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/9 "2022-11-15T02:29:45Z")

</div>

Thank you so much! I’ve just given it a try and it works

I’ve been mounting programmatically in the start of my programs which necessitated an online approval:

 ![image](https://canada1.discourse-cdn.com/flex009/uploads/numerai/original/2X/3/3c0755ac599cc8c89e4ab0d95da199c00fc3565b.png)

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [December 4, 2022, 3:49am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/10 "2022-12-04T03:49:13Z")

</div>

Daily submission need to upgrade to event driven, rather than schedule. Any new cloud notebook support that new demand?

---

<div class="post-metadata">

**Author:** ![zwk](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/zwk/32/2302_2.png) [@zwk](https://forum.numer.ai/u/zwk)\
**Post date:** [December 4, 2022, 5:44pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/11 "2022-12-04T17:44:59Z")

</div>

Indeed, we’ll need to hire an intern to click the button 😄

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [December 6, 2022, 3:18am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/12 "2022-12-06T03:18:18Z")

</div>

actually, the intern is myself. i start checking my email regularly and click the button if i saw the message 🙂

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [December 8, 2022, 2:13am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/13 "2022-12-08T02:13:59Z")

</div>

For those who like to use telegram to get a notification from Numerai, pls feel free to join following telegram group.

---

<div class="post-metadata">

**Author:** ![autratec](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@autratec](https://forum.numer.ai/u/autratec)\
**Post date:** [December 8, 2022, 4:58am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/14 "2022-12-08T04:58:44Z")

</div>

hi. i just close my telegram group and change to channel. please use the following linkage:

> **[Numerai Daily](https://t.me/numeraidaily)**
>
> Provide open notification of NUMERAI daily prediction submission window.

---

<div class="post-metadata">

**Author:** ![svendaj](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/svendaj/32/3285_2.png) [@svendaj](https://forum.numer.ai/u/svendaj)\
**Post date:** [December 8, 2022, 4:21pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/15 "2022-12-08T16:21:56Z")

</div>

I am using Kaggle both for learning and submissions and because they now provide for free notebooks with 4 CPU cores and 30GB RAM and I am lazy person to go elsewhere, [I have created workaround using Oracle Cloud compute node (always free! 😉), installed Kaggle public API, running `cron` triggering execution of Kaggle notebooks](https://www.kaggle.com/discussions/product-feedback/371090) at expected round openning. Inside of the [notebooks I wait for openning of given round](http://forum.numer.ai/t/server-errors-on-friday/5883/5).

---

<div class="post-metadata">

**Author:** ![lcrmorin](https://avatars.discourse-cdn.com/v4/letter/l/f1d935/32.png) [@lcrmorin](https://forum.numer.ai/u/lcrmorin)\
**Post date:** [March 23, 2023, 12:53pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/20 "2023-03-23T12:53:00Z")

</div>

At this point why not use the kaggle scheduler ?

---

<div class="post-metadata">

**Author:** ![svendaj](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/svendaj/32/3285_2.png) [@svendaj](https://forum.numer.ai/u/svendaj)\
**Post date:** [March 24, 2023, 12:35am UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/21 "2023-03-24T00:35:32Z")

</div>

Kaggle scheduler is very rudimentary and allows only daily, weekly or monthly frequency without possibility to set time for execution. So for numerai purposes useless.

---

<div class="post-metadata">

**Author:** ![svendaj](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/svendaj/32/3285_2.png) [@svendaj](https://forum.numer.ai/u/svendaj)\
**Post date:** [March 25, 2023, 7:33pm UTC](https://forum.numer.ai/t/automated-numerai-submission-with-notebook/5716/22 "2023-03-25T19:33:16Z")

</div>

I have just finished [python Flask server processing numerai compute webhook and launching Kaggle notebooks.](https://www.kaggle.com/discussions/questions-and-answers/397468) Server runs in Oracle Cloud (always free 😉 and up and running 24x7), but it can be built even locally and ngrok would provide you with public entrypoint.