What is your submission automation cost?

I am thnking about submission automation in cloud.

I’m considering moving my submission code to Azure Functions Azure Functions Overview | Microsoft Learn. The cost is basically $0, I just haven’t gotten around to it yet.

1 Like

Does it have enough computational resources?
Similar service like GCP cloud functions has limatation for memory which is not suitable for training, I think.

Not for training, like not even close. Azure functions are limited too ~1.5GB of memory, which should be enough for most models to predict a single era. I think Google Cloud and AWS offer equivalent, but I don’t know what their limitations are.

1 Like

Don’t you update trained model with updated dataset?

I have a lot of older models that I’m afraid to retrain.

@jacob_stahl @ryo_matsuzaka

I have published an article describing “How I automated my Numerai weekly submission pipeline for free, using Azure functions and python”.

I think you will find it useful!

4 Likes

Thank you very much for the information! I absolutely check it.

I use Deepnote. I’m able to submit daily predictions using their notebook scheduler feature.

2 Likes

Thats a thing?
d63c1ef766f4d12f14127148d3c0e45a

But now the submission changed to email triggered, how the schedule will work ?

My submission automation cost it around 0.6 €/Month on Azure. It runs on a container instance that loads the models from a cloud storage, predicts and stores the results on the same cloud storage until the next round. It runs very fast since it only predicts using live data, so no training is performed.It takes the container about 90 seconds to run my 12 models.
My whole cloud infrastructure consist in the container instance, the cloud storage, one http trigger for the submissions, one http trigger for numerbay sales and two scheduled triggers, one for daily rounds and one for weekend rounds.
The only small detail is that my container image is hosted on a free private repository outside Azure, so that cost it is not accounted for. Actually, that image repository would be the most expensive resource, costing about 4.2€ per month. Although I would not be surprised if there are less expensive alternatives out there.

Edit: I forgot to mention that this represents the cost of daily and weekly predictions. Since this thread is relatively old, maybe I should remark that. I am bad at predictions, but been smoothly predicting daily since day 1 of daily predictions :sunglasses: :stuck_out_tongue_winking_eye:

1 Like