# Automating Rust

**URL:** https://forum.numer.ai/t/automating-rust/6642
**Category:** Tournament
**Created:** [September 2, 2023, 7:53am UTC](https://forum.numer.ai/t/automating-rust/6642 "2023-09-02T07:53:15Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![liborty](https://avatars.discourse-cdn.com/v4/letter/l/b4bc9f/32.png) [@liborty](https://forum.numer.ai/u/liborty)
#### Post date: [September 2, 2023, 7:53am UTC](https://forum.numer.ai/t/automating-rust/6642/1 "2023-09-02T07:53:15Z")

</div>

I have been running Rust since the beginning. I have shell script cron automation on my local machine but sometimes deadlines get missed, for example because of internet connection problems. I wonder if there is any way of making use of the compute lite beta? It can be done. I am able to run Rust securely for example on github actions. All the instructions on numerai, however, seem to assume that we run interpreted (slow) Python.

---

<div class="post-metadata">

### Author: ![numerologist](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/numerologist/32/2824_2.png) [@numerologist](https://forum.numer.ai/u/numerologist)
#### Post date: [September 3, 2023, 5:48pm UTC](https://forum.numer.ai/t/automating-rust/6642/2 "2023-09-03T17:48:06Z")

</div>

I don’t think you’ll get a good response here, the dominant majority uses Python with some using R too.

But if you are determined, [GitHub - PyO3/pyo3: Rust bindings for the Python interpreter](https://github.com/PyO3/pyo3) might be worth looking into. No guarantees that it will work out the way you expect though.

Also, note that compute-lite is currently not well supported. See [Discord](https://discord.com/channels/894652647515226152/1145904192553226351/1146504225858265250)

---

<div class="post-metadata">

### Author: ![liborty](https://avatars.discourse-cdn.com/v4/letter/l/b4bc9f/32.png) [@liborty](https://forum.numer.ai/u/liborty)
#### Post date: [September 4, 2023, 2:16am UTC](https://forum.numer.ai/t/automating-rust/6642/3 "2023-09-04T02:16:35Z")

</div>

I am more likely to go the other way and to use Parquet reader etc. directly from Rust. Still no server automation though.

---

<div class="post-metadata">

### Author: ![quantverse](https://yyz1.discourse-cdn.com/flex009/user_avatar/forum.numer.ai/quantverse/32/2022_2.png) [@quantverse](https://forum.numer.ai/u/quantverse)
#### Post date: [September 4, 2023, 4:30pm UTC](https://forum.numer.ai/t/automating-rust/6642/4 "2023-09-04T16:30:52Z")

</div>

Kudos for trying to use Rust to implement Numerai pipeline! I develop in Rust on a daily basis yet I still use Python for Numerai mainly for historical and compatibility reasons. But for instance [polars](https://www.pola.rs/) looks to be a great replacement for pandas (and it should handle reading parquet files natively), so maybe I will move to Rust with my pipelines as well one day…

About automation - I would just pack your whole pipeline as a simple docker image (so compiling your Rust binaries will be part of the Dockerfile) and then use Amazon ECS & Fargate to schedule and run the container appropriately.

Some example how you could containerize your Rust programs: [Getting Started with Rust and Docker – Collabnix](https://collabnix.com/getting-started-with-rust-and-docker/)

Good luck!

---

<div class="post-metadata">

### Author: ![liborty](https://avatars.discourse-cdn.com/v4/letter/l/b4bc9f/32.png) [@liborty](https://forum.numer.ai/u/liborty)
#### Post date: [September 5, 2023, 3:12am UTC](https://forum.numer.ai/t/automating-rust/6642/5 "2023-09-05T03:12:09Z")

</div>

Thanks for the headsup about polars. They look promising, I will try them.  
If I can avoid going through all those python pyrotechnics just to convert .parquet to .csv,  
then my pipeline will be so much simpler and faster!
