Advice on setup for training new models

Data Science
1

Hey everyone!

I’m new to the Numerai competition and I’m eager to explore ways to work with medium to large Numerai datasets more efficiently. I’m currently considering using AWS EC2 instances or Amazon SageMaker for this purpose. My primary goals are to improve model training speed and having a more robust setup where I don’t have to load the dataset from the API every time I want to continue my research etc.

Any advice would be greatly appreciated!

2

Assuming your referring to tournament, you don’t need to load your data every time though api. You can just store your data locally and use them for any kind of test and comparison.