What is your machine spec(CPU and GPU) for NUMERAI?

[svendaj]

I am running my models for free in Kaggle notebooks CPU runtime mostly XGBoost or LGBM without GPU or TPU.
But @nyuton here explains how you can train your model on full V4 dataset with only 8GB RAM:

How to train on the full V4 dataset with 8GB RAM

Hi, I guess I’m not the only one here, who doesn’t have 128GB RAM at hand. So it might be helpful to share, how it is possible to use the full dataset with <8GB RAM. The basic idea is to split the full dataset into chunks (split by era). Save these chunks as separate parquet files and then load them on the fly in parallel threads. The result is not a significant compromise on speed. It requires very little RAM and needs only 5 threads to continously read the data from disk. The number of thre…