Using the SWMM for MMC

Currently, Signals and Crypto use their Naive-Weighted Meta Models (NWMM) to calculate MMC. We know that this is incorrect because the Stake-Weighted Meta Model (SWMM) fundamentally outperforms the Naive-Weighted variant on CORR. This is true of all tournaments we host. Thus, we must ensure that all tournaments are paying for contribution to the Stake-Weighted Meta Model.

For rounds starting on or after Feb. 18, 2025, payouts will begin paying on MMC with respect to the SWMM for both Signals and Crypto.

Here is what that change looks like for Signals and Crypto in terms of average MMC per round, as you can see the cumulative expected value of MMC for Signals is slightly lower while the cumulative expected value of MMC in Crypto is slightly higher:

Correlation between the 2 scores is high across both tournaments over 2024, so most data scientists should not see any significant change in payouts going forward:

1 Like