# Notebook to visualize historic model performance and see effect of different MMC multipliers and payout factors **URL:** \ **Category:** Tournament\ **Created:** [May 16, 2021, 10:42am UTC](https://forum.numer.ai/t/notebook-to-visualize-historic-model-performance-and-see-effect-of-different-mmc-multipliers-and-payout-factors/3316 "2021-05-16T10:42:39Z")\ **Posts on this page:** 1\ **Showing post:** 2
**Author:** ![ml\_is\_lyf](https://avatars.discourse-cdn.com/v4/letter/m/e56c9b/32.png) [@ml\_is\_lyf](https://forum.numer.ai/u/ml_is_lyf)\ **Post date:** [May 16, 2021, 10:51am UTC](https://forum.numer.ai/t/notebook-to-visualize-historic-model-performance-and-see-effect-of-different-mmc-multipliers-and-payout-factors/3316/2 "2021-05-16T10:51:55Z")
I’ve created a separate post about the issue with leaderboard returns > [@Feature request/bug report: Calculate leaderboard returns considering the payout factor](http://forum.numer.ai/t/feature-request-bug-report-calculate-leaderboard-returns-considering-the-payout-factor/3317): > > I noticed that it doesn’t look like the returns on the leaderboard are taking into consideration the payout factor. I discovered this as I wrote a notebook to do the calculations for myself and noticed I get different numbers to the leaderboard unless I override the payout factor as 1 for all rounds. I’m assuming not including it was just an accident as the payout factor is pretty new, but I think it’s pretty important to include it in the calculations for the transparency of the tournament. Mor… --- _[View the full topic](https://forum.numer.ai/t/notebook-to-visualize-historic-model-performance-and-see-effect-of-different-mmc-multipliers-and-payout-factors/3316)._