What World Are Our Models Building?

Hey Numerai community,

I’ve been loving the tournament, it’s super fun and mathematically challenging. But as we pour our expertise into these micro-predictions that power the hedge fund’s meta-model, I’ve started wondering: What decisions are our models actually driving behind the closed-source curtain? What world are we helping shape? I couldn’t find much online, so let’s start a thread to unpack this.

1. AI Era and the New Singularity Fund

We’re in the era of AI agents, and Numerai is leaning into this transformation. With assets under management steadily approaching $1 billion and backing from J.P. Morgan Asset Management, Numerai is scaling rapidly. As the fund holds increasingly larger capital positions across global equities, what framework guides portfolio selection? Are there explicit ethical guidelines, sector biases, or constitutional principles? Do our predictions preferentially support companies promoting freedom, sustainability, innovation, or poverty reduction—or is optimization purely risk-return driven? I understand that much of this information is confidential, but are there any guidelines, value documents, or other resources from the team that we can rely on for assurance?

2. Privacy’s Double Edge in High-Stakes Predictions

Numerai’s encryption and privacy architecture democratize access to premium data, enabling global collaboration without leaks. This is foundational to what makes Numerai work, and it’s undeniably beneficial for data scientists who get rewarded for building strong ML models. But it almost feels like we’re shrugging off responsibility. Our stake-weighted predictions aggregate into real trades with non-trivial consequences—the fund now holds over equity positions worth $700M+. In this black-box setup, what industries, companies, or systemic risks are we amplifying or mitigating? Are there audits, impact assessments, or anonymized metrics we could access?

3. AI-Native Design and the Missing Objective Function

Numerai is increasingly AI-first: the Faith dataset introduced 186 LLM-driven features described as “the most unique, information-dense, and expensive” ever released. Skills and MCP enable seamless agent integration, paving the way for autonomous model-building loops. But AI ruthlessly optimizes its objective function. Do these LLM-extracted features receive any constitutional AI training to guide behavior? Are we proactively aligning for long-term societal good, or purely optimizing for predictive performance? I know they extract unique exotic signals from massive web data, but is extraction guided by long-term horizons and responsible investment principles?

This isn’t criticism, it’s curiosity from a data scientist hooked on Numerai’s vision. Rich, Ark, or team: any insights? Community: thoughts on pushing for more transparency (e.g., anonymized impact metrics)? Let’s discuss!

I vehemently oppose your initiative. I am communism survivor and as such I smell in similar attempts slippery slope towards “looters” agenda. Road to hell is paved with good intentions.

Numerai guys (@richai, @ark, …) please keep tournament as skin in the game meritocracy. Anything else is bad.

2 Likes

Risk Neutral Porfolio Modeling.

Their target windows tell you everything you need to know along with the way the data is annonomized and all that implies.

Long-short hedge funds and the targets: Risk neutral porfolio modeling is based on the principal that for every long equity position there is a matching risk neutral (option + money market) position. Most hedge-funds and prop trading firms are long-short; meaning they borrow a boat load of money at a fixed rate, then try to beat cost of the interest, which implicitly has to be higher than the risk-free money market. That means they’re all holding equity to profit from correctly predicting volatliity and trading against any gaps in volatility pricing. Check out optionstrat to understand this more completely. If Im holding NVDA long term, that appreciates, but income is generated by selling options against the position. Oversimplified, but thats how most funds make money.

The fact that they are re-annonomizing ids between eras implies a lot. For our predictions to mean anything they have to be providing history (in large part reduced to indexed indicators) in every era with the predictions being a gauge of whether they should buy or sell volatility. The features (history and a load of indexed indicators) are modeled and we can produce prediction scores across 20+ targets. But which market are we in? Are we in a market that is described well by cyrusd, claudia, or ender? Are we in bull market, bear, flat? AI enthusiasim? AI pullback? Geopolotical uncertainty? Is a rate cut comming? The top models are picking up on which type of market we are in based on the features, and provide predictions for the target that best fits it. Like, in a strong bull market, vol is more expensive, but is it worth is? Is vol correctly priced in or overpriced? Is it priced for apprehension, but likely to be in rally territory by the time the 60 day targets are being scored? That could be the difference of one 60-day target doing well for 4 weeks then tanking in favor of another.

We arent telling them “buy PLTR,” but saying based on the snapshot of history up to now in the current era, whether the 20 and 60 day options for PLTR correctly priced and or potentially mis-priced far enough to provide a setup with a high expected value.

Expected Monetary Value (EMV), is calculated by multiplying the probability of a risk event by its financial impact (EMV=\text{Probability}\times \text{Impact})

Given all the predictions, they have to prioritize how to deploy their capital based on the ranked EV and whether or not they think they can enter the position in a pallatable way.

If you want to ask the question “who’s on the losing side of winning Numerai trades?”

Probably retail, wsb, gambling in the options market.

If you want a bone to pick, look at the voting power of Blackrock, Vangaurd, and Fidelity and VC. Numerai’s not affecting anything ideological or doing more in markets than providing some liquidity.