What evidence would convince you this no longer works?+
A sustained failure to beat the fair benchmark — buy-and-hold of the same basket — beyond
pre-defined tolerances. That judgement is made by rule, against thresholds set in advance, not by
mood after a bad month. Temporary underperformance inside historical norms is expected and
tolerated; a breach of the pre-set floor triggers de-risking. A system with a harsh bar for going
live must have an equally clear bar for stepping back.
Where is the biggest model risk?+
A future genuinely unlike anything in the training history. No amount of testing on the past fully
removes that risk, and it would be dishonest to claim otherwise. The mitigations are structural:
the worst-regime deployment gate, hard limits that sit outside the model's control, a strictly capped
short exposure with the book kept net-long, and cash as an always-available position.
How do you avoid fooling yourselves with backtests?+
Several independent defences, all mechanical: every engineered input is tested by perturbing
future data and asserting that today's values don't change; the trading simulator uses only past
prices; testing is strictly in time order; the final period is locked in code and opened exactly once,
after every choice is frozen; the deployment gate judges the worst window, not the average; and the
benchmark is buy-and-hold of the same basket, so the system gets no credit for a rising market.
It is also why the previous generation was retired. A full audit found its simulator could see a little
of the future in the periods it was tested on. The fix was not a patch but a rebuild — and the
defences above are the result.
What is automated, and what still depends on human judgement?+
The production loop — data gathering, signal construction, decisions, execution, record-keeping —
is fully automated, and the live model's daily decisions cannot be manually overridden. Human
judgement operates one level up: choosing research directions, approving the promotion of a new
model after it clears the full test regime, and deciding the rules themselves. People design the
gauntlet; they don't reach into the machine.
Which parts of past performance might not repeat?+
Any specific stretch of returns reflects the regimes that happened to occur, and no particular
window should be extrapolated. What is designed to repeat is the process: breadth of daily
attention, cost-aware discipline, and survival-first gating. That is also why performance is judged
against the fair benchmark over long horizons rather than sold on its best quarter.
Isn't a fixed universe of today's large caps survivorship bias?+
Partly, yes — choosing a basket of currently listed companies bakes some hindsight into the
universe itself, and pretending otherwise would be dishonest. The mitigation is structural: the
benchmark is buy-and-hold of the same basket, so whatever survivorship advantage the
universe enjoys, the benchmark enjoys it equally — the system is only ever credited for beating a
yardstick with the identical bias. These are also deeply established large companies where the
risk of disappearance over the tested period is low, and the universe is fixed rather than quietly
reshuffled.
How crowded is this trade?+
Far less than most systematic strategies, by construction. This is not a standard factor
portfolio — there is no published recipe being followed alongside billions of dollars of similar
money. The policy was learned, not copied; it applies to one specific basket; and its capacity
needs are a rounding error in some of the world's most liquid shares. The honest caveat: crowding
in the underlying names (large US equities are widely held) is unavoidable and shows up in
the benchmark too — which is exactly why the benchmark is the yardstick.
How is genuine degradation told apart from a bad patch — and how often is the model refreshed?+
By pre-set rule, not by feel. Underperformance within the range seen across years of testing is a
bad patch; a sustained breach of the pre-defined floor against the benchmark is degradation, and
it triggers de-risking. Refresh runs continuously but promotes rarely: challenger models are
trained and tested all the time, yet the production model changes only when a challenger beats it
through the full gauntlet — the incumbent is never retired for novelty's sake.
If a competitor had this exact codebase, what's left?+
More than it might seem. The code is the smaller half; the accumulated record of what was tried
and failed — thousands of discarded candidates and the reasons they died — is what steers the next
generation, and it doesn't ship with the code. The validation discipline would also force any copy
through the same multi-year gauntlet before it could be trusted. And a copy trades against the same
costs and the same market, with none of the iteration behind it.