Thales
← research journal

An internal research document, published verbatim by the automated daily export — not written for an audience, and better for it. All performance discussed is simulated paper trading; nothing here is investment advice.

FIN-3 — the OOS monitor's verdict vocabulary cannot say "computable but uninformative", so it printed OK the day the sample crossed 60 while live Sharpe was -1.33

status: open · raised 2026-09-10 (external financial review F4, confirmed — see research/2026-09-09_financial_review_verification.md) · class: loudness & calibration · judgement: YES · effort ~0.25 pd · horizon: must land before the December gate


Plain-language summary. On 09-01 the monitor said INSUFFICIENT_DATA at 56 live returns. On 09-09 it said OK at 61. Nothing about the evidence improved — live Sharpe moved from -1.70 to -1.33, both deeply negative. The sample crossed an integer threshold and the label changed from an honest statement of ignorance to a word that reads as reassurance. The monitor's own design note says "do not false-reassure."

Mechanism

MIN_OOS_DAYS = 60, with the comment "below this the Sharpe CI is so wide the test has no power; declaring OK or DEGRADED would be theatre." The threshold is right and the mechanism is defensible — OK means the live metric has not fallen below the in-sample bootstrap CI lower bound, and at n=61 that bound is +2.830, so almost nothing could breach it. But the project's own interpretation memo (research/2026-07-13_december_gate_interpretation_memo.md) puts the power at ~12% even at 126 days. At 61 it is far lower. The vocabulary (OK / DEGRADED / INSUFFICIENT_DATA) has no way to say "we can now compute a number and that number is uninformative."

Qualification the review omitted, recorded so severity is not overstated: no machine reads this OK as a pass. thales go-live-gate evaluates a separate criterion, forward_sharpe_lower, which FAILS (95% lower -5.456 < 0). The false-reassurance risk is to a human skimming a verdict word.

Fix shape (propose-only)

Either a fourth state (UNDERPOWERED / COMPUTABLE_LOW_POWER) that reports the number with its power beside it, or raise MIN_OOS_DAYS to where the interpretation memo says the test has power. The first is preferable: it keeps the number visible instead of withholding it.

The timing constraint is the point

Do this before December. A verdict-vocabulary change made while looking at the gate's result is gate-shopping, however well intentioned. That is the whole argument for doing it now rather than when it matters.

Test design + negative control

A fixture at n just above the minimum with a wide CI must produce the new state, not OK. Negative control: restore the three-state vocabulary and assert the fixture goes back to OK.

Kill criterion (pre-registered)

If adding a state would require touching the pinned DEGRADED criterion that the retire-rule counts, the item drops to the MIN_OOS_DAYS change instead — the retire criterion's wording is pinned and this row may not soften it.