Historical model audit

Forecast Replay

Return to a historical cutoff and reconstruct what 1stSeen could have predicted, using only the evidence it held by then. Every run is computed by the worker’s leak-safe backtest when you ask for it.

Future evidence is sealed

The held-out opening and every post-cutoff observation are scoring data only. They cannot enter the forecasting component.

What can be replayed

Held-out targets with a defensible actual interval

Roles with two or more recorded openings: 179
Excluded: only observed-by evidence: 26
Replay candidates: 153
held out on an exact opening: 153
held out on a bounded opening: 0

An archive capture proves a role was visible by then, not that it opened then, so an observed-by opening is never scored as ground truth.

Latest backtest

Why targets could not be scored

Finished Oct 3, 2026 · cutoff 60 days before each target · 890 targets, 0 scored, 890 skipped

no temporal evidence was available by the forecast cutoff689
held-out opening is observed-by only and has no scoreable actual interval201

Counted over every reconstructed cycle the backtest evaluated, which is more than the replay candidates above. Reasons are the backtest’s own words.

Choose a held-out target

Showing 41–60 of 153

IMC
Hardware Machine Learning PhD Research Intern
Held outSep 23, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Together AI
Software Engineer New Grad
Held outSep 18, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Tower Research Capital
Stagiaire en D Veloppement de Logiciels T Software Developer Intern Summer
Held outSep 17, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Tower Research Capital
Software Engineer Intern Summer
Held outSep 17, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Flight Software Engineer Intern
Held outSep 15, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Scale AI
Software Engineering Intern Summer
Held outSep 14, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Manufacturing Optimization Engineer Intern
Held outSep 14, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Commure
Software Engineer
Held outSep 11, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Hardware Engineer Intern
Held outSep 9, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Replit
Software Engineer New Grad
Held outSep 9, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Rocket Lab
Systems Engineering Intern Spring
Held outSep 9, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Datadog
Software Engineering Intern
Held outSep 8, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Coinbase
Machine Learning Engineer Intern
Held outSep 8, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Coinbase
Data Engineer Intern
Held outSep 8, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Tower Research Capital
Intern
Held outSep 7, 2026exactexact
Latest backtest held out another posting of this role that year
Scale AI
Software Engineer New Grad
Held outSep 4, 2026exactexact
Latest backtest held out another posting of this role that year
Scale AI
Software Engineering Intern Summer
Held outSep 4, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Software Engineering Intern
Held outSep 2, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Flight Software Engineer
Held outSep 2, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Anduril
Mechanical Engineering Intern
Held outSep 2, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff

Choose the historical vantage point

IMC · Hardware Machine Learning PhD Research Intern · held out Sep 23, 2026 exact

Forecast cutoff

Why targets could not be scored

Finished Oct 3, 2026 · cutoff 60 days before each target · 890 targets, 0 scored, 890 skipped

no temporal evidence was available by the forecast cutoff689

held-out opening is observed-by only and has no scoreable actual interval201

Counted over every reconstructed cycle the backtest evaluated, which is more than the replay candidates above. Reasons are the backtest’s own words.