Historical model audit

Forecast Replay

Return to a historical cutoff and reconstruct what 1stSeen could have predicted, using only the evidence it held by then. Every run is computed by the worker’s leak-safe backtest when you ask for it.

Future evidence is sealed

The held-out opening and every post-cutoff observation are scoring data only. They cannot enter the forecasting component.

What can be replayed

Held-out targets with a defensible actual interval

Roles with two or more recorded openings: 179
Excluded: only observed-by evidence: 26
Replay candidates: 153
held out on an exact opening: 153
held out on a bounded opening: 0

An archive capture proves a role was visible by then, not that it opened then, so an observed-by opening is never scored as ground truth.

Latest backtest

Why targets could not be scored

Finished Oct 3, 2026 · cutoff 60 days before each target · 890 targets, 0 scored, 890 skipped

no temporal evidence was available by the forecast cutoff689
held-out opening is observed-by only and has no scoreable actual interval201

Counted over every reconstructed cycle the backtest evaluated, which is more than the replay candidates above. Reasons are the backtest’s own words.

Choose a held-out target

Showing 81–100 of 153

Rocket Lab
Launch Safety Software Intern
Held outAug 7, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Varda Space
Flight Software Intern Spring
Held outAug 7, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Varda Space
Guidance Navigation Controls Gnc Intern Spring
Held outAug 7, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Varda Space
Site Reliability Intern Spring
Held outAug 7, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
DRW
Quantitative Trading Analyst
Held outAug 7, 2026exactexact
Latest backtest held out another posting of this role that year
Flow Traders
Trading Intern
Held outAug 4, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Belvedere Trading
Quantitative Trading Intern Summer
Held outAug 4, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Belvedere Trading
Quantitative Trader Entry Level
Held outAug 4, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Rocket Lab
Ground Systems Engineering Intern
Held outAug 3, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Rocket Lab
Supplier Quality Engineer Intern
Held outAug 3, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
IMC
Graduate Software Engineer Start Date in
Held outJul 31, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
IMC
Hardware Engineer Intern
Held outJul 31, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
IMC
Quantitative Trader Intern
Held outJul 31, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
IMC
Graduate Trader
Held outJul 31, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
IMC
Graduate Quantitative Researcher
Held outJul 31, 2026exactexact
Not in the latest backtest run
Flow Traders
Graduate Quantitative Trader
Held outJul 29, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
PDT Partners
Summer Systems Engineering Intern
Held outJul 24, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Verkada
Embedded Software Engineer Access Control
Held outJul 23, 2026exactexact
Skipped in the latest backtest
no temporal evidence was available by the forecast cutoff
Optiver
Quantitative Trading Intern Taiwan
Held outJul 21, 2026exactexact
Not in the latest backtest run
Virtu Financial
Intern Software Engineer
Held outJul 20, 2026exactexact
Not in the latest backtest run

Choose the historical vantage point

Rocket Lab · Launch Safety Software Intern · held out Aug 7, 2026 exact

Forecast cutoff

Why targets could not be scored

Finished Oct 3, 2026 · cutoff 60 days before each target · 890 targets, 0 scored, 890 skipped

no temporal evidence was available by the forecast cutoff689

held-out opening is observed-by only and has no scoreable actual interval201

Counted over every reconstructed cycle the backtest evaluated, which is more than the replay candidates above. Reasons are the backtest’s own words.