Session 56: Full audit — PropLine + boxscore + pipeline + sport coverage (2289 tests)
Research (verified against live MLB Stats / ESPN / The Odds APIs): - specs/propline-audit.md — every stat_type mapped against our 4-layer pipeline; real MLB boxscore fields; sport coverage status; pipeline gap analysis. - specs/vyndr-roadmap.md — priority-ordered Sessions 57–64 + coverage targets. - scripts/propline-audit.js + specs/audit-data/ (raw capture). Headline bug: oddsNormalizer mapped batter_rbis → 'rbis' while the whole grade/feature/outcome chain keys on 'rbi' — every PropLine RBI prop silently failed to grade AND settle. Fixed (+ regression test). Phase 4 — wired missing MLB stats end-to-end: - PropLine MLB markets 6 → 12 (+runs, walks, doubles, earned_runs, hits_allowed, outs — same request, no extra quota). - doubles/outs/triples added to featureCache + outcomeService MLB_LOG_FIELD and all three grade whitelists (analyze/scan/validation.py). Phase 6 — pipeline resilience: - opsNotify.js: ntfy alerts (never throws, test-disabled). Snapshot success/ stale/failure alerts; retry-once on hard odds error (not on empty slate). - Missed-cron watchdog (mostRecentExpectedSlot/isSnapshotOverdue); status probe now returns `overdue`. Coverage truth: MLB is the only end-to-end-live sport; outcome settlement is MLB-only (WNBA/NBA/soccer never settle) — documented as the #1 roadmap gap. Backend 2276 → 2289 tests (+13). Web build exit 0. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,96 @@
|
||||
# VYNDR Master Roadmap — Generated 2026-07-10 (Session 56)
|
||||
|
||||
The foundation document. Derived from the Session-56 data audit
|
||||
(`specs/propline-audit.md`, verified against live MLB Stats / ESPN / Odds APIs).
|
||||
Every session after this references it. Update it as sessions ship.
|
||||
|
||||
---
|
||||
|
||||
## Current coverage (verified 2026-07-10)
|
||||
|
||||
| Sport | Odds props | Grading | Features (l5/l20) | Outcomes settled | Status |
|
||||
|-------|-----------|---------|-------------------|------------------|--------|
|
||||
| MLB | ✅ PropLine + odds-api | ✅ | ✅ real (statsapi) | ✅ (S55, expanded S56) | **LIVE** |
|
||||
| WNBA | ✅ odds-api/PropLine | ✅ | ⚠️ Python offline → thin | ❌ | **PARTIAL** |
|
||||
| Soccer | ✅ odds-api only (no PropLine) | ⚠️ extractor only | ⚠️ | ❌ | **PARTIAL** |
|
||||
| NBA | ⚠️ summer league only | ✅ | ⚠️ offline | ❌ | **OFF-SEASON (Oct)** |
|
||||
| NFL | ⚠️ preseason | ⚠️ mapped, not e2e | ❌ | ❌ | **PRE-SEASON (Sep)** |
|
||||
| NHL | ❌ off-season | ⚠️ mapped | ❌ | ❌ | **DARK (Oct)** |
|
||||
|
||||
**The core product is MLB.** It is the only sport that is live end-to-end
|
||||
(odds → grade → real features → settled accuracy). Everything else is a
|
||||
build-out target.
|
||||
|
||||
---
|
||||
|
||||
## Gap analysis (from the audit)
|
||||
|
||||
1. **Outcome settlement is MLB-only** — WNBA/NBA/soccer grades never settle, so
|
||||
the accuracy record (the S55 trust engine) only reflects MLB. **Highest-value
|
||||
gap.** Needs the ESPN box-score settle path (`espnStatsAdapter` already parses
|
||||
the shape for season avgs).
|
||||
2. **NBA/WNBA features depend on an offline Python nba_api service** — l5/l20 are
|
||||
often empty; only season avgs survive (ESPN fallback). Needs an ESPN game-log
|
||||
feature path so intel populates without the Python service.
|
||||
3. **Soccer has no PropLine source** — odds-api backup only; no `SPORT_KEYS` entry.
|
||||
Soccer grading isn't wired into the snapshot pipeline end-to-end.
|
||||
4. **NFL mapped but not graded end-to-end** — markets normalize, but no feature/
|
||||
outcome path. Wire before September.
|
||||
5. ~~RBI silent-failure (rbis/rbi)~~ — **FIXED S56.**
|
||||
6. ~~Under-requesting MLB markets~~ — **FIXED S56** (6 → 12 markets).
|
||||
7. ~~No pipeline alerting / retry / missed-cron~~ — **FIXED S56.**
|
||||
8. **No live calibration** — the accuracy record exists but doesn't yet feed back
|
||||
into grade confidence (spec 2.3 from S55).
|
||||
9. **`batter_strikeouts` (batter Ks)** mapped but not feature/settle-wired.
|
||||
|
||||
---
|
||||
|
||||
## Session plan (priority-ordered)
|
||||
|
||||
| Session | Focus | Ships | Scope |
|
||||
|---------|-------|-------|-------|
|
||||
| 57 | **WNBA/NBA outcome settlement** | ESPN box-score settle path in outcomeService → accuracy for basketball; WNBA goes fully live | M |
|
||||
| 58 | **ESPN game-log features** | l5/l10/l20 for NBA/WNBA without the Python service → real intel on basketball grade cards | M |
|
||||
| 59 | **Soccer end-to-end** | soccer into the snapshot pipeline (odds-api source), feature extractor wired, ESPN settle | L |
|
||||
| 60 | **Live calibration** | accuracy record feeds grade-confidence adjustment (under/over-confident tiers nudge); "Model health: Calibrated/Learning" indicator | M |
|
||||
| 61 | **NFL pre-season prep** | NFL feature + settle path (ESPN NFL boxscore) so Week 1 (Sep) is live | L |
|
||||
| 62 | **Prop breadth** | `batter_strikeouts`, `triples`, pitcher `walks`; NBA `pra`/`turnovers` requested; WNBA extra markets | S |
|
||||
| 63 | **Accuracy depth** | per-archetype hit rates, per-stat hit rates, player-level record ("VYNDR on Judge: 12-5"); ledger UI | M |
|
||||
| 64 | **NBA regular-season readiness** | verify NBA pipeline for the Oct tip-off; depth-chart/cascade live | M |
|
||||
|
||||
Scope key: S ≈ ½ session, M ≈ 1 session, L ≈ 1–2 sessions.
|
||||
|
||||
---
|
||||
|
||||
## Stat-type coverage target (fully built)
|
||||
|
||||
- **MLB (batters):** hits, total_bases, home_runs, rbi, runs, doubles, triples,
|
||||
walks, stolen_bases, batter_strikeouts. **(pitchers):** strikeouts, earned_runs,
|
||||
hits_allowed, innings_pitched, outs, walks. *(Bold-new this session: doubles,
|
||||
triples, outs, runs, walks requested + settleable.)*
|
||||
- **NBA/WNBA:** points, rebounds, assists, threes, steals, blocks, turnovers, pra.
|
||||
- **Soccer:** goals, shots, shots_on_target, tackles, cards, corners, saves,
|
||||
passes, clean_sheet.
|
||||
- **NFL:** passing/rushing/receiving yards, receptions, pass/rush/rec TDs,
|
||||
anytime_td, interceptions, kicking_points.
|
||||
|
||||
## Sport coverage target
|
||||
|
||||
- **MLB** ✅ live now (settled accuracy).
|
||||
- **WNBA** → live after S57 (settlement) + S58 (features).
|
||||
- **Soccer** → live after S59.
|
||||
- **NFL** → ready for September (S61).
|
||||
- **NBA** → ready for October (S64).
|
||||
- **NHL** → ready for October (fast-follow once NBA path exists; shares ESPN pattern).
|
||||
|
||||
---
|
||||
|
||||
## Operating invariants (do not regress)
|
||||
- Three stat_type whitelists stay in sync: `routes/analyze.js`, `routes/scan.js`,
|
||||
`python/utils/validation.py`.
|
||||
- A requested market MUST have a `MARKET_MAP` entry (else silent zero) AND, if
|
||||
MLB, a `MLB_LOG_FIELD` entry in BOTH `featureCache` and `outcomeService` (else
|
||||
no features / no settlement).
|
||||
- The accuracy pill stays HONEST — "LEARNING" below MIN_SAMPLE, never a faked %.
|
||||
- Pipeline alerts (ntfy) fire on success/failure/stale/overdue; the status probe
|
||||
(`GET /api/internal/snapshot/status`) exposes `overdue`.
|
||||
Reference in New Issue
Block a user