Wiki
Data Lineage
Q: What is data lineage? A: Data lineage keeps the source IDs, quote time, snapshot batch, and validation status behind a strategy result so the signal can be audited.
Data Lineage
Q: What is data lineage?
A: Data lineage means every strategy result can be traced back to its source data.
Arbitrage signals are sensitive to data quality. A wrong match link, stale quote, or invalid market can create a false opportunity. So the output should keep more than EV and stake ratios.
Common lineage fields include:
| Field | Purpose |
|---|---|
| source_event_id | Match ID in the original source |
| source_game_id | Game ID in the original source |
| quote_timestamp | Quote time |
| quote_age_seconds | Quote age |
| snapshot_run_id | Crawl batch |
| market_selection_key | Original market key |
| freshness_status | Freshness status |
| validation_status | Validation status |
| validation_message | Validation note |
These fields do not change the arbitrage formula, but they decide whether the result can be trusted.
For example, a strategy may show:
\[ EV=1.012 \]
But if quote_age_seconds is 600, the price is already 10 minutes old. For live arbitrage, that signal is probably not executable.
Data lineage lets the system answer where the result came from, which crawl produced it, what the original market was, and whether it passed validation.