Robert Allan JamesandClaude Sonnet 5
cf5b08fb65
every factor interaction, and a raw-data appendix Expanded the campaign-mechanism validation report from a condensed 6-page summary into the full depth Captain Bob asked for: analyze all 9 cells as a conglomerate Latin square, then dive into each cell's own data, then cover every within-ISA and cross-factor interaction explicitly rather than averaging it away. Report structure (127 pages, compiled clean, no undefined references): - Front matter: context, methodology, the SWAP-MTX bug narrative (console-interleaving fix + the Fisher-Yates correctness bug and its fix, both already committed separately) - Layer 1: aggregate 3x3 Latin square (heatmap, invariant-metrics table) - Per-Cell Deep Dive (9 sections): cfg-level distribution, summary table, and a rep-order execution-trajectory chart per cell -- the trajectory charts are what actually visualize the order-dependence finding rather than just stating it - Per-ISA Deep Dive (3 sections): within-architecture seed comparison (violin plots, Kruskal-Wallis, per-factor main effects) - Factor Interactions (6 sections, every pairwise combination of the 4 L8 binary factors): both infer_dec_q and early_exit interaction plots faceted by architecture, plus the three-way factor x factor x architecture significance test - Per-Factor Response (4 sections): linear response by architecture, with an explicit note that a true quadratic term isn't identifiable from this 2-level factorial design - Appendix: full run_id-ordered raw data, all 4,320 rows across all 9 cells, as the primary-source backing for every statistic above Generated programmatically (analyse_stadium_relaunch_fixed.R for the aggregate layer, generate_stadium_deepdive.R for the per-cell/per-ISA/ interaction/appendix layers) rather than hand-authored, since content at this scale needs to be data-driven to stay honest. Also includes analyse_stadium_relaunch.R, the earlier script built against the pre-fix (buggy-shuffle) dataset -- superseded but kept for the record, matching how the underlying data commits were handled. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
931 B
931 B
| 1 | arch | seed | n_rows | n_cfg | n_run_id | mean_infer_dec_q | sd_infer_dec_q | early_exit_rate | l8_mode_const | win_div_const | fit_q_const |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | amd64 | 12345 | 480 | 16 | 480 | 56.8541666666667 | 29.2966182458014 | 0.9875 | TRUE | TRUE | TRUE |
| 3 | amd64 | 67890 | 480 | 16 | 480 | 28.0854166666667 | 38.3427977824838 | 0.989583333333333 | TRUE | TRUE | TRUE |
| 4 | amd64 | 13579 | 480 | 16 | 480 | 44.5 | 35.4835961394778 | 0.991666666666667 | TRUE | TRUE | TRUE |
| 5 | aarch64 | 12345 | 480 | 16 | 480 | 56.8541666666667 | 29.2966182458014 | 0.9875 | TRUE | TRUE | TRUE |
| 6 | aarch64 | 67890 | 480 | 16 | 480 | 28.0854166666667 | 38.3427977824838 | 0.989583333333333 | TRUE | TRUE | TRUE |
| 7 | aarch64 | 13579 | 480 | 16 | 480 | 44.5 | 35.4835961394778 | 0.991666666666667 | TRUE | TRUE | TRUE |
| 8 | riscv64 | 12345 | 480 | 16 | 480 | 56.8541666666667 | 29.2966182458014 | 0.9875 | TRUE | TRUE | TRUE |
| 9 | riscv64 | 67890 | 480 | 16 | 480 | 28.0854166666667 | 38.3427977824838 | 0.989583333333333 | TRUE | TRUE | TRUE |
| 10 | riscv64 | 13579 | 480 | 16 | 480 | 44.5 | 35.4835961394778 | 0.991666666666667 | TRUE | TRUE | TRUE |