Skip to content

Improve comparison coverage, reporting, and HTML diff page#20

Merged
AnHeuermann merged 1 commit intomainfrom
improve-ref-coverage
Mar 13, 2026
Merged

Improve comparison coverage, reporting, and HTML diff page#20
AnHeuermann merged 1 commit intomainfrom
improve-ref-coverage

Conversation

@AnHeuermann
Copy link
Member

Changes

  • Expand variable matching to include MTK observed (algebraically eliminated) variables via sol(t; idxs=sym), raising coverage beyond state variables alone
  • Track skipped signals (reference vars not found in simulation) and surface them in a new cmp_skip field on ModelResult
  • Add variable-coverage table to _diff.html listing every reference signal as pass/fail/not-found; move table above the charts
  • Colour index.html "Ref Cmp" cells orange (partial) when all compared signals pass but some reference variables were not found
  • Always link the sim CSV from the "Ref Cmp" cell; show "(CSV N/A)" when the file was skipped for exceeding CSV_MAX_SIZE_MB
  • Fix time-column lookup in reference CSVs to be case-insensitive ("Time" vs "time"), fixing missing comparisons for some models
  • Replace fixed meta placeholders in diff_template.html with a single META_BLOCK substitution; guard JS against empty CSV data

- Expand variable matching to include MTK observed (algebraically
  eliminated) variables via sol(t; idxs=sym), raising coverage beyond
  state variables alone
- Track skipped signals (reference vars not found in simulation) and
  surface them in a new cmp_skip field on ModelResult
- Add variable-coverage table to _diff.html listing every reference
  signal as pass/fail/not-found; move table above the charts
- Colour index.html "Ref Cmp" cells orange (partial) when all compared
  signals pass but some reference variables were not found
- Always link the sim CSV from the "Ref Cmp" cell; show "(CSV N/A)"
  when the file was skipped for exceeding CSV_MAX_SIZE_MB
- Fix time-column lookup in reference CSVs to be case-insensitive
  ("Time" vs "time"), fixing missing comparisons for some models
- Replace fixed meta placeholders in diff_template.html with a single
  META_BLOCK substitution; guard JS against empty CSV data

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@AnHeuermann AnHeuermann self-assigned this Mar 13, 2026
@AnHeuermann AnHeuermann enabled auto-merge (squash) March 13, 2026 12:31
@AnHeuermann AnHeuermann merged commit 5f95ebd into main Mar 13, 2026
3 checks passed
@AnHeuermann AnHeuermann deleted the improve-ref-coverage branch March 13, 2026 12:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant