Skip to content

[heft] Add auditing in rushstack CI/CD to catch performance regressions #5690

@dmichon-msft

Description

@dmichon-msft

Summary

We should add a benchmark test project that runs various common scenarios for Heft, leveraging V8 code coverage to collect information on:

item unit source
Executed Code KiB V8 Code Coverage
Unused Code KiB V8 Code Coverage
Loaded Code KiB V8 Code Coverage
Loaded Files # V8 Code Coverage
Duration ms time / cpuprofile

Once we have this data being generated, we should have a baseline CI pipeline that calculates a new reference value for every commit into main, and then have the PR CI job do performance comparisons and look for regressions/improvements. This will help us catch performance regressions and give us a standard for evaluating impact of optimizations.

This is the same concept as #5691 , but targeting @rushstack/heft

Candidates for benchmarking

  • heft --help
  • heft run --only build in demo projects using our published rigs.
  • heft run --only test in demo projects using our published rigs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    Needs triage

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions