Every goal against its target
Build quality50Code, tests, CI and the PR flow hold up
Ideal state
Every change is small, merges into main daily, and passes automated builds and tests at its head. No open PR waits on a conflict.
2 sources, newest 2026-11-04
- DORA: Capabilities, continuous integration 2026-11-04
- Small CLs: eng-practices 2026-11-04
CI runs that pass91.25%100%100%95%70%goal ≥ 95%
| .github | 100% | |
|---|---|---|
| comfyui-base | 100% | |
| compute-crafter | 95% | |
| git-crafter | 70% |
| verify (4 runs) | 50% |
|---|---|
| claude-review (2 runs) | 50% |
| pr-body (3 runs) | 66.67% |
| secret-scan (3 runs) | 66.67% |
| ci (6 runs) | 83.33% |
| pages (11 runs) | 90.91% |
| Dependabot updates (35 runs) | 100% |
| gitleaks-release (8 runs) | 100% |
| sage-wheels (8 runs) | 100% |
- CI runs cancelled0%
Measured: GitHub Actions, each org repo's last 20 completed runs. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); each repo's last 20 decided runs, passed or failed read 2026-11-21 13:37 UTC
Goal: Git Crafter goal, no public benchmark, as quality/targets/tests.json tests.main_pass_rate (95, near 85): a red run on a PR branch is CI doing its job, so not every run passes
Test runs that pass82.5%–75%–90%goal ≥ 95%
| git-crafter | 90% | |
|---|---|---|
| comfyui-base | 75% |
| comfyui-base: verify (20 runs) | 75% | |
|---|---|---|
| git-crafter: verify (14 runs) | 85.71% | |
| git-crafter: cloud-test (6 runs) | 100% |
Measured: GitHub Actions workflows named for tests, each org repo's last 20 runs of them. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); each repo's last 20 decided runs of workflows whose name or file matches /test|e2e|verify|lint/i, Dependabot runs left out read 2026-11-21 13:37 UTC
Goal: quality/targets/tests.json tests.main_pass_rate: the test jobs pass nearly every time, so a red run means a real break; re-goaled 2026-11-04 from 100, near 99, whose source (the site's code.test_pass_rate) is gone
PRs green when merged100%100%100%100%100%goal ≥ 100%
| .github | 100% | |
|---|---|---|
| comfyui-base | 100% | |
| compute-crafter | 100% | |
| git-crafter | 100% |
| green | 66 PRs | |
|---|---|---|
| not green | 0 PRs | |
| no checks | 0 PRs |
Measured: Merged PRs' head commit checks, each org repo's last 20 merges. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack); each repo's last 20 merges read 2026-11-21 13:37 UTC
Goal: quality/targets/github.json pull_requests.green_at_head: GitHub docs, About protected branches, require status checks before merging; every check passes at the merged head
Open PRs with conflicts1 PRs0 PRs1 PRs0 PRs0 PRsgoal ≤ 0 PRs
| comfyui-base | 1 PRs | |
|---|---|---|
| .github | 0 PRs | |
| compute-crafter | 0 PRs | |
| git-crafter | 0 PRs |
| comfyui-base#43 ComfyUI Base 3.22.1: triton beside the testbed's CPU torch on Linux | 34.52 days open |
|---|
- Open PRs stacked on another branch0 PRs
- Open PRs29 PRs
Measured: Open PRs' mergeable state, every org repo, at the read. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack) read 2026-11-21 13:37 UTC
Goal: quality/targets/github.json pull_requests.conflicting: no waiting change needs a rebase
Private references in Git Crafter–goal ≤ 0 refs
no org config (config/*.json with an org) in this checkout
Measured: Git Crafter tracked files outside config/ and data/, at the read: each name the org's config file (config/<org>.json) lists as private, and each /Users/<name> path. git ls-files outside config/ and data/; names from the org config private
Goal: the owner, 2026-11-03: Git Crafter goes open source with the org's settings kept apart, so none stay in template files; near band: Git Crafter goal, no public benchmark
Checks that failed, then passed on the same commit–goal ≤ 1%
could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo
Measured: The quality template's ci collector, the site's committed local.json. SoulCraft-Org/null quality/data/local.json
Goal: quality/targets/ci.json ci.flaky_reruns: below the 1.5% of test runs Google reported flaky (Google Testing Blog, Flaky Tests at Google and How We Mitigate Them, 2016)
Production quality100What people use looks right, works, stays safe and stays up
Ideal state
What people use meets WCAG 2.2 AA, answers fast, deploys without failing, and has no known vulnerable dependency left open.
3 sources, newest 2026-11-04
- Dependabot alerts 2026-11-04
- DORA's software delivery performance metrics 2026-01-05
- Web Content Accessibility Guidelines (WCAG) 2.2 2024-12-12
Text that fails contrast–goal ≤ 0 elements
could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo
Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json
Goal: quality/targets/design.json design.contrast_violations: WCAG 2.2 AA, SC 1.4.3 Contrast (Minimum), as axe-core tests it
Accessibility failures–goal ≤ 0 elements
could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo
- site.usability.target_size_375–
Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json
Goal: quality/targets/usability.json usability.axe_violations: WCAG 2.2 AA as axe-core's default rules test it
Open critical and high alerts0 alerts0 alerts0 alerts0 alerts0 alertsgoal ≤ 0 alerts
| .github | 0 alerts | |
|---|---|---|
| comfyui-base | 0 alerts | |
| compute-crafter | 0 alerts | |
| git-crafter | 0 alerts |
Measured: Dependabot alerts, every org repo, at the read. gh api orgs/SoulCraft-Org/dependabot/alerts (state open, severity critical and high) read 2026-11-21 13:37 UTC
Goal: quality/targets/github.json security.dependabot_open: GitHub docs, About Dependabot alerts, each alert is a known vulnerability; none left open
Deploys that succeed–goal ≥ 100%
no production Workers Builds check in the commits read; builds named for staging are left out
Measured: Production Workers Builds checks on default-branch commits, each org repo's last 20 deploys; staging builds left out. gh api graphql: default-branch history, check suites from the cloudflare-workers-and-pages app (Workers Builds check runs); each repo's last 20 production deploys
Goal: Git Crafter goal, no public benchmark: a failed production build leaves its merge undeployed; DORA's elite change fail rate is 5% (quality/targets/deploy.json deploy.failure_rate_last10), and a build failure comes before any change reaches users
Slowest recent Worker request–goal ≤ 800 ms
could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo
Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json
Goal: quality/targets/code.json code.worker_wall_max_ms: web.dev's good time to first byte, 0.8 seconds or less, poor above 1.8 seconds (web.dev/articles/ttfb)
Speed50Work goes from idea to live quickly
Ideal state
A change goes from push to green in about ten minutes, merges within hours, and is live within minutes of its merge.
2 sources, newest 2026-01-05
- DORA's software delivery performance metrics 2026-01-05
- Continuous Integration 2024-01-18
PR open to merge, the latest10.76 h0.02 h0.11 h0.08 h10.76 hgoal ≤ 4 h
| git-crafter | 10.76 h | |
|---|---|---|
| comfyui-base | 0.11 h | |
| compute-crafter | 0.08 h | |
| .github | 0.02 h |
| git-crafter#140 | 10.76 h |
|---|
Measured: The latest merged PR, every org repo. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack) read 2026-11-21 13:37 UTC
Goal: the site repo's quality/targets/github.json pull_requests.latest_merge_hours: goal set by the orchestrator, 2026-11-02, read as the latest merged PR at Git Crafter v2.0.0
All checks green to merge, median of the latest 10–goal ≤ 30 min
could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo
Measured: The latest 10 merged PRs, every org repo. SoulCraft-Org/null quality/data/local.json
Goal: Git Crafter goal, no public benchmark (the orchestrator, 2026-11-05): a PR merges within 30 minutes of all checks going green, since the merge waits only on the head-pinned review; near is 2 hours. Google's review-speed guide (google.github.io/eng-practices/review/reviewer/speed.html, read 2026-11-04) sets one business day as the slowest response, which this goal sits well inside
Push to green CI, the latest commit1.8 min0.22 min15.63 min0.88 min1.8 mingoal ≤ 10 min
| comfyui-base | 15.63 min | |
|---|---|---|
| git-crafter | 1.8 min | |
| compute-crafter | 0.88 min | |
| .github | 0.22 min |
| git-crafter 2871263 | 1.8 min |
|---|
- CI run minutes, the latest green commit2.47 min
Measured: GitHub Actions, the latest commit whose runs all passed, every org repo. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); the latest commit whose runs all passed, first run created to last run done read 2026-11-21 13:37 UTC
Goal: quality/targets/ci.json ci.latest_flow: the ten-minute build (Kent Beck, Extreme Programming Explained, 2004; Martin Fowler, Continuous Integration, 2024-01-18)
Hours since the 10th-latest merge177 hgoal ≤ 24 h
| compute-crafter | 1,008 h | |
|---|---|---|
| .github | 644 h | |
| comfyui-base | 624 h | |
| git-crafter | 177 h |
| git-crafter#120, the 10th-latest merge | 177 h |
|---|
Measured: The 10 latest merged PRs across every org repo, to the read. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack); the hours from the 10th-latest merge, across repos by mergedAt, to the read read 2026-11-21 13:37 UTC
Goal: Git Crafter goal, no public benchmark: 10 merged PRs a day across the org, near 5, read as the hours from the 10th-latest merge to the read (orchestrator, 2026-11-04): 10 a day spans 24 hours, 5 a day 48
Merge to deployed, the latest–goal ≤ 5 min
no production Workers Builds check in the commits read; builds named for staging are left out
Measured: The latest production Workers Build that succeeded, every org repo; staging builds left out. gh api graphql: default-branch history, check suites from the cloudflare-workers-and-pages app (Workers Builds check runs); the latest production deploy that succeeded, commit time to its last Workers Builds check done
Goal: Git Crafter goal, no public benchmark: a Workers Build deploys a merge in minutes; DORA's elite lead time is under a day (quality/targets/deploy.json deploy.latest_lead_hours), of which this is the last step
Repos against the same goals
| .github | 100 6/7 | 100% | – | 100% | 0 PRs | 0 alerts | 0.02 h | 0.22 min |
|---|---|---|---|---|---|---|---|---|
| compute-crafter | 100 6/7 | 95% | – | 100% | 0 PRs | 0 alerts | 0.08 h | 0.88 min |
| comfyui-base | 71 7/7 | 100% | 75% | 100% | 1 PRs | 0 alerts | 0.11 h | 15.63 min |
| git-crafter | 71 7/7 | 70% | 90% | 100% | 0 PRs | 0 alerts | 10.76 h | 1.8 min |