Git Crafter

4 reposAPI data 2026-11-21 13:36 UTCsite data 2026-11-21 13:36 UTCbuilt 2026-11-21 13:37 UTC

Every goal against its target

missesnearmeetsnoneBuild quality50Production quality100Speed50
3 meet3 near2 miss8 not measured

Build quality50Code, tests, CI and the PR flow hold up

Ideal state

Every change is small, merges into main daily, and passes automated builds and tests at its head. No open PR waits on a conflict.

2 sources, newest 2026-11-04
  1. DORA: Capabilities, continuous integration 2026-11-04
  2. Small CLs: eng-practices 2026-11-04
CI runs that pass91.25%goal ≥ 95%
By repo
.github100%
comfyui-base100%
compute-crafter95%
git-crafter70%
Breakdown
verify (4 runs)50%
claude-review (2 runs)50%
pr-body (3 runs)66.67%
secret-scan (3 runs)66.67%
ci (6 runs)83.33%
pages (11 runs)90.91%
Dependabot updates (35 runs)100%
gitleaks-release (8 runs)100%
sage-wheels (8 runs)100%
  • CI runs cancelled0%

Measured: GitHub Actions, each org repo's last 20 completed runs. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); each repo's last 20 decided runs, passed or failed read 2026-11-21 13:37 UTC

Goal: Git Crafter goal, no public benchmark, as quality/targets/tests.json tests.main_pass_rate (95, near 85): a red run on a PR branch is CI doing its job, so not every run passes

Test runs that pass82.5%goal ≥ 95%
By repo
git-crafter90%
comfyui-base75%
Breakdown
comfyui-base: verify (20 runs)75%
git-crafter: verify (14 runs)85.71%
git-crafter: cloud-test (6 runs)100%

Measured: GitHub Actions workflows named for tests, each org repo's last 20 runs of them. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); each repo's last 20 decided runs of workflows whose name or file matches /test|e2e|verify|lint/i, Dependabot runs left out read 2026-11-21 13:37 UTC

Goal: quality/targets/tests.json tests.main_pass_rate: the test jobs pass nearly every time, so a red run means a real break; re-goaled 2026-11-04 from 100, near 99, whose source (the site's code.test_pass_rate) is gone

PRs green when merged100%goal ≥ 100%
By repo
.github100%
comfyui-base100%
compute-crafter100%
git-crafter100%
Breakdown
green66 PRs
not green0 PRs
no checks0 PRs

Measured: Merged PRs' head commit checks, each org repo's last 20 merges. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack); each repo's last 20 merges read 2026-11-21 13:37 UTC

Goal: quality/targets/github.json pull_requests.green_at_head: GitHub docs, About protected branches, require status checks before merging; every check passes at the merged head

Open PRs with conflicts1 PRsgoal ≤ 0 PRs
By repo
comfyui-base1 PRs
.github0 PRs
compute-crafter0 PRs
git-crafter0 PRs
Breakdown
comfyui-base#43 ComfyUI Base 3.22.1: triton beside the testbed's CPU torch on Linux34.52 days open
  • Open PRs stacked on another branch0 PRs
  • Open PRs29 PRs

Measured: Open PRs' mergeable state, every org repo, at the read. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack) read 2026-11-21 13:37 UTC

Goal: quality/targets/github.json pull_requests.conflicting: no waiting change needs a rebase

Private references in Git Crafter–goal ≤ 0 refs

no org config (config/*.json with an org) in this checkout

Measured: Git Crafter tracked files outside config/ and data/, at the read: each name the org's config file (config/<org>.json) lists as private, and each /Users/<name> path. git ls-files outside config/ and data/; names from the org config private

Goal: the owner, 2026-11-03: Git Crafter goes open source with the org's settings kept apart, so none stay in template files; near band: Git Crafter goal, no public benchmark

Checks that failed, then passed on the same commit–goal ≤ 1%

could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo

Measured: The quality template's ci collector, the site's committed local.json. SoulCraft-Org/null quality/data/local.json

Goal: quality/targets/ci.json ci.flaky_reruns: below the 1.5% of test runs Google reported flaky (Google Testing Blog, Flaky Tests at Google and How We Mitigate Them, 2016)

Production quality100What people use looks right, works, stays safe and stays up

Ideal state

What people use meets WCAG 2.2 AA, answers fast, deploys without failing, and has no known vulnerable dependency left open.

3 sources, newest 2026-11-04
  1. Dependabot alerts 2026-11-04
  2. DORA's software delivery performance metrics 2026-01-05
  3. Web Content Accessibility Guidelines (WCAG) 2.2 2024-12-12
Text that fails contrast–goal ≤ 0 elements

could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo

Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json

Goal: quality/targets/design.json design.contrast_violations: WCAG 2.2 AA, SC 1.4.3 Contrast (Minimum), as axe-core tests it

Accessibility failures–goal ≤ 0 elements

could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo

  • site.usability.target_size_375–

Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json

Goal: quality/targets/usability.json usability.axe_violations: WCAG 2.2 AA as axe-core's default rules test it

Open critical and high alerts0 alertsgoal ≤ 0 alerts
By repo
.github0 alerts
comfyui-base0 alerts
compute-crafter0 alerts
git-crafter0 alerts

Measured: Dependabot alerts, every org repo, at the read. gh api orgs/SoulCraft-Org/dependabot/alerts (state open, severity critical and high) read 2026-11-21 13:37 UTC

Goal: quality/targets/github.json security.dependabot_open: GitHub docs, About Dependabot alerts, each alert is a known vulnerability; none left open

Deploys that succeed–goal ≥ 100%

no production Workers Builds check in the commits read; builds named for staging are left out

Measured: Production Workers Builds checks on default-branch commits, each org repo's last 20 deploys; staging builds left out. gh api graphql: default-branch history, check suites from the cloudflare-workers-and-pages app (Workers Builds check runs); each repo's last 20 production deploys

Goal: Git Crafter goal, no public benchmark: a failed production build leaves its merge undeployed; DORA's elite change fail rate is 5% (quality/targets/deploy.json deploy.failure_rate_last10), and a build failure comes before any change reaches users

Slowest recent Worker request–goal ≤ 800 ms

could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo

Measured: the site repo's Quality page data, committed. SoulCraft-Org/null quality/data/local.json

Goal: quality/targets/code.json code.worker_wall_max_ms: web.dev's good time to first byte, 0.8 seconds or less, poor above 1.8 seconds (web.dev/articles/ttfb)

Speed50Work goes from idea to live quickly

Ideal state

A change goes from push to green in about ten minutes, merges within hours, and is live within minutes of its merge.

2 sources, newest 2026-01-05
  1. DORA's software delivery performance metrics 2026-01-05
  2. Continuous Integration 2024-01-18
PR open to merge, the latest10.76 hgoal ≤ 4 h
By repo
git-crafter10.76 h
comfyui-base0.11 h
compute-crafter0.08 h
.github0.02 h
Breakdown
git-crafter#14010.76 h

Measured: The latest merged PR, every org repo. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack) read 2026-11-21 13:37 UTC

Goal: the site repo's quality/targets/github.json pull_requests.latest_merge_hours: goal set by the orchestrator, 2026-11-02, read as the latest merged PR at Git Crafter v2.0.0

All checks green to merge, median of the latest 10–goal ≤ 30 min

could not read the site's data: site quality data: no site repo: set CODE_OS_SITE_REPO or the org config's site_repo

Measured: The latest 10 merged PRs, every org repo. SoulCraft-Org/null quality/data/local.json

Goal: Git Crafter goal, no public benchmark (the orchestrator, 2026-11-05): a PR merges within 30 minutes of all checks going green, since the merge waits only on the head-pinned review; near is 2 hours. Google's review-speed guide (google.github.io/eng-practices/review/reviewer/speed.html, read 2026-11-04) sets one business day as the slowest response, which this goal sits well inside

Push to green CI, the latest commit1.8 mingoal ≤ 10 min
By repo
comfyui-base15.63 min
git-crafter1.8 min
compute-crafter0.88 min
.github0.22 min
Breakdown
git-crafter 28712631.8 min
  • CI run minutes, the latest green commit2.47 min

Measured: GitHub Actions, the latest commit whose runs all passed, every org repo. gh api repos/SoulCraft-Org/{repo}/actions/runs (created, completed runs; conclusion, created_at, run_started_at, updated_at, head_sha, event); the latest commit whose runs all passed, first run created to last run done read 2026-11-21 13:37 UTC

Goal: quality/targets/ci.json ci.latest_flow: the ten-minute build (Kent Beck, Extreme Programming Explained, 2004; Martin Fowler, Continuous Integration, 2024-01-18)

Hours since the 10th-latest merge177 hgoal ≤ 24 h
By repo
compute-crafter1,008 h
.github644 h
comfyui-base624 h
git-crafter177 h
Breakdown
git-crafter#120, the 10th-latest merge177 h

Measured: The 10 latest merged PRs across every org repo, to the read. gh api graphql: repository.pullRequests (states MERGED, createdAt, mergedAt, head commit statusCheckRollup; states OPEN, mergeable, baseRefName, stack); the hours from the 10th-latest merge, across repos by mergedAt, to the read read 2026-11-21 13:37 UTC

Goal: Git Crafter goal, no public benchmark: 10 merged PRs a day across the org, near 5, read as the hours from the 10th-latest merge to the read (orchestrator, 2026-11-04): 10 a day spans 24 hours, 5 a day 48

Merge to deployed, the latest–goal ≤ 5 min

no production Workers Builds check in the commits read; builds named for staging are left out

Measured: The latest production Workers Build that succeeded, every org repo; staging builds left out. gh api graphql: default-branch history, check suites from the cloudflare-workers-and-pages app (Workers Builds check runs); the latest production deploy that succeeded, commit time to its last Workers Builds check done

Goal: Git Crafter goal, no public benchmark: a Workers Build deploys a merge in minutes; DORA's elite lead time is under a day (quality/targets/deploy.json deploy.latest_lead_hours), of which this is the last step

Repos against the same goals

.github100 6/7100%–100%0 PRs0 alerts0.02 h0.22 min
compute-crafter100 6/795%–100%0 PRs0 alerts0.08 h0.88 min
comfyui-base71 7/7100%75%100%1 PRs0 alerts0.11 h15.63 min
git-crafter71 7/770%90%100%0 PRs0 alerts10.76 h1.8 min