claw-score
Use this skill when working on the OpenClaw maturity scorecard in this repo.
This is the openclaw-local version of the maintainer claw-score workflow:
it keeps the taxonomy and scorecard concepts, but excludes discrawl and the old
committed inventory/ report tree.
Authority
This skill owns the operational workflow for:
taxonomy.yamldocs/maturity-scores.yamldocs/maturity-scorecard.mddocs/taxonomy.mddocs/taxonomy-outline.mdscripts/render-maturity-docs.mjs.github/workflows/maturity-scorecard.yml
Keep person-specific, maintainer-private, Discord archive, and discrawl facts
out of this repo. If a score needs private evidence, use the redacted
qa-evidence.json artifact shape generated by OpenClaw QA workflows.
Source Model
taxonomy.yamlis the hand-edited source of truth for surfaces, levels, QA profiles, categories, feature coverage IDs, docs refs, LTS overrides, and completeness-instruction paths.docs/maturity-scores.yamlis the aggregate score source committed in this repo. It is the only committed score data; do not add generated inventory directories.docs/maturity-scorecard.md,docs/taxonomy.md, anddocs/taxonomy-outline.mdare deterministic docs generated from the root taxonomy and aggregate score source.qa-evidence.jsonartifacts provide per-run QA scorecard evidence. They can enrich generated artifact docs, but they are not committed as inventory.
Commands
Run from the openclaw repo root.
Render committed docs:
pnpm maturity:render
Check generated docs are current:
pnpm maturity:check
Render an evidence-enriched docs artifact from downloaded QA artifacts:
pnpm maturity:render -- --evidence-dir .artifacts/maturity-evidence --output-dir .artifacts/maturity-docs
Scoring Workflow
When asked to score or refresh a surface:
- Read the surface in
taxonomy.yaml. - Read the surface completeness rubric under
.agents/skills/claw-score/references/completeness/. - Gather public repo evidence from docs, source, tests, and QA scenario metadata.
- Prefer existing
qa-evidence.jsonartifacts for executed proof. Do not use discrawl or unredacted private archives. - Update
docs/maturity-scores.yamlonly when the score change is backed by public or redacted artifact evidence. - Run
pnpm maturity:render. - Run
pnpm maturity:check.
For subjective score changes, make the smallest defensible edit and leave the evidence path in the PR or task summary. The deterministic renderer owns Markdown structure; manual prose tweaks belong in taxonomy, score source, or the renderer rather than in generated docs.
Default Completeness Process
Completeness is scored against the intended operator-visible workflow for each
category, not against test breadth or implementation quality. The completeness
reference files under references/completeness/ define the category scope and
any surface-specific variation from this default process.
By default, Completeness measures how fully OpenClaw exposes the intended surface capability set to the user, operator, author, or maintainer persona for that surface. Score whether each category delivers the full expected workflow, including setup, normal use, status or inspection, recovery, and important platform, provider, channel, security, or lifecycle variants where they apply.
Treat Surface-Specific Scoring Questions and Surface-Specific Guidance as
higher-priority instructions for that surface. The surface instructions may
flesh out, narrow, or intentionally conflict with the default ideas here; when
they do, follow the surface instructions and make the score rationale reflect
that surface-specific instruction. If a reference file does not include
surface-specific questions or guidance, apply this default process to the
surface's Category Scope.
For each category, ask:
- Can the intended user or operator complete the category workflow end to end?
- Are the taxonomy features present as supported capabilities rather than isolated implementation fragments?
- Are the important lifecycle stages represented: setup, normal operation, status/inspection, recovery, and upgrade or removal where relevant?
- Are the important environment, provider, platform, channel, or security branches present for this surface?
- Do the known gaps leave major user-visible capability branches missing?
Default guidance:
- Favor higher Completeness when the category supports the full operator-visible workflow described by taxonomy and category evidence.
- Lower Completeness when only the happy path exists, when important variants are undocumented or unimplemented, or when recovery/status paths are missing.
- Do not lower Completeness because tests are thin; that is Coverage.
- Do not lower Completeness because implementation quality is fragile; that is Quality.
Default Completeness bands:
Lovable(95-100): complete across expected workflows, variants, and recovery branches, with only minor polish gaps.Stable(80-95): the expected workflow set is broadly present, with only bounded missing branches.Beta(70-80): the main workflow exists, but meaningful branches or recovery paths are still absent.Alpha(50-70): only a partial capability set is present; users can complete some core tasks but not the full expected workflow.Experimental(0-50): the category exposes only fragments of the intended capability.
Score Semantics
- Coverage: public or redacted proof that the feature is exercised by docs, tests, QA scenarios, live lanes, or release evidence.
- Quality: reliability, maintainability, operator safety, and regression confidence for the category.
- Completeness: how much of the intended operator-visible workflow exists for the category. Use the default completeness process plus any surface-specific variation before changing this score.
- LTS: derived from score thresholds and
human_lts_override; do not hand-edit generated Markdown to change LTS status.
Bands:
Lovable: 95-100Stable: 80-95Beta: 70-80Alpha: 50-70Experimental: 0-50
GitHub Action
The Maturity scorecard workflow verifies committed generated docs on PRs and
pushes. Manual dispatch can also download QA artifacts from another workflow run
with source_run_id and artifact_pattern, render evidence-enriched docs into
.artifacts/maturity-docs, and upload them as a GitHub artifact.
Do not add the maintainer repo's docs/kevinslin/maturity-scorecard/inventory/
tree to openclaw. Those generated reports are intentionally replaced here by
short-lived artifact docs and the committed aggregate scorecard pages.