Two testing skills · both proven

skill-creator vs writing-guidelines

Both skills were run through Claude twice: once on a fixed brief without the skill, once with it. The briefs differ because each is written for the job the skill claims to do, so compare each skill against its own baseline, then decide which difference matters for your work.

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

Category: Testing
Source: anthropics/skills
License: Not stated
Proof model: claude-opus-5-5
Brief: “Write a complete SKILL.md for a skill called release-notes that turns a list of merged pull request titles into customer-facing release notes grouped by feature, fix and breaking change, in the tone of a small developer-tools company. Present the finished SKILL.md as a single HTML page, with the frontmatter and body shown in a code block and a short note under it on how you decided what to include.”
Skill commit: dbd4588

Without the skillWith skill-creator

⇆

Without, runWith skill-creator, run3 independent runs per side, none selected by hand.

Download the with-skill page

writing-guidelines

Review docs/prose for Writing Guidelines compliance. Use when asked to "review my docs", "check writing style", "audit prose", "review docs voice and tone", or "check this page against the writing handbook".

Category: Testing
Source: vercel-labs/agent-skills
License: Not stated
Proof model: claude-opus-5-5
Brief: “Review and rewrite this getting-started page for Pipewell, a data pipeline CLI. The draft opens with two paragraphs of company history, mixes 'you' and 'the user', buries the install command in the fourth paragraph, uses passive voice throughout, and ends without a next step. Write the improved page as a single HTML document, followed by a short list of what you changed and why.”
Skill commit: 063bee9

Without the skillWith writing-guidelines

⇆

Without, runWith writing-guidelines, run3 independent runs per side, none selected by hand.

Download the with-skill page

We don’t pick a winner for you: the pages are the evidence. Both proofs can be repeated with the brief, model and commit shown above. See alternatives to skill-creator or alternatives to writing-guidelines.