Design vs Testing · both proven

prototype vs skill-creator

Both skills were run through Claude twice: once on a fixed brief without the skill, once with it. The briefs differ because each is written for the job the skill claims to do, so compare each skill against its own baseline, then decide which difference matters for your work. They are in different categories, so this is a choice of job, not a head-to-head on the same job.

prototype

Build a throwaway prototype to answer a design question. Use when the user wants to sanity-check whether a state model or logic feels right, or explore what a UI should look like.

Category: Design
Source: mattpocock/skills
License: MIT
Proof model: claude-opus-5-5
Brief: “We are designing the order state model for a food delivery app. An order can be placed, accepted by the restaurant, being prepared, ready for pickup, picked up by a courier, and delivered. The customer can cancel until the restaurant starts preparing; the restaurant can cancel at any time before pickup; a cancellation after payment triggers a refund, partial if food was already prepared. We are not sure this logic is right. Build a throwaway prototype as a single HTML page that lets someone on the team drive an order through these states and see where the rules break or get confusing.”
Skill commit: 5beb35b

Without the skillWith prototype

⇆

Without, runWith prototype, run3 independent runs per side, none selected by hand.

Download the with-skill page

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

Category: Testing
Source: anthropics/skills
License: Not stated
Proof model: claude-opus-5-5
Brief: “Write a complete SKILL.md for a skill called release-notes that turns a list of merged pull request titles into customer-facing release notes grouped by feature, fix and breaking change, in the tone of a small developer-tools company. Present the finished SKILL.md as a single HTML page, with the frontmatter and body shown in a code block and a short note under it on how you decided what to include.”
Skill commit: dbd4588

Without the skillWith skill-creator

⇆

Without, runWith skill-creator, run3 independent runs per side, none selected by hand.

Download the with-skill page

We don’t pick a winner for you: the pages are the evidence. Both proofs can be repeated with the brief, model and commit shown above. See alternatives to prototype or alternatives to skill-creator.