Docs & Writing vs Testing · both proven

changelog-generator vs grilling

Both skills were run through Claude twice: once on a fixed brief without the skill, once with it. The briefs differ because each is written for the job the skill claims to do, so compare each skill against its own baseline, then decide which difference matters for your work. They are in different categories, so this is a choice of job, not a head-to-head on the same job.

changelog-generator

Automatically creates user-facing changelogs from git commits by analyzing commit history, categorizing changes, and transforming technical commits into clear, customer-friendly release notes. Turns hours of manual changelog writing into minutes of automated generation.

Category: Docs & Writing
Source: ComposioHQ/awesome-claude-skills
License: Not stated
Proof model: claude-opus-5-5
Brief: “Turn these git commits into a user-facing changelog page for version 2.4.0 of Ledgerly, a small-business invoicing app, as a single HTML page. Commits: 'feat: recurring invoices with weekly, monthly and custom schedules'; 'feat: export invoices to CSV from the list view'; 'fix: PDF totals rounded incorrectly for invoices with more than 50 line items'; 'fix: late-fee reminder emails sent twice when a client had two contacts'; 'chore: bump node to 22'; 'refactor: move tax calculation into shared module'; 'feat: Stripe payouts show in the dashboard with a status badge'; 'fix: dark mode contrast on the settings page'; 'docs: update API examples for the invoices endpoint'.”
Skill commit: be2a406

Without the skillWith changelog-generator

⇆

Without, runWith changelog-generator, run3 independent runs per side, none selected by hand.

Download the with-skill page

grilling

Grill the user relentlessly about a plan, decision, or idea. Use when the user wants to stress-test their thinking, or uses any 'grill' trigger phrases.

Category: Testing
Source: mattpocock/skills
License: MIT
Proof model: claude-opus-5-5
Brief: “Here is my plan. I want to launch a paid newsletter for independent game developers in six weeks. It will cost $8 a month, come out every Tuesday, and cover marketing tips, funding opportunities and interviews with developers who shipped on Steam. I have 1,200 followers on X and no email list yet. My goal is 500 paying subscribers in the first year. Grill me on this plan, and present the result as a single HTML page: every question you would ask me, in the order you would ask it, why each one matters, and what a weak answer would tell you.”
Skill commit: 5beb35b

Without the skillWith grilling

⇆

Without, runWith grilling, run3 independent runs per side, none selected by hand.

Download the with-skill page

We don’t pick a winner for you: the pages are the evidence. Both proofs can be repeated with the brief, model and commit shown above. See alternatives to changelog-generator or alternatives to grilling.