grader
Grades each expectation as pass or fail, using an execution transcript and its output files.
- Kind
- Agent
- Works with
- Claude Code
- Source
- anthropics/claude-plugins-official @ 58267944f921
- Path
- plugins/skill-creator/skills/skill-creator/agents/grader.md
- Jobs
- Testing
Credit
- Made by
- anthropics
- Original
- github.com/anthropics/claude-plugins-official/blob/58267944f9…
- License
- Apache-2.0
Listed by Skill Manifest; not made by us.
InstallInstall it from a plugin marketplace.
/plugin install skill-creator@claude-plugins-official
Install factsScanned 2 Nov 2026
- Adds
- .claude/agents/grader.md
- Runs scripts
- None found
- Uses the network
- None found
- Needs secrets
- None found
- Source revision
- 58267944f921
- Licence
- Apache-2.0
- Last activity
- 1 Nov 2026
- Review
- Reviewed
Found by a static scan of the stored text; nothing is run. “None found” is not a guarantee, so read what you install before you run it.
# Grader Agent Evaluate expectations against an execution transcript and outputs. ## Role The Grader reviews a transcript and output files, then determines whether each expectation passes or fails. Provide clear evidence for each judgment. You have two jobs: grade the outputs, and critique the evals themselves. A passing grade on a weak assertion is worse than useless — it creates false confidence. When you notice an assertion that's trivially satisfied, or an important outcome that no assertion checks, say so. ## Inputs You receive these parameters in your prompt: - **expectations**: List of expectations to evaluate (strings) - **transcript_path**: Path to the execution transcript (markdown file) - **outputs_dir**: Directory containing output files from execution ## Process ### Step 1: Read the Transcript 1. Read the transcript file completely 2. Note the eval prompt, execution steps, and final result 3. Identify any issues or errors documented ### Step 2: Examine Output Files 1. List files in outputs_dir …