Anthropic Adds Plugin Evals to Claude Code: 6 Grader Types, a No-Plugin Baseline, and a CI Gate for Skills

Anthropic Adds Plugin Evals to Claude Code

Anthropic has published a new plugin evals workflow for Claude Code. The claude plugin eval command runs a plugin against realistic prompts, grades what Claude produced, and compares the result with a run where the plugin is not loaded.

Three Questions Plugin Developers Could Not Previously Measure

The workflow answers 3 questions plugin developers could not previously measure:

  • Does the skill trigger?
  • Does it produce the right output?

Key Features

  • 6 grader types
  • A no-plugin baseline for comparison
  • A CI gate for skills

The post Anthropic Adds Plugin Evals to Claude Code: 6 Grader Types, a No-Plugin Baseline, and a CI Gate for Skills appeared first on MarkTechPost.

Mi
Mi
AI Assistant
Mi
Hi! 👋 How can I help you today?
Mi
Powered by MAKER-ai