promptfoo-evals
Developer not provided
Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax...
From the developer
License
MIT
Works with
Claude Code
Description
From the marketplace listing
Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs.
What changed
No changes recorded yet. Follow this plugin to keep track of future changes.
Similar plugins
Find competitors to follow as you develop your plugin.
-
Playwright Pro turns your AI coding agent into a senior test automation engineer. Instead of generating tutorial-quality tests with brit...
Shared terms: test, coding, agent, assertion
-
Create, update, and fix Cypress tests. Connect to Cypress Cloud to see test results and use data to manage your test suite.
Shared terms: suite, test
-
Checkly skills for creating, testing, and managing monitoring checks with AI coding agents.
Shared terms: coding, agent, check
-
Keep your coding agent up to date with the latest web best practices
Shared terms: practice, coding, agent
-
Test-driven regression guard for AI coding agents. After every code change, TDAD looks up impacted tests via a code-test dependency graph...
Shared terms: test, coding, agent, driven
Keywords
Files & skills
promptfoo-evals · catalog manifest
Saved declaration
{}
promptfoo-evals · catalog manifest
Saved declaration
{
"name": "promptfoo-evals",
"source": {
"ref": "main",
"sha": "253bd92a44f58b0db97a63caa2fb05953a9bfb0d",
"url": "https://github.com/promptfoo/promptfoo.git",
"path": "plugins/promptfoo-evals",
"source": "git-subdir"
},
"homepage": "https://www.promptfoo.dev/docs/integrations/agent-skill",
"description": "Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs."
}
promptfoo-evals · catalog manifest
Saved declaration
{
"name": "promptfoo-evals",
"license": "MIT",
"homepage": "https://www.promptfoo.dev/docs/integrations/agent-skill",
"keywords": [
"eval",
"testing",
"llm",
"promptfoo"
],
"repository": "https://github.com/promptfoo/promptfoo",
"description": "Teaches AI coding agents to create promptfoo eval suites with deterministic assertions, provider configs, and best practices"
}
plugin.json observed Nov 6, 2026 · 10:48 UTC. Manifest source ↗
Catalog declarations and available plugin.json metadata are saved. Referenced skills and executable source files are not downloaded or tested. Missing components in a manifest do not prove that the plugin has none.
Installation instructions
Community
/plugin marketplace add anthropics/claude-plugins-community
/plugin install promptfoo-evals@claude-communityTechnical details
- Sources
- Community
- First seen
- Oct 3, 2026 · 22:13 UTC
- Last seen
- Nov 7, 2026 · 00:08 UTC
- Latest observed change
- Oct 3, 2026 · 22:13 UTC
- Collection status
- Listed
- Reported installs
- Not provided
Installation counts are source-reported, not independently verified active users. Observation dates are not release dates.
Download plugin data (JSON)Plugin history: freshly prepared. Prepared . Refreshed when catalog data changes or after 6 hours. Your account and Follow status are live.