{"slug":"promptfoo-evals","title":"promptfoo-evals","description":"Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct  environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs.","developer":null,"category":null,"reported_installs":null,"active":true,"first_seen_at":"2026-10-03T22:13:33.942Z","last_seen_at":"2026-11-07T00:08:29.147Z","last_changed_at":"2026-10-03T22:13:33.942Z","platform":"claude","sources":["Community"],"works_with":["Claude Code"],"marketplace_url":null,"repository_url":"https://github.com/promptfoo/promptfoo.git","web_data":{},"github_data":{},"catalog_sources":{"community":[{"name":"promptfoo-evals","source":{"ref":"main","sha":"253bd92a44f58b0db97a63caa2fb05953a9bfb0d","url":"https://github.com/promptfoo/promptfoo.git","path":"plugins/promptfoo-evals","source":"git-subdir"},"homepage":"https://www.promptfoo.dev/docs/integrations/agent-skill","description":"Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct  environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs."}]},"manifest":{"url":"https://raw.githubusercontent.com/promptfoo/promptfoo/253bd92a44f58b0db97a63caa2fb05953a9bfb0d/plugins/promptfoo-evals/.claude-plugin/plugin.json","payload":{"name":"promptfoo-evals","license":"MIT","homepage":"https://www.promptfoo.dev/docs/integrations/agent-skill","keywords":["eval","testing","llm","promptfoo"],"repository":"https://github.com/promptfoo/promptfoo","description":"Teaches AI coding agents to create promptfoo eval suites with deterministic assertions, provider configs, and best practices"},"observed_at":"2026-11-06T10:48:05Z"}}