类库 › promptfoo
promptfoo

promptfoo/promptfoo

promptfoo是一个用于测试、评估和红队测试AI提示词、代理和RAG系统的工具。支持GPT、Claude、Gemini、Llama等多种模型对比,通过简单配置实现命令行和CI/CD集成,帮助开发者构建安全可靠的AI应用。

20,910 1,815 20,910 273
在 GitHub 上查看
promptfoo/promptfoo

技术栈

框架

React ^19.2.4

状态管理

Zustand ^5.0.11

数据请求

React Query ^5.90.21

构建工具

Vite ^7.3.1 esbuild ^0.27.4

测试

Jest ^30.2.0 Playwright ^1.58.2 Vitest ^4.0.18

网络

Requests

CSS 框架

Tailwind CSS ^4.2.1

CSS-in-JS

Emotion ^11.14.0

代码规范

Biome ^2.4.6 Prettier ^3.8.1
查看全部依赖 (333)

依赖

@actions/core ^3.0.0 @actions/exec ^3.0.0 @actions/github ^9.0.0 @ai-sdk/openai ^3.0.41 @anthropic-ai/sdk ^0.78.0 @apidevtools/json-schema-ref-parser ^15.3.1 @emotion/styled ^11.14.1 @faker-js/faker ^10.2.0 @googleapis/sheets ^13.0.1 @inquirer/checkbox ^5.1.0 @inquirer/confirm ^6.0.8 @inquirer/core ^11.1.5 @inquirer/editor ^5.0.8 @inquirer/input ^5.0.8 @inquirer/select ^5.1.0 @modelcontextprotocol/sdk ^1.25.3 @mui/material ^7.3.9 @mui/system ^7.3.9 @octokit/auth-app ^8.2.0 @octokit/rest ^22.0.1 @openai/agents ^0.5.4 @opencode-ai/sdk ^1.2.19 @opentelemetry/api ^1.9.0 @opentelemetry/core ^2.6.0 @opentelemetry/exporter-trace-otlp-http ^0.211.0 @opentelemetry/resources ^2.5.0 @opentelemetry/sdk-trace-base ^2.6.0 @opentelemetry/sdk-trace-node ^2.5.0 @opentelemetry/semantic-conventions ^1.39.0 @radix-ui/react-alert-dialog ^1.1.15 @radix-ui/react-checkbox ^1.3.3 @radix-ui/react-collapsible ^1.1.12 @radix-ui/react-dialog ^1.1.15 @radix-ui/react-dropdown-menu ^2.1.16 @radix-ui/react-label ^2.1.8 @radix-ui/react-navigation-menu ^1.2.14 @radix-ui/react-popover ^1.1.15 @radix-ui/react-progress ^1.1.8 @radix-ui/react-radio-group ^1.3.8 @radix-ui/react-select ^2.2.6 @radix-ui/react-separator ^1.1.8 @radix-ui/react-slider ^1.3.6 @radix-ui/react-slot ^1.2.4 @radix-ui/react-switch ^1.2.6 @radix-ui/react-tabs ^1.1.13 @radix-ui/react-tooltip ^1.2.8 @tanstack/react-virtual ^3.13.21 @types/react 19.2.14 @types/react-dom 19.2.3 @types/ws ^8.18.1 NumPy Pandas PyYAML Pydantic SQLAlchemy ai ^6.0.55 aiohappyeyeballs aiohttp aiosignal ajv ^8.18.0 ajv-formats ^3.0.1 annotated-types anyio async ^3.2.6 attrs bert-score better-sqlite3 ^12.6.2 binary-extensions ^3.1.0 cache-manager ^7.2.8 certifi chalk ^5.6.2 charset-normalizer chokidar 5.0.0 chromadb cli-progress ^3.12.0 cli-table3 ^0.6.5 commander ^14.0.3 compression ^1.8.1 cors ^2.8.6 crewai csv-parse ^6.1.0 csv-stringify ^6.6.0 dataclasses-json datasets debounce ^3.0.0 dedent ^1.7.2 distro docker dompurify ^3.3.3 dotenv ^17.2.3 drizzle-orm ^0.45.1 epicbox exceptiongroup execa ^9.6.1 express ^5.2.1 express-rate-limit ^8.2.1 exsolve ^1.0.8 fast-deep-equal ^3.1.3 fast-safe-stringify ^2.1.1 fast-xml-parser ^5.5.0 fastest-levenshtein ^1.0.16 frozenlist gcp-metadata ^8.1.2 github.com/sashabaranov/go-openai v1.37.0 glob ^13.0.6 google-adk gradio h11 http-z ^8.1.1 httpcore httpx httpx-sse idna ink ^6.8.0 istextorbinary ^9.5.0 jiter jks-js ^1.1.5 js-rouge ^3.2.0 js-yaml ^4.1.1 jsdom ^28.1.0 json5 ^2.2.3 jsonpatch jsonpointer keyv ^5.6.0 keyv-file ^5.3.3 langchain langchain-chroma langchain-classic langchain-community langchain-core langchain-openai langchain-text-splitters langgraph langgraph-checkpoint langgraph-prebuilt langgraph-sdk langsmith lightningcss ^1.32.0 lru-cache ^11.2.6 marshmallow mathjs ^15.1.1 minimatch ^10.2.4 multidict mypy_extensions numexpr nunjucks ^3.2.4 openai ^6.25.0 openai-agents opener ^1.5.2 opentelemetry-api opentelemetry-exporter-otlp-proto-http opentelemetry-sdk opentelemetry-semantic-conventions ora ^9.3.0 orjson ormsgpack packaging pem ^1.15.1 pillow posthog-node ~5.24.10 promptfoo file:../promptfoo propcache protobufjs ^8.0.0 proxy-agent ^6.5.0 proxy-from-env ^2.0.0 pydantic-ai pydantic-settings pydantic_core pypdf python-dateutil python-dotenv python-shell ^5.0.0 react-countup ^6.5.3 regex requests-toolbelt rfdc ^1.4.1 rxjs ^7.8.2 semver ^7.7.4 simple-git ^3.32.3 six sniffio socket.io ^4.8.3 socket.io-client ^4.8.3 strands-agents structlog swiper ^12.1.2 tenacity tensorflow text-extensions ^3.1.0 tiktoken torch tqdm transformers tsx ^4.21.0 typing-inspect typing-inspection typing_extensions undici ^7.21.0 urllib3 uuid ^13.0.0 uuid_utils winston ^3.19.0 ws ^8.19.0 xxhash yarl zod ^4.3.6 zstandard

开发依赖

@anthropic-ai/claude-agent-sdk ^0.2.76 @aws-sdk/client-bedrock-agent-runtime ^3.1003.0 @aws-sdk/client-bedrock-runtime ^3.1003.0 @aws-sdk/client-s3 ^3.1003.0 @aws-sdk/client-sagemaker-runtime ^3.1003.0 @aws-sdk/credential-provider-sso ^3.972.16 @aws-sdk/types ^3.973.5 @azure/identity ^4.13.0 @azure/openai-assistants ^1.0.0-beta.6 @calcom/embed-react ^1.5.3 @chromatic-com/storybook ^5.0.1 @docusaurus/core ^3.9.2 @docusaurus/module-type-aliases ^3.9.2 @docusaurus/plugin-client-redirects ^3.9.2 @docusaurus/plugin-content-docs ^3.9.2 @docusaurus/preset-classic ^3.9.2 @docusaurus/theme-mermaid ^3.9.2 @fal-ai/client ~1.9.4 @ibm-cloud/watsonx-ai ^1.7.9 @ibm-generative-ai/node-sdk ^3.2.4 @kurkle/color ^0.4.0 @mdx-js/react ^3.1.1 @monaco-editor/react ^4.7.0 @mui/icons-material ^7.3.9 @segment/ajv-human-errors ^2.16.0 @smithy/types ^4.13.0 @storybook/addon-a11y ^10.2.10 @storybook/addon-docs ^10.2.10 @storybook/addon-onboarding ^10.2.10 @storybook/addon-vitest ^10.2.10 @storybook/react-vite ^10.2.10 @swc/core ^1.15.18 @swc/jest ^0.2.39 @tailwindcss/postcss ^4.2.1 @tanstack/react-table ^8.21.3 @tanstack/table-core ^8.21.3 @testing-library/dom ^10.4.1 @testing-library/jest-dom ^6.9.1 @testing-library/react ^16.3.2 @testing-library/user-event ^14.6.1 @tsconfig/docusaurus ^2.0.9 @types/async ^3.2.25 @types/better-sqlite3 ^7.6.13 @types/cli-progress ^3.11.6 @types/compression ^1.8.1 @types/cors ^2.8.19 @types/express ^5.0.6 @types/jest ^30.0.0 @types/js-yaml ^4.0.9 @types/jsdom ^27.0.0 @types/node ^24.12.0 @types/nunjucks ^3.2.6 @types/opener ^1.4.3 @types/pdf-parse ^1.1.5 @types/pem ^1.14.4 @types/prismjs ^1.26.6 @types/proxy-from-env ^1.0.4 @types/react 19.2.14 @types/react-dom 19.2.3 @types/semver ^7.7.1 @types/source-map-support ^0.5.10 @types/supertest ^6.0.3 @vitejs/plugin-react ^5.2.0 @vitest/browser-playwright ^4.1.0 @vitest/coverage-v8 ^4.1.0 ansi-to-html ^0.7.2 autoprefixer ^10.4.27 babel-plugin-react-compiler ^1.0.0 canvas-confetti ^1.9.4 chart.js ^4.5.1 class-variance-authority ^0.7.1 clsx ^2.1.1 concurrently ^9.2.1 csv-parse ^6.1.0 csv-stringify ^6.6.0 dedent ^1.7.2 depcheck ^1.4.7 diff ^8.0.3 docusaurus-plugin-image-zoom ^3.0.1 drizzle-kit ^0.31.9 framer-motion ^12.34.3 gray-matter ^4.0.3 husky ^9.1.7 ibm-cloud-sdk-core ^5.4.9 idb-keyval ^6.2.2 ink-testing-library ^4.0.0 js-yaml ^4.1.1 jsdom ^28.1.0 knip ^5.85.0 langfuse ^3.38.6 lucide-react ^0.577.0 madge ^8.0.0 nock ^14.0.11 node-sql-parser ^5.4.0 nodemon ^3.1.11 pdf-parse ^2.4.5 playwright-extra ^4.3.6 postcss ^8.5.8 posthog-js ^1.343.0 prism-react-renderer ^2.4.1 prismjs ^1.30.0 promptfoo latest puppeteer-extra-plugin-stealth ^2.11.2 react-dom ^19.2.4 react-error-boundary ^6.1.1 react-is ^19.2.4 react-markdown ^10.1.0 react-router-dom ^7.13.1 react-simple-code-editor ^0.14.1 read-excel-file ^7.0.2 recharts ^3.8.0 remark-gfm ^4.0.1 satori ^0.25.0 shx ^0.4.0 socket.io-client ^4.8.3 source-map-support ^0.5.21 storybook ^10.2.10 supertest ^7.2.2 tailwind-merge ^3.5.0 ts-dedent ^2.2.0 ts-jest ^29.4.6 tsdown 0.21.2 tsx ^4.21.0 typescript ^5.9.3 use-debounce ^10.1.0 winston-transport ^4.9.0

截图

site/static/img/claude-vs-gpt-example@2x.png
https://www.promptfoo.dev/img/docs/self-grading.gif
https://www.promptfoo.dev/img/redteam-dashboard@2x.jpg

评论

Главная - Вики-сайт
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-05-09 15:52
浙ICP备14020137号-1 $Гость$