# promptfoo

Open-source tool for testing prompts, agents, RAG systems, and AI security behavior.

## Summary
promptfoo is an MIT-licensed testing and red-teaming tool for prompts, agents, RAG pipelines, and AI application behavior, with declarative configs and CI/CD-friendly workflows.


## Guide
promptfoo is an MIT-licensed testing and red-teaming tool for prompts, agents, RAG pipelines, and AI application behavior, with declarative configs and CI/CD-friendly workflows.

### What it is
promptfoo is listed on OpenAgent.bot as a tools resource for open AI builders.

### Why it matters
Agent teams need repeatable tests before shipping changes. promptfoo gives builders a practical way to compare prompts, models, providers, and safety behavior without relying only on manual review.

### How it works
Start from the official source links, then validate the project against your deployment needs, license requirements, and maintenance expectations.


### Getting Started
- Review the repository: https://github.com/promptfoo/promptfoo
- Homepage: https://promptfoo.dev
## Why It Matters
Agent teams need repeatable tests before shipping changes. promptfoo gives builders a practical way to compare prompts, models, providers, and safety behavior without relying only on manual review.


## Best For
- Teams testing prompts, agents, and RAG systems
- Developers adding AI evaluations to CI/CD
- Builders doing red-team or vulnerability checks on AI workflows

## Not For
- Teams that need only production tracing
- Users who want a benchmark score without writing test cases

## What It Actually Does
- Automation: promptfoo surfaces automation as a core capability in its published project metadata and source links.
  - Why it matters: This gives readers a starting point for evaluating whether the project fits their workflow before visiting the source repository or docs.
- Workflow: promptfoo surfaces workflow as a core capability in its published project metadata and source links.
  - Why it matters: This gives readers a starting point for evaluating whether the project fits their workflow before visiting the source repository or docs.
- Rag: promptfoo surfaces rag as a core capability in its published project metadata and source links.
  - Why it matters: This gives readers a starting point for evaluating whether the project fits their workflow before visiting the source repository or docs.

## Typical Use Cases
- Self hosted ai: Use it as a candidate for self hosted ai when the project facts, license, and official links match your deployment requirements.

## How It Compares
- When to choose promptfoo: Compare it with nearby tools by looking at hosting model, integration surface, license, and whether the official docs show the workflow you need.

## Command Line
### Install or run
```bash
npx promptfoo@latest init
```

## Facts
- Category: tools
- Resource type: tool
- Open source: yes
- License: MIT
- Last verified: 2026-06-02
- GitHub repo: promptfoo/promptfoo
- GitHub stars: 21787

## Capabilities
- automation
- workflow
- rag

## Structured Use Case Tags
- self-hosted-ai

## Getting Started
- Review the repository: https://github.com/promptfoo/promptfoo
- Homepage: https://promptfoo.dev

## Links
- GitHub: https://github.com/promptfoo/promptfoo
- Homepage: https://promptfoo.dev

## Structured Outputs
- JSON: https://www.openagent.bot/tools/promptfoo.json
- Markdown: https://www.openagent.bot/tools/promptfoo.md
- Canonical: https://www.openagent.bot/tools/promptfoo