| name | pydanticai |
| description | Build type-safe AI agents and graph-based workflows with PydanticAI and PydanticGraph. Agent creation, function tools, capabilities, dependency injection, structured output, streaming, multi-agent patterns, testing, evals, and graph state machines. Use whenever you are building agents, tool-using LLM workflows, or graph-based state machines in Python. |
| license | MIT |
| metadata | {"source":"https://pydantic.dev/docs/ai/overview/","version":"1.0.4"} |
| compatibility | Python 3.10+; requires pydantic-ai or pydantic-ai-slim package |
PydanticAI & PydanticGraph Expert Skill
PydanticAI is a Python agent framework for building production-grade GenAI applications, built by the team behind Pydantic. PydanticGraph is its companion graph/state-machine library.
Install:
pip install pydantic-ai
pip install "pydantic-ai-slim[openai]"
Quick Reference
from pydantic_ai import Agent
agent = Agent('openai:gpt-5.2', instructions='Be concise.')
result = agent.run_sync('What is the capital of France?')
print(result.output)
When to Load Which Reference
| Topic | Load When | File |
|---|
| Agent creation & lifecycle | You need to create, configure, or run an agent — define tools, deps, output types, run methods, streaming | references/core-agents.md |
| Capabilities & hooks | You need built-in capabilities (Thinking, WebSearch, MCP, etc.), on-demand loading, lifecycle hooks, or custom capabilities | references/capabilities-hooks.md |
| PydanticGraph | You need a state machine, graph-based control flow, parallel execution, BaseNode subclasses, or GraphBuilder with joins/decisions | references/graph.md |
| Models, output & streaming | You need multi-model setups, FallbackModel, streaming output, output functions, or structured output with validation | references/models-output.md |
| Multi-agent patterns & integrations | You need agent delegation, programmatic hand-off, MCP servers, durable execution, or UI adapters | references/patterns.md |
| Testing & evaluation | You need TestModel, FunctionModel, pytest patterns, overrides, or Pydantic Evals for systematic eval | references/testing-evals.md |
| Full worked examples | You want complete runnable examples — bank support agent, email feedback graph, multi-agent flight booking | references/examples.md |
| Framework boundaries | You need to compare PydanticAI vs LangGraph for a project, or want to combine them | references/hybrid-pydanticai-langgraph.md — also load skill_view(name='langgraph') |
| API surface reference | You need to find the right import path, class name, or method signature quickly | references/api-reference.md |
Common Patterns at a Glance
Agent with tools and structured output
from pydantic import BaseModel
from pydantic_ai import Agent, RunContext
class WeatherResult(BaseModel):
temperature: float
conditions: str
agent = Agent('openai:gpt-5.2', output_type=WeatherResult)
@agent.tool
async def get_weather(ctx: RunContext, city: str) -> str:
"""Get current weather for a city."""
return f"24°C and sunny in {city}"
result = agent.run_sync('Weather in London?')
print(result.output.temperature)
→ See references/core-agents.md for full agent lifecycle, run methods, and tool patterns.
Agent with dependency injection
from dataclasses import dataclass
from pydantic_ai import Agent, RunContext
@dataclass
class MyDeps:
api_key: str
db_conn: str
agent = Agent('openai:gpt-5.2', deps_type=MyDeps)
@agent.tool
async def query_db(ctx: RunContext[MyDeps], sql: str) -> str:
return f"Query results using {ctx.deps.db_conn}"
→ See references/core-agents.md for dependency injection patterns and testing overrides.
Graph with multiple nodes
from dataclasses import dataclass
from pydantic_graph import BaseNode, End, GraphRunContext, GraphBuilder
@dataclass
class MyState:
value: int = 0
@dataclass
class ProcessNode(BaseNode[MyState]):
async def run(self, ctx: GraphRunContext[MyState]) -> End | NextNode:
ctx.state.value += 1
if ctx.state.value >= 5:
return End(ctx.state.value)
return NextNode()
→ See references/graph.md for both BaseNode and GraphBuilder APIs, parallel execution, and join/reducer patterns.
When to use which run method
| When you need… | Use | Key behavior |
|---|
| A single answer, sync code | run_sync() | Blocks until complete, returns RunResult |
| A single answer, async code | run() | Async, returns RunResult |
| Stream text as it's generated | run_stream() | Async context manager, yields stream_text() / stream_output() |
| See granular events (tool calls, part starts, deltas) | run_stream_events() | Yields AgentStreamEvent types — FunctionToolCallEvent, PartStartEvent, FinalResultEvent |
| Manual control over each graph step | iter() | Iterate over agent's internal graph nodes (UserPromptNode → ModelRequestNode → CallToolsNode) |
| Tool calls to execute during streaming | run_stream_events() or run(event_stream_handler=...) | run_stream() stops at the first output that matches output_type and does NOT execute subsequent tool calls |
Details for each run method in references/core-agents.md.
Graph API: BaseNode vs GraphBuilder
| Factor | BaseNode (class-based) | GraphBuilder (function-based) |
|---|
| Style | Subclass BaseNode[StateT], implement async run() | Decorate async functions with @g.step |
| State mutation | Via ctx.state inside run() method | Via ctx.state inside step function |
| Parallelism | Manual fork/join logic | Built-in .map() per-element fan-out and .broadcast() same-input-to-multiple |
| Joins / aggregation | Manual aggregation in return types | Built-in reducers: reduce_list_append, reduce_sum, reduce_dict_update, etc. |
| Edge declaration | Inferred from run() return type annotation | Explicit via g.edge_from(source).to(target) |
| When to use | Complex node logic, OO patterns, conditional edge logic | Simple linear flows, parallel data processing, concise syntax |
Both APIs in references/graph.md.
Framework boundaries: PydanticAI vs LangGraph
Both frameworks build agentic systems with graphs and tools, but they differ sharply in design philosophy. The right choice depends on what you're optimizing for.
| Factor | PydanticAI + PydanticGraph | LangGraph | Using both together |
|---|
| Design philosophy | Type-safe, data-schema-driven. Feels like FastAPI. | Low-level graph primitives (Pregel/Beam inspired). Feels like NetworkX. | PydanticAI for the agent layer; LangGraph for complex orchestration |
| Agent definition | Agent(model, tools, deps, output_type) — declarative, one line | Manual StateGraph nodes with message-passing | PydanticAI Agent as a node function inside LangGraph StateGraph |
| Tool calling | @agent.tool decorator, auto-schema from type hints, RunContext DI | Manual tool registration, tool_node = ToolNode(tools) | PydanticAI's typed tool definitions used within LangGraph nodes |
| State management | GraphRunContext.state — mutable dataclass, in-memory | State with typed reducers, checkpointers (SQLite/Postgres) | LangGraph checkpointer for the outer flow; PydanticGraph for sub-graph state |
| Multi-agent patterns | Agent delegation (tool-call), programmatic hand-off, graph-based | Supervisor (central router), swarm (direct handoff), hierarchical (subgraphs) | PydanticAI delegation within a LangGraph supervisor node |
| Persistence | Durable execution via Temporal, Inngest, Prefect, DBOS | Built-in checkpointers (MemorySaver, SqliteSaver, PostgresSaver) | LangGraph checkpointer at graph level |
| Streaming | 5 methods: run, run_sync, run_stream, run_stream_events, iter | .stream() / .astream_events() on compiled graph | LangGraph .astream_events() wrapping PydanticAI event handlers |
| Learning curve | Lower — type hints guide everything | Higher — more manual wiring | Highest — two mental models |
| Best for | Single agents, tool-using workflows, type-safe structured output, teams new to agents | Complex state machines, multi-agent with branching/cycles, HITL, existing LangChain users | Large systems needing type-safe agents AND sophisticated orchestration |
Boundary conditions — consider LangGraph when:
- You need built-in checkpointing/persistence for long-running conversations (SQLite, Postgres backends built-in)
- Your multi-agent system needs subgraph composition with isolated state namespaces
- You need human-in-the-loop patterns (interrupt/resume, state editing, approval workflows)
- You're already using LangChain and want consistency
- Your graph needs cycles or dynamic fan-out via
Send()
Consider PydanticAI when:
- Type safety and IDE autocomplete are priorities
- You want declarative agents with minimal boilerplate
- You need structured output with automatic validation and retries
- Your multi-agent needs are simple delegation or sequential hand-off
- You value the composable capabilities system (Thinking, WebSearch, MCP as plugins)
Consider using both when:
- You need LangGraph's orchestration (checkpointing, subgraphs, HITL) for the outer loop, but want PydanticAI's type-safe agent definition and tool schema for the inner agent logic
- You have a mixed team: some agents benefit from PydanticAI's typing, others need LangGraph's low-level control
- See
references/hybrid-pydanticai-langgraph.md for a complete worked example.
LangGraph skill: skill_view(name='langgraph') — covers supervisor/swarm/hierarchical patterns, persistence, production deployment, and evals.
Error handling quick-pick
from pydantic_ai import UnexpectedModelBehavior, capture_run_messages
with capture_run_messages() as messages:
try:
result = agent.run_sync('Query')
except UnexpectedModelBehavior as e:
cause = e.__cause__
print(f"Root cause: {cause}")
print("Full conversation:", messages)
| Exception | Meaning | Recovery |
|---|
UnexpectedModelBehavior | Retry limit exceeded or model gave unexpected response | Inspect e.__cause__, check messages, adjust instructions or tool retries |
ModelRetry (raised from tools) | Tool wants model to retry with different args | Let it propagate — PydanticAI handles it automatically up to retries limit |
ModelAPIError | Provider returned 4xx/5xx | Check API key, rate limits, model availability |
UsageLimitExceeded | Token/request budget exhausted | Increase UsageLimits or optimize prompt |
HookTimeoutError | A lifecycle hook timed out | Increase hook timeout or optimize hook logic |
Key CLI Commands
pip install pydantic-ai
pip install "pydantic-ai-slim[openai]"
pip install "pydantic-ai-slim[openai,google,anthropic]"
Directory Structure
pydanticai/
├── SKILL.md
├── references/
│ ├── core-agents.md # Agent lifecycle, tools, deps, output
│ ├── capabilities-hooks.md # Capabilities system & lifecycle hooks
│ ├── graph.md # PydanticGraph (BaseNode + GraphBuilder)
│ ├── models-output.md # Models, streaming, structured output
│ ├── patterns.md # Multi-agent patterns & integrations
│ ├── testing-evals.md # Testing & evaluation framework
│ ├── examples.md # Complete worked examples
│ ├── hybrid-pydanticai-langgraph.md # PydanticAI as LangGraph node (hybrid pattern)
│ └── api-reference.md # Quick API surface reference
Gotchas
-
Output type = final only: The output_type constrains the final response. The model can still call tools (function tools) mid-run. Output functions are different — they're forced to be called and end the run.
-
pydantic-graph has zero dependency on pydantic-ai: It's a standalone library. You can use it for non-GenAI state machines. Install with pip install pydantic-graph.
-
pydantic-ai-slim vs pydantic-ai: The slim package ships only core deps + OpenTelemetry. The full pydantic-ai is a meta-package that adds openai, anthropic, google, cli, mcp, evals, web, retries, and logfire extras.
-
Tool calls during streaming by default DON'T execute: run_stream() stops at the first output that matches the output type. Use run_stream_events() or run() with event_stream_handler to keep tool calls executing.
-
System prompt ≠ instructions: System prompts are part of message history and round-trip. Instructions are server-side and don't appear in messages sent to clients. When reusing message_history, the agent's new system prompt won't automatically be sent unless you add ReinjectSystemPrompt.
-
conversation_id is manual for forking: Pass conversation_id='new' to start a fresh conversation chain from existing history. It's not automatic.
-
Models named provider:model_name — PydanticAI auto-resolves the model class from the string prefix. For custom endpoints, use OpenAIChatModel(model_name, provider=OpenAIProvider(base_url=...)).
-
TestModel can't emulate native tools: Override with agent.override(model=TestModel(), native_tools=[]) in tests if your agent uses WebSearch, etc.
-
defer_model_check=True for testable module-level agents: When declaring an Agent at module level (outside a function) and using TestModel in tests with agent.override(model=TestModel()), set defer_model_check=True on the constructor. Without it, the agent tries to resolve the model string at import time — which fails without API credentials, even though the real model is overridden before any test runs.