Documentation for LangSmith, Fleet, and our open source packages.
-
Create Connection
-
List Connections
-
Remove Connection
-
Authenticate
-
Check Oauth Token Exists
-
Check Workspace Slack Tokens Exist
-
Create Mcp Oauth Provider
-
Create Oauth Provider
-
Delete Oauth Provider
-
Delete Oauth Tokens For User
-
Delete Single Oauth Token
-
Get Oauth Provider
-
List Oauth Providers
-
List Oauth Tokens For User
-
Oauth Callback
-
Oauth Callback Get
-
Oauth Setup Callback
-
Revoke All Slack Tokens For Workspace
-
Update Oauth Provider
-
Update Token Label
-
Wait For Auth Completion
-
Create Deployment
-
Delete Deployment
-
Delete Deployments
-
Get Deployment
-
Get Revision
-
List Deployments
-
List Revisions
-
Patch Deployment
-
Redeploy Revision
-
List Forge GitHub Integrations
-
List Forge GitHub Repositories
-
List GitHub Integrations
-
List GitHub Repositories
-
Create Listener
-
Delete Listener
-
Get Listener
-
List Listeners
-
Patch Listener
-
Link: [](
-
Attribute-based access control
-
Access the current run (span) within a traced function
-
Connect an authentication provider
-
Human-in-the-loop using server API
-
Add metadata and tags to traces
-
Account
-
Overview
-
Set up Agent Auth (Beta)
-
Agent Server
-
A2A JSON-RPC
-
Count Assistants
-
Create Assistant
-
Delete Assistant
-
Get Assistant
-
Get Assistant Graph
-
Get Assistant Schemas
-
Get Assistant Subgraphs
-
Get Assistant Subgraphs by Namespace
-
Get Assistant Versions
-
Patch Assistant
-
Search Assistants
-
Set Latest Assistant Version
-
Count Crons
-
Create Cron
-
Create Thread Cron
-
Delete Cron
-
Get Cron
-
Search Crons
-
Update Cron
-
MCP Get
-
MCP Post
-
Terminate Session
-
Create Background Run
-
Create Run Batch
-
Create Run, Stream Output
-
Create Run, Wait for Output
-
Delete an item.
-
List namespaces with optional match conditions.
-
Retrieve a single item.
-
Search or list items within a namespace prefix.
-
Store or update an item.
-
Protocol v2 Command
-
Protocol v2 Event Stream (SSE)
-
API Documentation
-
Health Check
-
Server Information
-
System Metrics
-
Cancel Run
-
Cancel Runs
-
Create Background Run
-
Create Run, Stream Output
-
Create Run, Wait for Output
-
Delete Run
-
Get Run
-
Join Run
-
Join Run Stream
-
List Runs
-
Copy Thread
-
Count Threads
-
Create Thread
-
Delete Thread
-
Get Thread
-
Get Thread History
-
Get Thread History Post
-
Get Thread State
-
Get Thread State At Checkpoint
-
Get Thread State At Checkpoint
-
Join Thread Stream
-
Patch Thread
-
Prune Threads
-
Search Threads
-
Update Thread State
-
Agent Server changelog
-
Distributed tracing with Agent Server
-
How to collect user feedback for Agent Server runs
-
Configure LangSmith Agent Server for scale
-
Alerts in LangSmith
-
Analyze an experiment
-
Custom instrumentation
-
Annotate traces and runs inline
-
Use annotation queues
-
Manage feedback & annotation queues programmatically
-
Control plane API reference for LangSmith Deployment
-
Application structure
-
Use assertions
-
Assistants
-
Log user feedback using the SDK
-
How to audit evaluator scores
-
Audit logs
-
Authentication & access control
-
Authentication methods
-
Self-hosted LangSmith on AWS
-
Self-hosted LangSmith on Azure
-
How to kick off background runs
-
Export trace data to BigQuery
-
Manage billing in your account
-
Automatically run evaluators on experiments
-
Use server-side caching
-
How to cancel a run
-
LangSmith Cloud changelog
-
LangSmith Chat
-
LangSmith Chat
-
LangSmith Chat
-
LangSmith Chat
-
Implement a CI/CD pipeline using LangSmith Deployment and Evaluation
-
LangGraph CLI
-
Cloud (SaaS)
-
How to define a code evaluator
-
How to define a code evaluator
-
How to compare experiment results
-
LangSmith Deployment components
-
How to create a composite evaluator
-
How to create a composite evaluator
-
Conditional tracing
-
Use HTTP headers for runtime configuration
-
Include HTTP headers in server logs
-
Manage assistants
-
Configure checkpointer backend
-
Configure run input and output preview
-
How to add TTLs to your application
-
Context engineering concepts
-
Context Hub
-
LangSmith control plane
-
Core capabilities overview
-
Cost tracking
-
Create a prompt
-
Create an account and API key
-
How to improve your evaluator with few-shot examples
-
Use cron jobs
-
Add custom authentication
-
How to use a custom checkpointer
-
How to customize the Dockerfile
-
Connect to a custom model
-
How to add custom lifespan events
-
How to add custom middleware
-
Connect to an OpenAI compliant model provider/proxy
-
Custom output rendering
-
How to add custom routes
-
How to use a custom store
-
Monitor projects with dashboards
-
Bulk export trace data
-
Manage bulk export destinations
-
Import exported data
-
Monitor and troubleshoot bulk exports
-
LangSmith data plane
-
Data purging for compliance
-
Data storage and privacy
-
Dataset prebuilt JSON schema types
-
Dataset transformations
-
How to define a target function to evaluate
-
Deploy Google ADK agents
-
Deploy other frameworks
-
Enable LangSmith Deployment, Fleet, Insights, and Chat
-
Self-host standalone servers
-
Deploy on Cloud
-
Deploy with control plane
-
LangSmith Deployment
-
Deploy your app to cloud
-
Deploy Managed Deep Agents
-
Troubleshooting for self-hosted deployments
-
Implement distributed tracing
-
Double texting
-
Add encryption at rest
-
Find and fix your agent's failures with LangSmith Engine
-
LangSmith Engine
-
LangSmith Engine
-
LangSmith Engine webhook events
-
Enqueue concurrent
-
LangSmith for Enterprise
-
Environment variables
-
Evaluate a chatbot
-
Evaluate a complex agent
-
How to add evaluators to an existing experiment (Python only)
-
How to evaluate a graph
-
How to evaluate an LLM application
-
How to evaluate an application's intermediate steps
-
How to run a pairwise evaluation
-
Evaluate a RAG application
-
Run an evaluation with multimodal content
-
How to evaluate with OpenTelemetry
-
How to retry failed runs in experiments (Python only)
-
LangSmith Evaluation
-
Application-specific evaluation approaches
-
How to run an evaluation asynchronously
-
Evaluation concepts
-
Evaluation quickstart
-
Evaluation types
-
Manage evaluators
-
Event streaming API
-
Example data format
-
Experiment configuration
-
Export LangSmith telemetry to your observability backend
-
Query traces using the SDK
-
Frequently asked questions
-
Feedback data format
-
How to fetch performance metrics for an experiment
-
How to filter experiments in the UI
-
Filter traces
-
Access & oversight
-
Agent identity
-
Arcade integration
-
Auth-aware tool responses
-
LangSmith Fleet changelog
-
Channels
-
Use Fleet agents in code
-
Agent platform comparison
-
Computer use
-
Essentials
-
No-code agents with LangSmith Fleet
-
Manage agent settings
-
LangSmith Tool Server
-
Quickstart
-
Remote MCP servers
-
Salesforce integration
-
Schedules
-
Self-hosted
-
Skills
-
Integrate Slack with an agent
-
Integrate Teams with an agent
-
Templates
-
Tool integrations
-
Fleet webhooks
-
Manage workspace administration
-
Self-hosted LangSmith on GCP
-
How to implement generative user interfaces with LangGraph
-
Integrations
-
Governance
-
Granular billable usage
-
Rebuild graph at runtime
-
Time travel using the server API
-
Hybrid
-
Setup guide (legacy)
-
Improve LLM-as-judge evaluators using human feedback
-
Discover errors and usage patterns with Insights
-
Integrations
-
Interrupt concurrent
-
Manage user access in SSO organizations
-
Self-host LangSmith on Kubernetes
-
How to evaluate a runnable
-
LangGraph JS/TS SDK
-
LangGraph Python SDK
-
LangSmith CLI
-
Configure your collector for LangSmith telemetry
-
LangSmith-managed ClickHouse
-
LangSmith MCP Server
-
LangSmith Remote MCP
-
How to define an LLM-as-a-judge evaluator
-
How to define an LLM-as-a-judge evaluator
-
Set up the LLM auth proxy
-
LLM Gateway
-
Custom model providers
-
PII and secrets redaction
-
Spend policies
-
How to run an evaluation locally (Python only)
-
Local development & testing
-
Log LLM calls
-
Log multimodal traces
-
Log retriever traces
-
Log traces to a specific project
-
Metadata parameters reference
-
Manage contexts with the SDK
-
Manage datasets
-
Create and manage datasets in the UI
-
How to create and manage datasets programmatically
-
Manage your organization using the API
-
Manage prompts
-
Manage prompts programmatically
-
Manage a trace
-
Manage LangSmith with Terraform
-
Managed Deep Agents
-
Managed Deep Agents API reference
-
Managed Deep Agents API reference
-
Check agent health
-
Clone an agent
-
Create an agent
-
Delete an agent
-
Get an agent
-
List agents
-
Update an agent
-
Get an authorization session
-
Start an authorization session
-
Register an MCP server
-
Delete an MCP server
-
Get an MCP server
-
List MCP servers
-
Register per-user MCP OAuth provider
-
Update an MCP server
-
List MCP tools
-
Create a thread and start a run
-
Create a thread run
-
Resolve an interrupt
-
Stream a thread run
-
Bulk update threads
-
Count threads
-
Create a thread
-
Delete thread
-
Get thread
-
List threads
-
Search threads
-
Update thread
-
Managed Deep Agents CLI reference
-
Deploy a Managed Deep Agent
-
Run a Managed Deep Agent
-
Connect MCP tools to Managed Deep Agents
-
Managed Deep Agents
-
Managed Deep Agents quickstart
-
Managed Deep Agents SDKs
-
Configure prompt settings
-
Prevent logging of sensitive data in traces
-
Messages view integrations
-
Messages view trace format reference
-
How to return categorical vs numerical metrics
-
Manage model configurations
-
Monorepo support
-
How to simulate multi-turn interactions
-
Include multimodal content in a prompt
-
Test multi-turn conversations
-
How to return multiple scores in one evaluator
-
Troubleshoot trace nesting
-
LangSmith Observability
-
Observability concepts
-
Trace an LLM application tutorial
-
Tracing quickstart
-
Deploy an observability stack for your LangSmith deployment
-
Observability in Studio
-
Set up online code evaluators
-
Set up composite online evaluators
-
Set up LLM-as-a-judge online evaluators
-
Set up multi-turn online evaluators
-
Document API authentication in OpenAPI
-
Run evals with openevals package
-
Optimize a classifier
-
Organization and workspace operations reference
-
Redact sensitive data with the OpenTelemetry Gateway architecture
-
Set up LangSmith
-
Model providers
-
Collect feedback with presigned URLs
-
Pricing plans
-
Profile configuration
-
How to sync prompts with GitHub
-
Prompt engineering
-
Prompt engineering concepts
-
Prompt engineering quickstart
-
Prompt template format guide
-
How to run evaluations with pytest
-
Query threads using the SDK
-
Get started with Studio
-
How to handle model rate limits
-
Role-based access control
-
How to read experiment results locally
-
LangSmith reference
-
Regions FAQ
-
Reject Concurrent
-
Release policy
-
RemoteGraph
-
How to evaluate with repetitions
-
Make conversations private
-
Rollback Concurrent
-
Set up automation rules
-
Run backtests on a new version of an agent
-
Run (span) data format
-
How to use the REST API
-
Run an evaluation from the Playground
-
Runs
-
How to run multiple agents on the same thread
-
Set a sampling rate for traces
-
Sandbox auth proxy
-
Sandbox CLI
-
Run evaluations with Harbor
-
Sandbox access permissions
-
Sandbox SDK usage
-
Sandbox service URLs
-
Sandbox snapshots
-
LangSmith Sandboxes
-
Scalability & resilience
-
Delete workspaces
-
Delete organizations
-
Delete traces
-
Generate ClickHouse stats
-
Generate query stats
-
Run support queries against ClickHouse
-
Run support queries against PostgreSQL
-
Basic authentication with email and password
-
Enable blob storage
-
Configure custom TLS certificates
-
Minimum versions for self-hosting dependencies
-
Disaster recovery for self-hosted LangSmith
-
Egress for billing and operational telemetry
-
Configure environment variables in the Helm chart
-
Connect to an external ClickHouse database
-
Connect to an external PostgreSQL database
-
Connect to an external Redis or Valkey database
-
FIPS-compliant images
-
Create an Ingress for installations (Kubernetes)
-
Mirror images for your LangSmith installation
-
View trace counts across your organization
-
Use environment variables for model providers
-
Configure LangSmith for scale
-
Set up SSO with OAuth2.0 and OIDC
-
Enable TTL and data retention
-
Customize the error support message
-
Upgrade an installation
-
Interact with your self-hosted instance of LangSmith
-
Customize user management
-
Use an existing secret for your installation (Kubernetes)
-
Self-hosted LangSmith
-
Self-hosted LangSmith changelog
-
Install Mission Control
-
How to add semantic search to your agent deployment
-
A2A endpoint in Agent Server
-
Agent Server API reference for LangSmith Deployment
-
MCP endpoint in Agent Server
-
Trace JS functions in serverless environments
-
Set up custom authentication
-
Set up feedback criteria
-
Set up hierarchy
-
Set up resource tags
-
How to set up an application with requirements.txt
-
How to set up a JavaScript application
-
How to set up an application with pyproject.toml
-
LangSmith shared responsibility model
-
LangSmith skills
-
LangSmith API reference
-
Attach access policies to a role
-
Create an access policy
-
Delete an access policy
-
Get an access policy
-
List access policies
-
Execute
-
Create an alert rule
-
Delete an alert rule
-
Get an alert rule
-
Test an alert action to determine if configuration is valid
-
Update an alert rule
-
Add Runs To Annotation Queue
-
Add Runs To Annotation Queue By Key
-
Create Annotation Queue
-
Create Identity Annotation Queue Run Status
-
Delete Annotation Queue
-
Delete Annotation Queues
-
Delete Run From Annotation Queue
-
Delete Runs From Annotation Queue
-
Export Annotation Queue Archived Runs
-
Get Annotation Queue
-
Get Annotation Queues
-
Get Annotation Queues For Run
-
Get Run From Annotation Queue
-
Get Runs From Annotation Queue
-
Get Size From Annotation Queue
-
Get Total Archived From Annotation Queue
-
Get Total Size From Annotation Queue
-
Populate Annotation Queue
-
Resolve Annotation Queue Run
-
Update Annotation Queue
-
Update Run In Annotation Queue
-
Add a reviewer to an annotation queue
-
Remove a reviewer from an annotation queue
-
Delete Api Key
-
Delete Personal Access Token
-
Generate Api Key
-
Generate Personal Access Token
-
Get Api Keys
-
Get Personal Access Tokens
-
Get Audit Logs
-
Check Sso Email Verification Status
-
Confirm Sso User Email
-
Get public auth info
-
Get Sso Settings
-
Login
-
Lookup Sso By Email
-
Send Sso Email Confirmation
-
AWS Marketplace fulfillment URL registration
-
Restart a backfill job
-
Cancel Bulk Export
-
Create Bulk Export
-
Create Bulk Export Destination
-
Get Bulk Export
-
Get Bulk Export Destination
-
Get Bulk Export Destinations
-
Get Bulk Export Run
-
Get Bulk Export Runs
-
Get Bulk Export Runs Filtered
-
Get Bulk Exports
-
Update Bulk Export Destination
-
Clone Section
-
Create Chart
-
Create Section
-
Delete Chart
-
Delete Section
-
Org Create Chart
-
Org Create Section
-
Org Delete Chart
-
Org Delete Section
-
Org Read Chart Preview
-
Org Read Charts
-
Org Read Sections
-
Org Read Single Chart
-
Org Read Single Section
-
Org Update Chart
-
Org Update Section
-
Read Chart Preview
-
Read Charts
-
Read Sections
-
Read Single Chart
-
Read Single Section
-
Update Chart
-
Update Section
-
Create Comment
-
Create Sub Comment
-
Get Comments
-
Get Sub Comments
-
Like Comment
-
Unlike Comment
-
Create a commit
-
Get a commit
-
List commits
-
Create a new data plane
-
List data planes for the current organization
-
Clone Dataset
-
Create Comparative Experiment
-
Create Dataset
-
Delete Comparative Experiment
-
Delete Dataset
-
Delete Datasets
-
Diff Dataset Versions
-
Download Dataset Csv
-
Download Dataset Jsonl
-
Download Dataset Openai
-
Download Dataset Openai Ft
-
Generate
-
Get Dataset Splits
-
Get Dataset Version
-
Get Dataset Versions
-
Read Comparative Experiments
-
Read Dataset
-
Read Dataset Share State
-
Read Datasets
-
Read Datasets Stream
-
Read Delta
-
Read Delta Stream
-
Read Examples With Runs
-
Read Examples With Runs Grouped
-
Read Grouped Experiments
-
Share Dataset
-
Studio Experiment
-
Unshare Dataset
-
Update Dataset
-
Update Dataset Splits
-
Update Dataset Version
-
Upload Csv Dataset
-
Upload Experiment
-
Create directory commit
-
Delete directory repository
-
Get directory contents
-
Respond to Engine trial ending notice
-
Bulk delete evaluators
-
Create evaluator
-
Delete evaluator
-
Get evaluator
-
Get evaluator spend
-
List evaluators
-
Update evaluator
-
Count Examples
-
Create Example
-
Create Examples
-
Delete Example
-
Delete Examples
-
Hard Delete Examples
-
Legacy Update Examples
-
Read Example
-
Read Examples
-
Update Example
-
Update Examples
-
Upload Examples
-
Upload Examples From Csv
-
Validate Example
-
Validate Examples
-
Create new experiment view override configuration for a dataset
-
Delete experiment view override configuration
-
Get experiment view override configuration by specific ID
-
Get experiment view override configurations for a dataset
-
Update existing experiment view override configuration
-
Evaluate Experiment Adhoc
-
Delete default model for a feature
-
Disable a model for a feature
-
List feature configurations
-
Re-enable a disabled model for a feature
-
Set default model for a feature
-
Create Feedback Config Endpoint
-
Delete Feedback Config Endpoint
-
List Feedback Configs Endpoint
-
Update Feedback Config Endpoint
-
Create Feedback
-
Create Feedback Formula Ep
-
Create Feedback Ingest Token
-
Create Feedback With Token Get
-
Create Feedback With Token Post
-
Delete Feedback
-
Delete Feedback Formula Endpoint
-
Eagerly Create Feedback
-
Get Feedback Formula Ep
-
List Feedback Formula Ep
-
List Feedback Ingest Tokens
-
Read Feedback
-
Read Feedbacks
-
Update Feedback
-
Update Feedback Formula Ep
-
Create a gateway policy
-
Delete a gateway policy
-
Get a gateway policy
-
List gateway policies
-
Update a gateway policy
-
Create hub environments model
-
Delete hub environments model
-
List hub environments
-
Update hub environments model
-
Get Health Info
-
Get Server Info
-
Get Agent Builder integrations settings
-
Update Agent Builder integrations settings
-
Link: [[Beta] Create the issues agent for a session](
-
Link: [[Beta] Delete the issues agent for a session](
-
Link: [[Beta] Get the issues agent config for a session](
-
Link: [[Beta] List issues agent configs](
-
Link: [[Beta] Save the agent overview for a session](
-
Link: [[Beta] Update the issues agent config for a session](
-
Get issues-agent (Engine) LCU spend per project for the calling org
-
Roll an issues agent webhook signing secret
-
Link: [[Beta] List issues](
-
Link: [[Beta] List viewed issues for a session](
-
Link: [[Beta] Mark issue viewed](
-
Like Repo
-
Get Tools
-
Invalidate Tools Cache
-
Proxy
-
Proxy Get
-
Create vendor settings
-
Delete vendor settings
-
Get MCP vendor
-
Get vendor account
-
Get vendor settings
-
List MCP servers for a vendor
-
List MCP vendors
-
List tools for a vendor
-
Replace vendor settings
-
Create Onboarding State
-
Get Ls User Id
-
Get Onboarding State
-
Get the authenticated user's provider user ID
-
Update Onboarding State Field
-
Create New Model Price
-
Delete Model Price
-
Read Model Price Map
-
Update Model Price
-
Approve OAuth2 authorization request
-
Authorize a device code
-
Exchange grant for OAuth2 tokens