Menu
Documentation for LangSmith, Fleet, and our open source packages.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. This llms.txt indexes the official Ansible Community Documentation (latest stable). Source: https://docs.ansible.com/projects/ansible/latest/
A proposal that those interested in providing LLM-friendly content add a /llms.txt file to their site. This is a markdown file that provides brief background information and guidance, along with links to markdown files providing more detailed information.
An ultra-portable web-browser engine for games and desktop apps.
Documentation - Discord documentation and resources. Use this skill when working with Documentation - Discord or when the user mentions documentation - discord.
The official documentation for building on the Slack platform: apps, agents, workflows, and integrations. Covers the Slack CLI, Bolt frameworks (JavaScript, Python, Java), SDKs, the Web and Events APIs, Block Kit, authentication, and Slack Marketplace distribution.
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
| name | langchain-docs |
| description | Documentation for LangSmith, Fleet, and our open source packages. |
| metadata | {"source":"llms.txt","source_url":"https://docs.langchain.com/llms.txt","generated":"2026-06-16T04:43:25.491Z"} |
Documentation for LangSmith, Fleet, and our open source packages.
Documentation for LangSmith, Fleet, and our open source packages.
Create Connection
List Connections
Remove Connection
Authenticate
Check Oauth Token Exists
Check Workspace Slack Tokens Exist
Create Mcp Oauth Provider
Create Oauth Provider
Delete Oauth Provider
Delete Oauth Tokens For User
Delete Single Oauth Token
Get Oauth Provider
List Oauth Providers
List Oauth Tokens For User
Oauth Callback
Oauth Callback Get
Oauth Setup Callback
Revoke All Slack Tokens For Workspace
Update Oauth Provider
Update Token Label
Wait For Auth Completion
Create Deployment
Delete Deployment
Delete Deployments
Get Deployment
Get Revision
List Deployments
List Revisions
Patch Deployment
Redeploy Revision
List Forge GitHub Integrations
List Forge GitHub Repositories
List GitHub Integrations
List GitHub Repositories
Create Listener
Delete Listener
Get Listener
List Listeners
Patch Listener
Link: [](
Attribute-based access control
Access the current run (span) within a traced function
Connect an authentication provider
Human-in-the-loop using server API
Add metadata and tags to traces
Account
Overview
Set up Agent Auth (Beta)
Agent Server
A2A JSON-RPC
Count Assistants
Create Assistant
Delete Assistant
Get Assistant
Get Assistant Graph
Get Assistant Schemas
Get Assistant Subgraphs
Get Assistant Subgraphs by Namespace
Get Assistant Versions
Patch Assistant
Search Assistants
Set Latest Assistant Version
Count Crons
Create Cron
Create Thread Cron
Delete Cron
Get Cron
Search Crons
Update Cron
MCP Get
MCP Post
Terminate Session
Create Background Run
Create Run Batch
Create Run, Stream Output
Create Run, Wait for Output
Delete an item.
List namespaces with optional match conditions.
Retrieve a single item.
Search or list items within a namespace prefix.
Store or update an item.
Protocol v2 Command
Protocol v2 Event Stream (SSE)
API Documentation
Health Check
Server Information
System Metrics
Cancel Run
Cancel Runs
Create Background Run
Create Run, Stream Output
Create Run, Wait for Output
Delete Run
Get Run
Join Run
Join Run Stream
List Runs
Copy Thread
Count Threads
Create Thread
Delete Thread
Get Thread
Get Thread History
Get Thread History Post
Get Thread State
Get Thread State At Checkpoint
Get Thread State At Checkpoint
Join Thread Stream
Patch Thread
Prune Threads
Search Threads
Update Thread State
Agent Server changelog
Distributed tracing with Agent Server
How to collect user feedback for Agent Server runs
Configure LangSmith Agent Server for scale
Alerts in LangSmith
Analyze an experiment
Custom instrumentation
Annotate traces and runs inline
Use annotation queues
Manage feedback & annotation queues programmatically
Control plane API reference for LangSmith Deployment
Application structure
Use assertions
Assistants
Log user feedback using the SDK
How to audit evaluator scores
Audit logs
Authentication & access control
Authentication methods
Self-hosted LangSmith on AWS
Self-hosted LangSmith on Azure
How to kick off background runs
Export trace data to BigQuery
Manage billing in your account
Automatically run evaluators on experiments
Use server-side caching
How to cancel a run
LangSmith Cloud changelog
LangSmith Chat
LangSmith Chat
LangSmith Chat
LangSmith Chat
Implement a CI/CD pipeline using LangSmith Deployment and Evaluation
LangGraph CLI
Cloud (SaaS)
How to define a code evaluator
How to define a code evaluator
How to compare experiment results
LangSmith Deployment components
How to create a composite evaluator
How to create a composite evaluator
Conditional tracing
Use HTTP headers for runtime configuration
Include HTTP headers in server logs
Manage assistants
Configure checkpointer backend
Configure run input and output preview
How to add TTLs to your application
Context engineering concepts
Context Hub
LangSmith control plane
Core capabilities overview
Cost tracking
Create a prompt
Create an account and API key
How to improve your evaluator with few-shot examples
Use cron jobs
Add custom authentication
How to use a custom checkpointer
How to customize the Dockerfile
Connect to a custom model
How to add custom lifespan events
How to add custom middleware
Connect to an OpenAI compliant model provider/proxy
Custom output rendering
How to add custom routes
How to use a custom store
Monitor projects with dashboards
Bulk export trace data
Manage bulk export destinations
Import exported data
Monitor and troubleshoot bulk exports
LangSmith data plane
Data purging for compliance
Data storage and privacy
Dataset prebuilt JSON schema types
Dataset transformations
How to define a target function to evaluate
Deploy Google ADK agents
Deploy other frameworks
Enable LangSmith Deployment, Fleet, Insights, and Chat
Self-host standalone servers
Deploy on Cloud
Deploy with control plane
LangSmith Deployment
Deploy your app to cloud
Deploy Managed Deep Agents
Troubleshooting for self-hosted deployments
Implement distributed tracing
Double texting
Add encryption at rest
Find and fix your agent's failures with LangSmith Engine
LangSmith Engine
LangSmith Engine
LangSmith Engine webhook events
Enqueue concurrent
LangSmith for Enterprise
Environment variables
Evaluate a chatbot
Evaluate a complex agent
How to add evaluators to an existing experiment (Python only)
How to evaluate a graph
How to evaluate an LLM application
How to evaluate an application's intermediate steps
How to run a pairwise evaluation
Evaluate a RAG application
Run an evaluation with multimodal content
How to evaluate with OpenTelemetry
How to retry failed runs in experiments (Python only)
LangSmith Evaluation
Application-specific evaluation approaches
How to run an evaluation asynchronously
Evaluation concepts
Evaluation quickstart
Evaluation types
Manage evaluators
Event streaming API
Example data format
Experiment configuration
Export LangSmith telemetry to your observability backend
Query traces using the SDK
Frequently asked questions
Feedback data format
How to fetch performance metrics for an experiment
How to filter experiments in the UI
Filter traces
Access & oversight
Agent identity
Arcade integration
Auth-aware tool responses
LangSmith Fleet changelog
Channels
Use Fleet agents in code
Agent platform comparison
Computer use
Essentials
No-code agents with LangSmith Fleet
Manage agent settings
LangSmith Tool Server
Quickstart
Remote MCP servers
Salesforce integration
Schedules
Self-hosted
Skills
Integrate Slack with an agent
Integrate Teams with an agent
Templates
Tool integrations
Fleet webhooks
Manage workspace administration
Self-hosted LangSmith on GCP
How to implement generative user interfaces with LangGraph
Integrations
Governance
Granular billable usage
Rebuild graph at runtime
Time travel using the server API
Hybrid
Setup guide (legacy)
Improve LLM-as-judge evaluators using human feedback
Discover errors and usage patterns with Insights
Integrations
Interrupt concurrent
Manage user access in SSO organizations
Self-host LangSmith on Kubernetes
How to evaluate a runnable
LangGraph JS/TS SDK
LangGraph Python SDK
LangSmith CLI
Configure your collector for LangSmith telemetry
LangSmith-managed ClickHouse
LangSmith MCP Server
LangSmith Remote MCP
How to define an LLM-as-a-judge evaluator
How to define an LLM-as-a-judge evaluator
Set up the LLM auth proxy
LLM Gateway
Custom model providers
PII and secrets redaction
Spend policies
How to run an evaluation locally (Python only)
Local development & testing
Log LLM calls
Log multimodal traces
Log retriever traces
Log traces to a specific project
Metadata parameters reference
Manage contexts with the SDK
Manage datasets
Create and manage datasets in the UI
How to create and manage datasets programmatically
Manage your organization using the API
Manage prompts
Manage prompts programmatically
Manage a trace
Manage LangSmith with Terraform
Managed Deep Agents
Managed Deep Agents API reference
Managed Deep Agents API reference
Check agent health
Clone an agent
Create an agent
Delete an agent
Get an agent
List agents
Update an agent
Get an authorization session
Start an authorization session
Register an MCP server
Delete an MCP server
Get an MCP server
List MCP servers
Register per-user MCP OAuth provider
Update an MCP server
List MCP tools
Create a thread and start a run
Create a thread run
Resolve an interrupt
Stream a thread run
Bulk update threads
Count threads
Create a thread
Delete thread
Get thread
List threads
Search threads
Update thread
Managed Deep Agents CLI reference
Deploy a Managed Deep Agent
Run a Managed Deep Agent
Connect MCP tools to Managed Deep Agents
Managed Deep Agents
Managed Deep Agents quickstart
Managed Deep Agents SDKs
Configure prompt settings
Prevent logging of sensitive data in traces
Messages view integrations
Messages view trace format reference
How to return categorical vs numerical metrics
Manage model configurations
Monorepo support
How to simulate multi-turn interactions
Include multimodal content in a prompt
Test multi-turn conversations
How to return multiple scores in one evaluator
Troubleshoot trace nesting
LangSmith Observability
Observability concepts
Trace an LLM application tutorial
Tracing quickstart
Deploy an observability stack for your LangSmith deployment
Observability in Studio
Set up online code evaluators
Set up composite online evaluators
Set up LLM-as-a-judge online evaluators
Set up multi-turn online evaluators
Document API authentication in OpenAPI
Run evals with openevals package
Optimize a classifier
Organization and workspace operations reference
Redact sensitive data with the OpenTelemetry Gateway architecture
Set up LangSmith
Model providers
Collect feedback with presigned URLs
Pricing plans
Profile configuration
How to sync prompts with GitHub
Prompt engineering
Prompt engineering concepts
Prompt engineering quickstart
Prompt template format guide
How to run evaluations with pytest
Query threads using the SDK
Get started with Studio
How to handle model rate limits
Role-based access control
How to read experiment results locally
LangSmith reference
Regions FAQ
Reject Concurrent
Release policy
RemoteGraph
How to evaluate with repetitions
Make conversations private
Rollback Concurrent
Set up automation rules
Run backtests on a new version of an agent
Run (span) data format
How to use the REST API
Run an evaluation from the Playground
Runs
How to run multiple agents on the same thread
Set a sampling rate for traces
Sandbox auth proxy
Sandbox CLI
Run evaluations with Harbor
Sandbox access permissions
Sandbox SDK usage
Sandbox service URLs
Sandbox snapshots
LangSmith Sandboxes
Scalability & resilience
Delete workspaces
Delete organizations
Delete traces
Generate ClickHouse stats
Generate query stats
Run support queries against ClickHouse
Run support queries against PostgreSQL
Basic authentication with email and password
Enable blob storage
Configure custom TLS certificates
Minimum versions for self-hosting dependencies
Disaster recovery for self-hosted LangSmith
Egress for billing and operational telemetry
Configure environment variables in the Helm chart
Connect to an external ClickHouse database
Connect to an external PostgreSQL database
Connect to an external Redis or Valkey database
FIPS-compliant images
Create an Ingress for installations (Kubernetes)
Mirror images for your LangSmith installation
View trace counts across your organization
Use environment variables for model providers
Configure LangSmith for scale
Set up SSO with OAuth2.0 and OIDC
Enable TTL and data retention
Customize the error support message
Upgrade an installation
Interact with your self-hosted instance of LangSmith
Customize user management
Use an existing secret for your installation (Kubernetes)
Self-hosted LangSmith
Self-hosted LangSmith changelog
Install Mission Control
How to add semantic search to your agent deployment
A2A endpoint in Agent Server
Agent Server API reference for LangSmith Deployment
MCP endpoint in Agent Server
Trace JS functions in serverless environments
Set up custom authentication
Set up feedback criteria
Set up hierarchy
Set up resource tags
How to set up an application with requirements.txt
How to set up a JavaScript application
How to set up an application with pyproject.toml
LangSmith shared responsibility model
LangSmith skills
LangSmith API reference
Attach access policies to a role
Create an access policy
Delete an access policy
Get an access policy
List access policies
Execute
Create an alert rule
Delete an alert rule
Get an alert rule
Test an alert action to determine if configuration is valid
Update an alert rule
Add Runs To Annotation Queue
Add Runs To Annotation Queue By Key
Create Annotation Queue
Create Identity Annotation Queue Run Status
Delete Annotation Queue
Delete Annotation Queues
Delete Run From Annotation Queue
Delete Runs From Annotation Queue
Export Annotation Queue Archived Runs
Get Annotation Queue
Get Annotation Queues
Get Annotation Queues For Run
Get Run From Annotation Queue
Get Runs From Annotation Queue
Get Size From Annotation Queue
Get Total Archived From Annotation Queue
Get Total Size From Annotation Queue
Populate Annotation Queue
Resolve Annotation Queue Run
Update Annotation Queue
Update Run In Annotation Queue
Add a reviewer to an annotation queue
Remove a reviewer from an annotation queue
Delete Api Key
Delete Personal Access Token
Generate Api Key
Generate Personal Access Token
Get Api Keys
Get Personal Access Tokens
Get Audit Logs
Check Sso Email Verification Status
Confirm Sso User Email
Get public auth info
Get Sso Settings
Login
Lookup Sso By Email
Send Sso Email Confirmation
AWS Marketplace fulfillment URL registration
Restart a backfill job
Cancel Bulk Export
Create Bulk Export
Create Bulk Export Destination
Get Bulk Export
Get Bulk Export Destination
Get Bulk Export Destinations
Get Bulk Export Run
Get Bulk Export Runs
Get Bulk Export Runs Filtered
Get Bulk Exports
Update Bulk Export Destination
Clone Section
Create Chart
Create Section
Delete Chart
Delete Section
Org Create Chart
Org Create Section
Org Delete Chart
Org Delete Section
Org Read Chart Preview
Org Read Charts
Org Read Sections
Org Read Single Chart
Org Read Single Section
Org Update Chart
Org Update Section
Read Chart Preview
Read Charts
Read Sections
Read Single Chart
Read Single Section
Update Chart
Update Section
Create Comment
Create Sub Comment
Get Comments
Get Sub Comments
Like Comment
Unlike Comment
Create a commit
Get a commit
List commits
Create a new data plane
List data planes for the current organization
Clone Dataset
Create Comparative Experiment
Create Dataset
Delete Comparative Experiment
Delete Dataset
Delete Datasets
Diff Dataset Versions
Download Dataset Csv
Download Dataset Jsonl
Download Dataset Openai
Download Dataset Openai Ft
Generate
Get Dataset Splits
Get Dataset Version
Get Dataset Versions
Read Comparative Experiments
Read Dataset
Read Dataset Share State
Read Datasets
Read Datasets Stream
Read Delta
Read Delta Stream
Read Examples With Runs
Read Examples With Runs Grouped
Read Grouped Experiments
Share Dataset
Studio Experiment
Unshare Dataset
Update Dataset
Update Dataset Splits
Update Dataset Version
Upload Csv Dataset
Upload Experiment
Create directory commit
Delete directory repository
Get directory contents
Respond to Engine trial ending notice
Bulk delete evaluators
Create evaluator
Delete evaluator
Get evaluator
Get evaluator spend
List evaluators
Update evaluator
Count Examples
Create Example
Create Examples
Delete Example
Delete Examples
Hard Delete Examples
Legacy Update Examples
Read Example
Read Examples
Update Example
Update Examples
Upload Examples
Upload Examples From Csv
Validate Example
Validate Examples
Create new experiment view override configuration for a dataset
Delete experiment view override configuration
Get experiment view override configuration by specific ID
Get experiment view override configurations for a dataset
Update existing experiment view override configuration
Evaluate Experiment Adhoc
Delete default model for a feature
Disable a model for a feature
List feature configurations
Re-enable a disabled model for a feature
Set default model for a feature
Create Feedback Config Endpoint
Delete Feedback Config Endpoint
List Feedback Configs Endpoint
Update Feedback Config Endpoint
Create Feedback
Create Feedback Formula Ep
Create Feedback Ingest Token
Create Feedback With Token Get
Create Feedback With Token Post
Delete Feedback
Delete Feedback Formula Endpoint
Eagerly Create Feedback
Get Feedback Formula Ep
List Feedback Formula Ep
List Feedback Ingest Tokens
Read Feedback
Read Feedbacks
Update Feedback
Update Feedback Formula Ep
Create a gateway policy
Delete a gateway policy
Get a gateway policy
List gateway policies
Update a gateway policy
Create hub environments model
Delete hub environments model
List hub environments
Update hub environments model
Get Health Info
Get Server Info
Get Agent Builder integrations settings
Update Agent Builder integrations settings
Link: [[Beta] Create the issues agent for a session](
Link: [[Beta] Delete the issues agent for a session](
Link: [[Beta] Get the issues agent config for a session](
Link: [[Beta] List issues agent configs](
Link: [[Beta] Save the agent overview for a session](
Link: [[Beta] Update the issues agent config for a session](
Get issues-agent (Engine) LCU spend per project for the calling org
Roll an issues agent webhook signing secret
Link: [[Beta] List issues](
Link: [[Beta] List viewed issues for a session](
Link: [[Beta] Mark issue viewed](
Like Repo
Get Tools
Invalidate Tools Cache
Proxy
Proxy Get
Create vendor settings
Delete vendor settings
Get MCP vendor
Get vendor account
Get vendor settings
List MCP servers for a vendor
List MCP vendors
List tools for a vendor
Replace vendor settings
Create Onboarding State
Get Ls User Id
Get Onboarding State
Get the authenticated user's provider user ID
Update Onboarding State Field
Create New Model Price
Delete Model Price
Read Model Price Map
Update Model Price
Approve OAuth2 authorization request
Authorize a device code
Exchange grant for OAuth2 tokens
