| name | kurt |
| version | 1.0.0 |
| description | Content fetching, URL discovery, and workflow automation |
| author | boringdata |
| repository | https://github.com/boringdata/kurt-core |
| type | cli |
| command | kurt |
| actions | [{"name":"fetch","description":"Fetch content from a URL using the best available provider","usage":"kurt fetch <url> [--provider <name>] [--timeout <seconds>]","examples":["kurt fetch https://example.com","kurt fetch https://notion.so/page --provider notion","kurt fetch https://docs.example.com --timeout 60"]},{"name":"map","description":"Discover URLs from a source (sitemap, RSS, folder)","usage":"kurt map <source> [--provider <name>] [--max-urls <n>]","examples":["kurt map https://example.com/sitemap.xml","kurt map https://blog.example.com/feed.xml --provider rss","kurt map ./docs --provider folder"]},{"name":"workflow","description":"Run a predefined workflow","usage":"kurt workflow run <workflow.toml> [--background]","examples":["kurt workflow run sync-docs.toml","kurt workflow run scrape-all.toml --background"]},{"name":"tool","description":"Manage tools and providers","usage":"kurt tool <subcommand>","examples":["kurt tool list","kurt tool info fetch","kurt tool providers fetch","kurt tool check fetch"]}] |
| requires | [{"command":"kurt","install":"pip install kurt"},{"env":"ANTHROPIC_API_KEY","optional":true,"description":"Required for LLM tools"}] |
| url_patterns | ["notion.so/*","*.notion.site/*","*/sitemap.xml","*/sitemap*.xml","*/feed.xml","*/rss.xml","twitter.com/*","x.com/*","linkedin.com/*","threads.net/*","*.substack.com/*"] |
| capabilities | ["web_fetch","file_read","workflow_automation"] |
Kurt
Kurt is a content fetching and workflow automation tool designed for AI agents.
Quick Start
kurt fetch https://example.com
kurt map https://example.com/sitemap.xml
kurt tool list
Automatic Provider Selection
Kurt automatically selects the best provider based on URL patterns:
| URL Pattern | Provider |
|---|
| notion.so/* | notion |
| twitter.com/, x.com/ | apify or twitterapi |
| linkedin.com/* | apify |
| */sitemap.xml | sitemap |
| */feed.xml, */rss.xml | rss |
| Local paths | folder |
| Other URLs | trafilatura (default) |
Available Tools
fetch - Retrieve content from URLs
kurt fetch https://example.com
kurt fetch https://example.com --provider httpx
kurt fetch https://example.com --json
map - Discover URLs from sources
kurt map https://example.com/sitemap.xml
kurt map https://blog.example.com/feed.xml
kurt map ./docs --provider folder
kurt map https://example.com --provider crawl
workflow - Run automation workflows
kurt workflow list
kurt workflow run sync-docs.toml
kurt workflow run scrape-all.toml --background
tool - Manage tools and providers
kurt tool list
kurt tool info fetch
kurt tool providers fetch
kurt tool check
Configuration
Kurt reads configuration from (highest to lowest priority):
- CLI arguments
- Project
kurt.toml
- User
~/.kurt/config.toml
- Provider defaults
Example kurt.toml
[tool.fetch]
provider = "trafilatura"
timeout = 30
[tool.fetch.providers.notion]
include_children = true
max_depth = 3