Skip to main content

ax-llm

This skill helps with using the @ax-llm/ax TypeScript library for building LLM applications. Use when the user asks about ax(), ai(), f(), s(), agent(), flow(), AxGen, AxAgent, AxFlow, signatures, streaming, or mentions @ax-llm/ax.

来源信息

仓库
Tyler-R-Kendrick/ts-autocode
最近来源活动
2026年7月12日 02:32
检测到的 SKILL.md 语言
英语
星标
0
分支
0

安装方式

默认使用会先检查来源的 Prompt;你也可以切换为直接命令,或下载本地副本。

检查来源文件

决定是否安装前,请先阅读 SKILL.md,以及 SkillsMP 当前展示的配套文件。

正在显示 SKILL.md

SKILL.md
来源说明 · 只读预览
name
ax-llm
description
This skill helps with using the @ax-llm/ax TypeScript library for building LLM applications. Use when the user asks about ax(), ai(), f(), s(), agent(), flow(), AxGen, AxAgent, AxFlow, signatures, streaming, or mentions @ax-llm/ax.
version
23.0.0
# Ax Library (@ax-llm/ax) Quick Reference Ax is a TypeScript library for building LLM-powered applications with type-safe signatures, streaming support, and multi-provider compatibility. > **Detailed skills available:** ax-ai (providers), ax-signature (signatures/types), ax-gen (generators), ax-agent (core agents/tools), ax-agent-rlm (agent runtime/RLM/delegation), ax-agent-observability (callbacks/logs/usage), ax-agent-memory-skills (recall and dynamic skill loading), ax-agent-optimize (agent tuning/eval), ax-flow (workflows), ax-gepa (top-level `optimize(...)`, BootstrapFewShot -> GEPA, Pareto optimization). ## Imports & Factories ```typescript // Prefer factory functions: ax(), ai(), agent(), flow(); avoid class constructors. import { ax, ai, f, s, fn, agent, flow, AxMemory, AxMCPClient } from '@ax-llm/ax'; import { z } from 'zod'; // optional — any Standard Schema v1 library works // AI provider const llm = ai({ name: 'openai', apiKey: process.env.OPENAI_APIKEY }); // Generator (from string signature) const gen = ax('question:string -> answer:string'); // Generator (from fluent signature) const gen = ax( f() .input('question', f.string('User question')) .output('answer', f.string('AI response')) .build() ); // Generator (from zod — Standard Schema v1, also works with valibot/arktype) const zodGen = ax( f() .input(z.object({ question: z.string().describe('User question') })) .output(z.object({ answer: z.string().describe('AI response') })) .build() ); // Reusable signature const sig = s('question:string, context:string[] -> answer:string'); // Agent const myAgent = agent('userInput:string -> response:string', { name: 'helper', description: 'A helpful assistant', }); // Flow const wf = flow<{ input: string }, { output: string }>() .node('step1', 'input:string -> output:string') .execute('step1', (state) => ({ input: state.input })) .returns((state) => ({ output: state.step1Result.output })); // Function tool — native fluent const tool = fn('search') .description('Search the web') .arg('query', f.string('Search query')) .returns(f.string('Search results')) .handler(({ query }) => searchWeb(query)) .build(); // Function tool — zod schema (Standard Schema v1: also works with valibot, arktype) const zodTool = fn('calculateTax') .description('Calculate tax for an amount') .arg(z.object({ amount: z.number().positive().describe('Pre-tax amount in USD'), region: z.enum(['US', 'EU', 'UK']).describe('Tax region'), })) .returns(z.object({ tax: z.number(), total: z.number() })) .handler(async ({ amount }) => ({ tax: amount * 0.1, total: amount * 1.1 })) .build(); ``` ## Running ```typescript // Forward (blocking) const result = await gen.forward(llm, { question: 'What is 2+2?' }); // Streaming for await (const chunk of gen.streamingForward(llm, { question: 'Tell a story' })) { if (chunk.delta.answer) process.stdout.write(chunk.delta.answer); } ``` ## Forward Options Quick Reference | Goal | Option | Example | |------|--------|---------| | Model override | `model` | `{ model: 'gpt-5.4-mini' }` | | Temperature | `modelConfig.temperature` | `{ modelConfig: { temperature: 0.8 } }` | | Max tokens | `modelConfig.maxTokens` | `{ modelConfig: { maxTokens: 500 } }` | | Retry on failure | `maxRetries` | `{ maxRetries: 3 }` | | Max agent steps | `maxSteps` | `{ maxSteps: 10 }` | | Fail fast | `fastFail` | `{ fastFail: true }` | | Thinking budget | `thinkingTokenBudget` | `{ thinkingTokenBudget: 'medium' }` | | Show thoughts | `showThoughts` | `{ showThoughts: true }` | | Context caching | `contextCache` | `{ contextCache: { cacheBreakpoint: 'after-examples' } }` | | Multi-sampling | `sampleCount` | `{ sampleCount: 5 }` | | Debug logging | `debug` | `{ debug: true }` | | Abort signal | `abortSignal` | `{ abortSignal: controller.signal }` | | Memory | `mem` | `{ mem: new AxMemory() }` | | Stop function | `stopFunction` | `{ stopFunction: 'finalAnswer' }` | | Function mode | `functionCallMode` | `{ functionCallMode: 'auto' }` | Global runtime defaults can be set with `axGlobals` and are read live by future AI, AxGen, and AxFlow calls: ```typescript import { axGlobals, axCreateDefaultColorLogger } from '@ax-llm/ax'; import { trace } from '@opentelemetry/api'; axGlobals.tracer = trace.getTracer('my-app'); axGlobals.debug = true; axGlobals.logger = axCreateDefaultColorLogger(); ``` Precedence is: per-call options, then explicit instance/program options, then current `axGlobals`, then built-in defaults. `customLabels` merge in that order, and `abortSignal` values are combined so either global or local cancellation works. ## Memory and Context ```typescript import { AxMemory } from '@ax-llm/ax'; const memory = new AxMemory(); // Multi-turn conversation await gen.forward(llm, { userMessage: 'My name is Alice' }, { mem: memory }); const r = await gen.forward(llm, { userMessage: 'What is my name?' }, { mem: memory }); ``` ## Few-Shot Examples ```typescript const classifier = ax('reviewText:string -> sentiment:class "positive, negative, neutral"'); classifier.setExamples([ { reviewText: 'I love this!', sentiment: 'positive' }, { reviewText: 'Terrible.', sentiment: 'negative' }, { reviewText: 'It works.', sentiment: 'neutral' }, ]); ``` ## Common Patterns ### Classification ```typescript const classifier = ax( f() .input('text', f.string()) .output('category', f.class(['spam', 'ham', 'uncertain'])) .output('confidence', f.number().min(0).max(1)) .build() ); ``` ### Extraction ```typescript const extractor = ax( f() .input('text', f.string()) .output('entities', f.object({ people: f.string().array(), organizations: f.string().array(), locations: f.string().array() })) .build() ); ``` ### Multi-modal (Images) ```typescript const analyzer = ax( f() .input('image', f.image('Image to analyze')) .input('question', f.string('Question').optional()) .output('description', f.string()) .output('objects', f.string().array()) .build() ); const result = await analyzer.forward(llm, { image: { mimeType: 'image/jpeg', data: base64Data }, question: 'What objects are in this image?' }); ``` ### Chaining Generators ```typescript const researcher = ax('topic:string -> research:string, keyFacts:string[]'); const writer = ax('research:string, keyFacts:string[] -> article:string'); const research = await researcher.forward(llm, { topic: 'AGI' }); const draft = await writer.forward(llm, { research: research.research, keyFacts: research.keyFacts }); ``` ## Error Handling ```typescript import { AxGenerateError, AxAIServiceError, AxAIServiceAbortedError } from '@ax-llm/ax'; try { const result = await gen.forward(llm, { input: 'test' }); } catch (error) { if (error instanceof AxGenerateError) { console.error('Generation failed:', error.details.model, error.details.signature); } else if (error instanceof AxAIServiceAbortedError) { console.log('Request was aborted'); } else if (error instanceof AxAIServiceError) { console.error('AI service error:', error.message); } } ``` ## Debugging ```typescript import { axCreateDefaultColorLogger, axGlobals } from '@ax-llm/ax'; const result = await gen.forward(llm, { input: 'test' }, { debug: true, logger: axCreateDefaultColorLogger(), // OpenTelemetry tracer: openTelemetryTracer, meter: openTelemetryMeter, }); // Or set live app-wide defaults for future calls: axGlobals.tracer = openTelemetryTracer; axGlobals.meter = openTelemetryMeter; ``` ## MCP Integration ```typescript import { AxMCPClient, agent } from '@ax-llm/ax'; import { AxMCPStdioTransport } from '@ax-llm/ax-tools'; // Stdio transport (local MCP server) const transport = new AxMCPStdioTransport({ command: 'npx', args: ['-y', '@modelcontextprotocol/server-memory'], }); const mcpClient = new AxMCPClient(transport, { debug: false }); await mcpClient.init(); // Use with agent under a namespace const myAgent = agent('userMessage:string -> response:string', { functions: [ { namespace: 'memory', title: 'Memory MCP', description: 'Memory server tools', selectionCriteria: 'Use for persistent memory lookup and updates.', functions: [mcpClient], }, ], functionDiscovery: true, contextFields: [], }); ``` ### HTTP Transport (Remote MCP) ```typescript import { AxMCPStreambleHTTPTransport } from '@ax-llm/ax/mcp/transports/httpStreamTransport.js'; const transport = new AxMCPStreambleHTTPTransport('https://remote.mcp.pipedream.net', { headers: { 'x-pd-project-id': projectId }, authorization: `Bearer ${accessToken}`, }); ``` ### MCP Capabilities | Capability | Prefix | Description | |---|---|---| | Tools | *(none)* | Function calls | | Prompts | `prompt_` | Prompt templates | | Resources | `resource_` | File/data access | ```typescript const caps = mcpClient.getCapabilities(); const functions = mcpClient.toFunction(); ``` ### Function Overrides ```typescript const mcpClient = new AxMCPClient(transport, { functionOverrides: [ { name: 'search_documents', updates: { name: 'findDocs', description: 'Search docs' } } ] }); ``` ## Type Reference ```typescript class AxGen<IN, OUT> { forward(ai: AxAIService, values: IN, options?: AxProgramForwardOptions): Promise<OUT>; streamingForward(ai: AxAIService, values: IN, options?: AxProgramStreamingForwardOptions): AsyncGenerator<{ delta: Partial<OUT> }>; setExamples(examples: Array<Partial<IN & OUT>>): void; addAssert(fn: (output: OUT) => boolean | string | undefined | Promise<boolean | string | undefined>, message?: string): void;
在 GitHub 查看
这个 SKILL.md 很大,SkillsMP 这里只预览前一段内容。 在 GitHub 查看