Skip to main content
langfuse-performance-tuning Optimize Langfuse tracing performance for high-throughput applications.
Use when experiencing latency issues, optimizing trace overhead,
or scaling Langfuse for production workloads.
Trigger with phrases like "langfuse performance", "optimize langfuse",
"langfuse latency", "langfuse overhead", "langfuse slow".
설치로 이동 Skills Marketplace 커뮤니티가 만든 AI 스킬을 발견하고 탐색하세요.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
직접 명령은 검토 Prompt를 거치지 않습니다. 실행하기 전에 소스를 확인하세요.
npx skills add https://github.com/jeremylongshore/claude-code-plugins-plus-skills --skill langfuse-performance-tuning명령은 한 줄로 유지됩니다. 복사하기 전에 가로로 스크롤해 전체 내용을 확인하세요.
로컬 사본을 원하시나요? SkillsMP에서 현재 제공할 수 있는 파일을 다운로드하세요.
Zip 다운로드 다운로드 중... 이 저장소의 다른 Skills Implement user sign-up and sign-in flows with Clerk.
Use when building authentication UI, customizing sign-in experience,
or implementing OAuth social login.
Trigger with phrases like "clerk sign-in", "clerk sign-up",
"clerk login flow", "clerk OAuth", "clerk social login".
Implement session management and middleware with Clerk.
Use when managing user sessions, configuring route protection,
or implementing token refresh and custom JWT templates.
Trigger with phrases like "clerk session", "clerk middleware",
"clerk route protection", "clerk token", "clerk JWT".
Configure enterprise SSO, role-based access control, and organization management.
Use when implementing SSO integration, configuring role-based permissions,
or setting up organization-level controls.
Trigger with phrases like "clerk SSO", "clerk RBAC",
"clerk enterprise", "clerk roles", "clerk permissions", "clerk organizations".
jeremylongshore
jeremylongshore/claude-code-plugins-plus-skills
GitHub 저장소 열기 name langfuse-performance-tuning description Optimize Langfuse tracing performance for high-throughput applications.
Use when experiencing latency issues, optimizing trace overhead,
or scaling Langfuse for production workloads.
Trigger with phrases like "langfuse performance", "optimize langfuse",
"langfuse latency", "langfuse overhead", "langfuse slow".
allowed-tools Read, Write, Edit version 1.12.0 license MIT author Jeremy Longshore <jeremy@intentsolutions.io> tags ["saas","langfuse","performance","scaling","tracing"] compatibility Designed for Claude Code, also compatible with Codex and OpenClaw
Langfuse Performance Tuning
Overview
Optimize Langfuse tracing for minimal overhead and maximum throughput: benchmark measurement, batch tuning, non-blocking patterns, payload optimization, sampling, and memory management.
Prerequisites
Existing Langfuse integration
Performance baseline to compare against
Understanding of async patterns
Performance Targets
Metric Target Critical Trace creation overhead < 1ms < 5ms Flush latency (batch) < 100ms < 500ms Memory per active trace < 1KB < 5KB CPU overhead < 1% < 5%
Instructions
Step 1: Benchmark Current Performance
import { performance } from "perf_hooks" ;
import { startActiveObservation, updateActiveObservation } from "@langfuse/tracing" ;
import { LangfuseSpanProcessor } from "@langfuse/otel" ;
import { NodeSDK } from "@opentelemetry/sdk-node" ;
async function benchmark (const sdk = new NodeSDK ({
spanProcessors : [new LangfuseSpanProcessor ()],
});
sdk.start ();
const iterations = 1000 ;
const timings
number
for
let
0
const
now
await
startActiveObservation
`bench-${i} `
async
updateActiveObservation
input
output
done
true
push
now
const
sort
(a, b ) =>
console
log
"=== Langfuse Performance Benchmark ==="
console
log
`Iterations: ${iterations} `
console
log
`Mean: ${(sorted.reduce((a, b) => a + b) / sorted.length).toFixed(3 )} ms`
console
log
`P50: ${sorted[Math .floor(sorted.length * 0.5 )].toFixed(3 )} ms`
console
log
`P95: ${sorted[Math .floor(sorted.length * 0.95 )].toFixed(3 )} ms`
console
log
`P99: ${sorted[Math .floor(sorted.length * 0.99 )].toFixed(3 )} ms`
const
now
await
shutdown
console
log
`Flush: ${(performance.now() - flushStart).toFixed(1 )} ms`
benchmark
Step 2: Optimize Batch Configuration
import { LangfuseSpanProcessor } from "@langfuse/otel" ;
import { NodeSDK } from "@opentelemetry/sdk-node" ;
const processor = new LangfuseSpanProcessor ({
exportIntervalMillis : 10000 ,
maxExportBatchSize : 100 ,
maxQueueSize : 4096 ,
});
const sdk = new NodeSDK ({ spanProcessors : [processor] });
sdk.start ();
const langfuse = new Langfuse ({
flushAt : 100 ,
flushInterval : 10000 ,
requestTimeout : 30000 ,
});
Setting Low Volume High Volume Ultra-High Batch size 15 50-100 200 Flush interval 5s 10s 30s Queue size 1024 4096 8192
Step 3: Non-Blocking Trace Wrapper Ensure tracing never blocks your application's critical path:
import { observe, updateActiveObservation } from "@langfuse/tracing" ;
function safeObserve<T extends (...args : any []) => Promise <any >>(
name : string ,
fn : T
): T {
return (async (...args : Parameters <T>) => {
try {
return await observe ({ name }, async () => {
updateActiveObservation ({ input : args });
const result = await fn (...args);
updateActiveObservation ({ output : result });
return result;
})();
} catch (error) {
console .warn (`Tracing failed for ${name} :` , error);
return fn (...args);
}
}) as T;
}
Step 4: Payload Size Optimization Large trace payloads slow down flush and increase costs:
function truncateForTrace (input : any , maxStringLen = 5000 , maxArrayLen = 50 any {
if (typeof input === "string" ) {
return input.length > maxStringLen
? input.slice (0 , maxStringLen) + `...[truncated ${input.length - maxStringLen} chars]`
: input;
}
if (Array .isArray (input)) {
return input.slice (0 , maxArrayLen).map ((item ) => truncateForTrace (item));
}
if (input instanceof Buffer || input instanceof Uint8Array ) {
return `[Binary: ${input.length} bytes]` ;
}
if (typeof input === "object" && input !== null ) {
const result : Record <string , any > = {};
for (const [key, value] of Object .entries (input)) {
result[key] = truncateForTrace (value);
}
return result;
}
return input;
}
await startActiveObservation ("process" , async () => {
updateActiveObservation ({
input : truncateForTrace (largeInput),
});
const result = await process (largeInput);
updateActiveObservation ({ output : truncateForTrace (result) });
});
Step 5: Sampling for Ultra-High Volume When you cannot afford to trace every request:
class TraceSampler {
private rate : number ;
private windowMs = 60000 ;
private maxPerWindow : number ;
private timestamps : number [] = [];
constructor (rate : number , maxPerMinute : number this .rate = rate;
this .maxPerWindow = maxPerMinute;
}
shouldSample (isError = false ): boolean {
if (isError) return true ;
const now = Date .now ();
this .timestamps = this .timestamps .filter ((t ) => t > now - this .windowMs );
if (this .timestamps .length >= this .maxPerWindow ) return false ;
if (Math .random () > this .rate ) return false ;
this .timestamps .push (now);
return true ;
}
}
const sampler = new TraceSampler (0.1 , 1000 );
async function maybeTrace<T>(name : string , fn : () => Promise <T>, isError = false ): Promise <T> {
if (!sampler.shouldSample (isError)) {
return fn ();
}
return startActiveObservation (name, async () => {
updateActiveObservation ({ metadata : { sampled : true } });
return fn ();
});
}
Step 6: Memory Management
function logMemoryStats (const mem = process.memoryUsage ();
console .log ({
heapUsedMB : (mem.heapUsed / 1024 / 1024 ).toFixed (1 ),
rssMB : (mem.rss / 1024 / 1024 ).toFixed (1 ),
externalMB : (mem.external / 1024 / 1024 ).toFixed (1 ),
});
}
setInterval (logMemoryStats, 60000 );
Optimization Impact Matrix Optimization Latency Impact Throughput Impact Effort Increase batch size High High Low Non-blocking wrapper High Medium Low Payload truncation Medium Medium Low Sampling High Very High Medium Memory monitoring Low Low Low
Error Handling Issue Cause Solution High P99 latency Sync flush in hot path Use non-blocking wrapper Memory growth No payload limits Truncate inputs/outputs Request timeouts Batch too large Reduce batch size or increase timeout Dropped spans Queue full Increase maxQueueSize
Resources 