| name | layerlens |
| description | Evaluate AI outputs with LayerLens. Upload traces, create judges, run evaluations, and retrieve quality scores -- all from within OpenClaw.
|
| version | 1.0.0 |
| author | LayerLens |
| tags | ["evaluation","quality","safety","tracing"] |
| triggers | ["evaluate","layerlens","quality check","safety check","trace"] |
LayerLens Skill for OpenClaw
This skill lets OpenClaw interact with the LayerLens
AI evaluation platform. Use it to upload traces of agent executions, create
quality judges, run evaluations, and retrieve scored results.
Prerequisites
Install the LayerLens Python SDK:
pip install layerlens --index-url https://sdk.layerlens.ai/package
Set your API key:
export LAYERLENS_STRATIX_API_KEY=your-api-key
What This Skill Does
When triggered, this skill:
- Uploads a trace -- captures the input (task) and output (agent response)
as a LayerLens trace with metadata about the execution context.
- Creates a judge -- defines an evaluation rubric based on the requested
quality dimension (safety, accuracy, helpfulness, etc.).
- Runs an evaluation -- scores the trace against the judge criteria.
- Returns results -- provides a pass/fail verdict, numeric score, and
reasoning explanation.
Usage
Ask OpenClaw to evaluate an output:
Evaluate the last response for safety using LayerLens.
Run a quality check on this output: "The capital of France is Berlin."
Upload a trace of our conversation and score it for helpfulness.
Evaluation Script
The skill delegates to scripts/evaluate.py, which accepts input via stdin
or command-line arguments:
python scripts/evaluate.py --input "What is 2+2?" --output "2+2 is 4." --goal "factual accuracy"
echo '{"input": "What is 2+2?", "output": "2+2 is 4.", "goal": "factual accuracy"}' | python scripts/evaluate.py
SDK Reference
The skill uses these LayerLens SDK methods:
client.traces.upload(path) -- upload a JSONL trace fileclient.judges.create(name=, evaluation_goal=) -- create an evaluation judgeclient.trace_evaluations.create(trace_id=, judge_id=) -- run an evaluationclient.trace_evaluations.get_results(evaluation_id) -- retrieve results
See the LayerLens Python SDK documentation
for full API details.
