Maintain agent-eval cases, judges, records, traces, campaigns, comparisons, and releases.
原文の言語: 英語
メニュー
SkillsMP は tangle-network/agent-eval から 5 件の skill を収集しています。skill を開くとソースと詳細を確認できます。
収集済み skill 5 件中 5 件を表示しています。
Maintain agent-eval cases, judges, records, traces, campaigns, comparisons, and releases.
原文の言語: 英語
Parse classic SWE-agent .traj trajectories: one step per entry of the trajectory array, in order, matching the CodeTraceBench annotation convention. No upstream CodeTracer commit ships a SWE-agent parser.
原文の言語: 英語
Parse OpenHands trajectories published as per-call LiteLLM completion logs (<model>-<timestamp>.json files with messages/response/kwargs/cost), the layout of CodeTraceBench's swe_raw OpenHands trials. Reads the call file whose messages hold the most tool-call…
原文の言語: 英語
Parse OpenHands session-event trajectories at the CodeTraceBench annotation granularity: one step per action event with a cause-paired observation (run, run_ipython, read, edit, think, recall). Outranks the seed openhands skill, which counts only…
原文の言語: 英語
Parse Terminus2 trajectories at command granularity: one step per entry of each episode response's commands array, matching the CodeTraceBench annotation convention. Outranks the seed terminus2 skill, whose episode-level steps do not align with the…
原文の言語: 英語