القائمة
جمع SkillsMP عدد ٤ من skills من castorini/umbrela. افتح أي skill لمراجعة مصدره وتفاصيله.
عرض ٤ من أصل ٤ skills مجمعة.
Use when analyzing umbrela evaluation results — comparing nDCG@10 scores across backends, interpreting confusion matrices, computing kappa agreement, and comparing modified qrels against human judgments. Use after running evaluate to interpret results.
لغة النص الأصلي: الإنجليزية
Set up an umbrela development environment — checks Python 3.11+, installs via uv or pip with cloud extras, and verifies with doctor. Use when someone is onboarding, setting up a fresh clone, or troubleshooting their environment.
لغة النص الأصلي: الإنجليزية
Use when validating umbrela judge outputs — checks label range (0–3), qid/docid completeness, result_status consistency, backend metadata, and JSONL integrity. Wraps `umbrela validate` plus custom assertions. Use after running judge or evaluate to verify…
لغة النص الأصلي: الإنجليزية
Use when working with umbrela CLI commands (judge, evaluate), backend selection (gpt, gemini, hf, os, ensemble), qrel handling (dl19-passage, dl20-passage, etc.), relevance labels (0–3), or introspection (doctor, describe, schema, validate). Covers all entry…
لغة النص الأصلي: الإنجليزية