OpenDCAI/DataFlow-WebUI

dataflow-dev

DataFlow 开发专家上下文加载器。当用户在 DataFlow 仓库中进行开发时触发， 涵盖：新建算子/Pipeline/Prompt、诊断报错、规范审查、 以及感知仓库变更并建议更新知识库。 Trigger: user is developing in DataFlow repo, asks to create operator/pipeline/prompt, encounters errors, wants code review, or asks about operators.

Quellsprache: Chinesisch

generating-dataflow-pipeline

Plan and write a standard DataFlow pipeline from a target and representative JSONL data. Use when a user asks to select DataFlow operators, trace field dependencies, generate runnable pipeline code, or repair a pipeline with schema or field-flow errors.

Quellsprache: Englisch

bench-dataset-evaluator-question

Reference documentation for the BenchDatasetEvaluatorQuestion operator. Extended version of BenchDatasetEvaluator with question and subquestion support. Use when: evaluating answers with question context or multiple subquestions.

Quellsprache: Englisch

bench-dataset-evaluator

Reference documentation for the BenchDatasetEvaluator operator. Covers the constructor, two comparison modes (match/semantic), and pipeline usage. Use when: comparing predicted answers against ground truth answers in benchmark evaluation.

Quellsprache: Englisch

prompted-evaluator

Reference documentation for the PromptedEvaluator operator. Use when: scoring text quality with LLM without filtering rows.

Quellsprache: Englisch

text2qa-sample-evaluator

Reference documentation for the Text2QASampleEvaluator operator. Use when: evaluating QA pair quality across multiple dimensions.

Quellsprache: Englisch

unified-bench-dataset-evaluator

Reference documentation for the UnifiedBenchDatasetEvaluator operator. Use when: evaluating model answers on benchmark datasets.

Quellsprache: Englisch

general-filter

Reference documentation for the GeneralFilter operator. Covers the constructor, rule-based filtering logic, and pipeline usage notes. Use when: filtering rows based on column value conditions that can be expressed as lambda functions without LLM calls.

Quellsprache: Englisch

kcentergreedy-filter

Reference documentation for the KCenterGreedyFilter operator. Covers the constructor, K-Center Greedy algorithm behavior, embedding serving requirements, and pipeline usage notes. Use when: downsampling a large dataset by semantic diversity using embedding…

Quellsprache: Englisch

prompted-filter

Reference documentation for the PromptedFilter operator. Covers the constructor, actual scoring and filtering behavior, and pipeline usage notes. Use when: filtering rows based on LLM semantic quality judgment rather than simple rule-based conditions.

Quellsprache: Englisch

bench-answer-generator

Reference documentation for the BenchAnswerGenerator operator. Covers the constructor, full run() signature, actual generation behavior, and integration notes for unified bench evaluation pipelines. Use when: generating model answers from benchmark question…

Quellsprache: Englisch

chunked-prompted-generator

Reference documentation for the ChunkedPromptedGenerator operator. Covers the constructor, file-path based chunking flow, actual prompt construction, and output file writing behavior. Use when: the dataframe stores file paths, the file content may exceed a…

Quellsprache: Englisch

embedding-generator

Reference documentation for the EmbeddingGenerator operator. Covers the constructor, embedding serving requirements, actual dataframe flow, and runnable pipeline usage. Use when: converting one text column in a dataframe into embedding vectors for retrieval,…

Quellsprache: Englisch

format-str-prompted-generator

Reference documentation for the FormatStrPromptedGenerator operator. Covers the constructor, prompt template restrictions, placeholder-to-column mapping, actual prompt-building logic, and runnable example usage. Use when: one generation task needs multiple…

Quellsprache: Englisch

prompted-generator

Reference documentation for the PromptedGenerator operator. Covers constructor parameters, run() signature, actual row-processing behavior, and pipeline usage notes. Use when: integrating PromptedGenerator into a DataFlow pipeline for single-field LLM…

Quellsprache: Englisch

random-domain-knowledge-row-generator

Reference documentation for the RandomDomainKnowledgeRowGenerator operator. [Purpose] Calls an LLM repeatedly with the same domain-generation prompt and writes the generated results into one column of an existing DataFrame. [When to use] Use it when you…

Quellsprache: Englisch

retrieval-generator

Reference documentation for the RetrievalGenerator operator. [Purpose] Reads one text column from storage, forwards every non-empty row to `llm_serving.generate_from_input(...)`, and writes the returned list into a new output column. [Default backend] Use…

Quellsprache: Englisch

text2multihopqa-generator

Reference documentation for the Text2MultiHopQAGenerator operator. [Purpose] Generates multi-hop QA pairs from one text column and writes two output columns: one for `qa_pairs` and one for metadata. [When to use] Use it when you want reasoning-style QA pairs…

Quellsprache: Englisch

pandas-operator

Reference documentation for the PandasOperator operator. Use when: applying custom DataFrame transformations without LLM.

Quellsprache: Englisch

prompted-refiner

Reference documentation for the PromptedRefiner operator. Use when: refining text with LLM, overwriting original column.

Quellsprache: Englisch

core-text

Reference documentation for DataFlow's core_text operators — 8 generators, 3 filters, 2 refiners and 5 evaluators. Read by generating-dataflow-pipeline when a task needs an operator beyond the six core primitives. This is a reference package, not a workflow:…

Quellsprache: Englisch

dataflow-operator-builder

Build production-grade DataFlow operator scaffolds (generate/filter/refine/eval) for Codex and coding agents. Trigger when users ask to create/new/scaffold operators, add OPERATOR_REGISTRY registration, generate DataFlowStorage-based CLI wrappers, or generate…

Quellsprache: Englisch

prompt-template-builder

Build reusable DataFlow prompt_template classes for existing operators with two-round structured intake, two-stage auditable outputs, and static acceptance checks. Trigger when users ask to generate/rewrite/optimize prompt_template or reuse operator logic…

Quellsprache: Chinesisch