Menü
SkillsMP hat 21 Skills aus xinyangli/nixos-config gesammelt. Öffne einen Skill, um Quelle und Details zu prüfen.
Es werden 21 von 21 gesammelten Skills angezeigt.
Recover and retry failed records from Gemini batch annotation jobs. Covers grid-level retry (no re-concat), full re-concat retry pipelines, and after concat — how to upload manifest to S3, split shard ranges across teammates, run with --use-concat,…
Quellsprache: Englisch
Update Canva ML model weights through W&B registry upload, artifact mirroring, model lockfile PRs, and staged deployment PRs. Use when updating ingredient-generation/media-transformation model checkpoints, running arnold registry upload, following Canva…
Quellsprache: Englisch
Package image datasets into bucketed Parquet shards with resolution and aspect ratio bucketing. Use when converting JSONL+image datasets to Parquet format, creating training-ready datasets, or when the user mentions parquet, packaging, bucketing, sharding, or…
Quellsprache: Englisch
Run verifier gates for Core CN dataset processing stages: S3 counts, parquet schema, row alignment, metadata naming, bbox validity, OCR/caption validity, resized image audits, and final sidecar quality.
Quellsprache: Englisch
Orchestrate Core CN image dataset processing from raw assets through CPU filtering, dedup, main/sidecar Parquet packaging, 512/1024 resized Parquet, layer detection, HunyuanOCR, JSON captioning, score enrichment, and verifier gates. Use when planning or…
Quellsprache: Englisch
Build 2x2 grid concat images from S3 image datasets for batch Gemini captioning. Use when creating concat grids, running the annotation batch infer pipeline, generating concat manifests, managing the prepare→concat→worker→run→postprocess workflow, or…
Quellsprache: Englisch
Build 512-area and 1024-area resized image Parquet datasets, preserve row keys, audit valid/invalid rows, and feed crop metadata back into structured_description bbox columns.
Quellsprache: Englisch
Reduce YubiKey touch frequency on Canva Linux devboxes. Diagnoses where touches come from (tsh/kubectl, Python kubernetes clients like utp, AWS prod profile) and applies workarounds. Use when the user says "yubikey 触发太频繁", "kubectl 每次要 touch", "aws cli 一直要…
Quellsprache: Englisch
Start an HTTP service in Devbox and expose it to colleagues via infra highway tunnel. Covers tmux session setup, python http.server, highway tunnel creation, and warp access. Use when needing to share HTML demos, comparison pages, Streamlit/Gradio apps, or…
Quellsprache: Chinesisch
Build image editing dataset pipelines using third-party APIs (OpenAI gpt-image-1.5/bluefire-alpha, Google Gemini). Covers generating edit instructions via Vertex AI batch, executing image edits via OpenAI Batch API or local concurrent API calls,…
Quellsprache: Englisch
Multi-model quality assessment and data cleaning pipeline for image editing datasets. Evaluates (source, instruction, edited) triplets on three dimensions (edit adherence, visual quality, content preservation) using Gemini batch + OpenAI online judges.…
Quellsprache: Englisch
Run layer detection, identify text-bearing elements, hand layer detection plus HunyuanOCR outputs to JSON caption jobs, and validate structured_description bbox outputs for final sidecar merge.
Quellsprache: Englisch
Run HunyuanOCR on text-bearing images or layer-detection outputs, submit OCR-aware single-image recaption, build an index, and merge OCR/recaption results into final sidecar Parquet.
Quellsprache: Englisch
Access S3 buckets across accounts using S3 Access Grants (s3control GetDataAccess). Use when reading from cross-account S3 buckets like design-generation-core-oss.canva.com, or when encountering AccessDenied errors on S3 operations requiring temporary…
Quellsprache: Englisch
Build row-aligned sidecar Parquet for large image datasets without rewriting image bytes. Use for merge-then-join enrichment, Ray actor distribution, 1:1 shard alignment, resume, and pyarrow offset-overflow pitfalls.
Quellsprache: Englisch
Work in the sidecar-parquet-ops repo for YAML-driven sidecar datasets, ops, schemas, runtimes, Docker builds, and runtime selection. Use before adding datasets, pipelines, filters, side-input joins, or recaption ops.
Quellsprache: Englisch
Merge DQM-d1-V6.1 and ERNIE-Image-Aes score sidecar Parquet outputs into an existing row-aligned sidecar Parquet dataset. Use when Codex needs to create an all-in-one sidecar from filter sidecars plus DQM/AES key-score sidecars, add merge_from_sidecar dataset…
Quellsprache: Englisch
Send Slack notifications for long-running jobs, UTP/Arnold/Ray/S3 batch processing, evaluation pipelines, task progress checks, completion/failure alerts, and user-requested Slack messages. Use when Codex should notify a specified Slack channel or user about…
Quellsprache: Englisch
Submit and monitor distributed Ray jobs on Arnold/UTP. Use for compute YAMLs, Arnold Docker builds, Ray preinstall requirements, CPU worker sizing, Kueue/Karpenter scheduling, pod quota/count checks, Ray parallelism, job logs, and auth troubleshooting.
Quellsprache: Englisch
Use when running Vertex AI or Gemini jobs from Arnold/UTP, especially from AWS/EKS with Workload Identity Federation, Google GenAI clients, GCS upload/download, Vertex batch submission, and UTP monitoring.
Quellsprache: Englisch
Pack tar or zip webdataset-style sources into canonical bucketed main Parquet, preserve metadata into meta_info, tune writer memory, and verify output shards.
Quellsprache: Englisch