browser-use/browser-worlds-tinker-rl

最近记录的来源活动: 2026年8月8日 10:12

SkillsMP 收录数据更新: 2026年11月12日 12:52

已收集 skills: 1

GitHub 星标: 4
GitHub Forks: 3

用 AI 助手安装

复制这段 Prompt，发给你正在使用的 AI 助手。

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/browser-use/browser-worlds-tinker-rl.

仓库 README

仓库 README 来源：README.md

查看 README 源文件

展开完整 README

# Browser Worlds × Tinker RL This repository will demonstrate specialist browser-agent improvement with reinforcement learning on deterministic Browser Use Worlds. Before changing the environment, it reproduces Tinker Cookbook's default Harbor RL recipe on Terminal-Bench using Inkling. No browser-agent training code is present yet. ## Pinned baseline Tinker Cookbook is pinned in `pyproject.toml`; see [UPSTREAM.md](UPSTREAM.md). The baseline uses: - the upstream Harbor task loader and bash-tool agent; - Terminal-Bench 2.0; - Modal sandboxes; - each task's `tests/test.sh` reward; - `thinkingmachines/Inkling` instead of the recipe's original model default. ## Setup Place `TINKER_API_KEY` in `.env` and authenticate Modal. Then: ```bash uv sync uvx harbor datasets download terminal-bench@2.0 \ -o ~/.cache/harbor/tasks/terminal-bench-2.0 ``` Load `.env` without passing credentials as command arguments: ```bash set -a source .env set +a ``` ## One-step baseline Run the smallest real training step first: ```bash uv run python scripts/train_terminal_bench_smoke.py ``` This runs one Terminal-Bench task with two Inkling rollouts and disables the upstream iteration-zero evaluation over all 89 tasks. The Harbor agent, sandbox, grader, and training loop are unchanged. Validated on August 8, 2026: one batch and two rollouts completed, the optimizer step succeeded, and final Tinker state and sampler checkpoints were produced. Both rollouts reached their token limit and received `-0.1`, so this validates the baseline pipeline rather than task performance. ## Full upstream example After the one-step run succeeds: ```bash uv run python -m tinker_cookbook.recipes.harbor_rl.scripts.train_terminal_bench \ model_name=thinkingmachines/Inkling \ learning_rate=1e-5 ``` The learning rate is an explicit initial experiment value; Inkling does not publish a universal recommended RL learning rate. ## Zenith sandbox The browser stack uses one reusable Daytona base snapshot containing Chromium and Browser Harness. Each rollout creates one ephemeral sandbox, materializes the exact Zenith World binary, and runs the World, Chromium, and Browser Harness locally together. Browser Use Cloud is not involved. ```bash uv run python scripts/verify_zenith_daytona_sandbox.py \ --world-binary /tmp/zenith-world-server \ --customer-repo ~/work/browser-rl-daytona-harbor \ --output /tmp/zenith-daytona-browser-harness ``` The verifier checks the Zenith task result, records output-file and screenshot hashes, deletes the sandbox, and retains the shared snapshot for later rollouts.

正在加载仓库 README…

这个仓库中的 skills

软件开发工程师

1 个职业分类 · 已分类 100%

skill

职业分类

描述

更新

browser-harness

软件开发工程师

Always use browser-harness for any web interaction: automation, scraping, testing, or site/app work.

原文语言：英语

2026-08-08

已展示 1 / 1 个已收集 Skill。