browser-use/browser-worlds-tinker-rl

최근 기록된 소스 활동: 2026년 8월 8일 10:12

SkillsMP 카탈로그 업데이트: 2026년 11월 2일 18:02

수집된 skills: 1

GitHub 스타: 4
GitHub 포크: 3

AI 어시스턴트로 설치

이 프롬프트를 복사해 사용 중인 AI 어시스턴트에 입력하세요.

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/browser-use/browser-worlds-tinker-rl.

저장소 README

README 원본 파일: README.md

README 원본 보기

README 전체 펼치기

# Browser Worlds × Tinker RL This repository will demonstrate specialist browser-agent improvement with reinforcement learning on deterministic Browser Use Worlds. Before changing the environment, it reproduces Tinker Cookbook's default Harbor RL recipe on Terminal-Bench using Inkling. No browser-agent training code is present yet. ## Pinned baseline Tinker Cookbook is pinned in `pyproject.toml`; see [UPSTREAM.md](UPSTREAM.md). The baseline uses: - the upstream Harbor task loader and bash-tool agent; - Terminal-Bench 2.0; - Modal sandboxes; - each task's `tests/test.sh` reward; - `thinkingmachines/Inkling` instead of the recipe's original model default. ## Setup Place `TINKER_API_KEY` in `.env` and authenticate Modal. Then: ```bash uv sync uvx harbor datasets download terminal-bench@2.0 \ -o ~/.cache/harbor/tasks/terminal-bench-2.0 ``` Load `.env` without passing credentials as command arguments: ```bash set -a source .env set +a ``` ## One-step baseline Run the smallest real training step first: ```bash uv run python scripts/train_terminal_bench_smoke.py ``` This runs one Terminal-Bench task with two Inkling rollouts and disables the upstream iteration-zero evaluation over all 89 tasks. The Harbor agent, sandbox, grader, and training loop are unchanged. Validated on August 8, 2026: one batch and two rollouts completed, the optimizer step succeeded, and final Tinker state and sampler checkpoints were produced. Both rollouts reached their token limit and received `-0.1`, so this validates the baseline pipeline rather than task performance. ## Full upstream example After the one-step run succeeds: ```bash uv run python -m tinker_cookbook.recipes.harbor_rl.scripts.train_terminal_bench \ model_name=thinkingmachines/Inkling \ learning_rate=1e-5 ``` The learning rate is an explicit initial experiment value; Inkling does not publish a universal recommended RL learning rate. ## Zenith sandbox The browser stack uses one reusable Daytona base snapshot containing Chromium and Browser Harness. Each rollout creates one ephemeral sandbox, materializes the exact Zenith World binary, and runs the World, Chromium, and Browser Harness locally together. Browser Use Cloud is not involved. ```bash uv run python scripts/verify_zenith_daytona_sandbox.py \ --world-binary /tmp/zenith-world-server \ --customer-repo ~/work/browser-rl-daytona-harbor \ --output /tmp/zenith-daytona-browser-harness ``` The verifier checks the Zenith task result, records output-file and screenshot hashes, deletes the sandbox, and retains the shared snapshot for later rollouts.

저장소 README를 불러오는 중…

이 저장소의 skills

소프트웨어 개발자

직업 카테고리 1개 · 100% 분류됨

skill

직업 분류

설명

업데이트

browser-harness

소프트웨어 개발자

Always use browser-harness for any web interaction: automation, scraping, testing, or site/app work.

원문 언어: 영어

2026-08-08

수집된 skill 1개 중 1개를 표시합니다.