メニュー
scrape websites, extract data, crawl pages, and browse the web at scale using kernel cloud browsers with stealth mode and proxies.
デフォルトでは、最初にソースを確認する Prompt が選択されています。直接コマンドに切り替えるか、ローカルコピーをダウンロードすることもできます。
インストールを決める前に、SKILL.md と SkillsMP に表示されている付属ファイルをお読みください。
Codex または Claude でインストール この Prompt をコピーして Codex、Claude、または他のアシスタントに貼り付けると、Skill ページを確認してインストールできます。
直接コマンドでは確認用 Prompt が省略されます。実行前にソースを確認してください。
npx skills add https://github.com/kernel/cursor-plugin --skill web-scrapingコマンドは1行のまま表示されます。コピー前に横へスクロールして全体を確認してください。
ローカルで確認しますか？SkillsMP が現在取得できるファイルをダウンロードできます。
browse websites, open a browser, automate a website, navigate to a URL, click buttons, fill forms, and scrape pages using kernel cloud browsers with playwright and CDP.
manage cloud browsers, take screenshots, run playwright scripts, and manage browser profiles using kernel's MCP tools. use when the kernel MCP server is connected.
build browser automation scripts using the kernel python sdk with playwright and remote browser management. use when writing python code that creates browsers, runs playwright, or automates websites with kernel.
SKILL.md を表示中
SOC 職業分類に基づく
| name | web-scraping |
| description | scrape websites, extract data, crawl pages, and browse the web at scale using kernel cloud browsers with stealth mode and proxies. |
kernel cloud browsers let you scrape at scale with stealth mode, residential proxies, and up to 72-hour sessions. no charges for idle time.
stealth mode automatically adds a recaptcha solver and residential proxy to your browsers. use it for any site with bot detection.
const browser = await kernel.browsers.create({ stealth: true });
proxy quality for bot detection avoidance, best to worst:
await page.goto("https://example.com/products");
await page.waitForSelector(".product-card");
const products = await page.$$eval(".product-card", cards =>
cards.map( ({
: card.()?.?.(),
: card.()?.?.(),
: card.()?.,
}))
);
products;
const allItems = [];
let hasNext = true;
while (hasNext) {
const items = await page.$$eval(".item", els =>
els.map(e => e.textContent?.trim())
);
allItems.push(...items);
const nextBtn = await page.$("a.next-page");
if (nextBtn) {
await nextBtn.click();
await page.waitForLoadState("networkidle");
} else {
hasNext = false;
}
}
return allItems;
let previousHeight = 0;
while (true) {
const currentHeight = await page.evaluate(() => document.body.scrollHeight);
if (currentHeight === previousHeight) break;
previousHeight = currentHeight;
await page.evaluate(() => window.scrollTo(0, document.body.scrollHeight));
await page.waitForTimeout(2000);
}
return await page.$$eval(".item", els => els.map(e => e.textContent));
launch multiple browsers for parallel scraping:
const urls = ["https://site.com/1", "https://site.com/2", "https://site.com/3"];
const results = await Promise.all(
urls.map(async (url) => {
const browser = await kernel.browsers.create({ stealth: true });
const pw = await chromium.connectOverCDP(browser.cdp_ws_url);
const page = pw.contexts()[0].pages()[0];
try {
await page.goto(url);
return await page.title();
} finally {
await pw.close();
await kernel.browsers.deleteByID(browser.session_id);
}
})
);
pre-warm a pool of browsers for instant acquisition. no cold-start latency.
const pool = await kernel.pools.create({
name: "scraper-pool",
size: 10,
stealth: true,
proxy_id: "residential-proxy-id",
});
// acquire, scrape, release — browsers recycle instantly
for (const url of urls) {
const browser = await kernel.pools.acquire(pool.id);
// scrape...
await kernel.pools.release(pool.id, browser.session_id);
}
kernel supports sessions up to 72 hours. no charges for idle time — you can pause overnight and resume the next day from the same point.
const browser = await kernel.browsers.create({
stealth: true,
timeout_seconds: 259200, // 72 hours
});