browser-automation

name	browser-automation
version	0.1.0
author	devclaw
description	Browser automation with Playwright — navigate, click, fill forms, scrape
category	automation
tags	["browser","playwright","automation","scraping","web"]
requires	{"bins":["npx","node"]}

Browser Automation

Automate web browsers using Playwright for testing, scraping, and automation.

Setup

Node.js (required):

• macOS: brew install node
• Ubuntu: sudo apt install nodejs npm

Playwright (browsers):

npm install -g playwright   # or: npm install playwright (project dependency)
npx playwright install        # downloads Chromium, Firefox, WebKit

Quick Scripts

# Take screenshot
npx playwright screenshot https://example.com screenshot.png

# Generate PDF
npx playwright pdf https://example.com page.pdf

Navigate & Screenshot

// script.js
const { chromium } = require('playwright');

(async () => {
  const browser = await chromium.launch();
  const page = await browser.newPage();

  await page.goto('https://example.com');
  await page.screenshot({ path: 'screenshot.png', fullPage: true });

  await browser.close();
})();

node script.js

Click & Fill Forms

const { chromium } = require('playwright');

(async () => {
  const browser = await chromium.launch({ headless: false });
  const page = await browser.newPage();

  await page.goto('https://example.com/login');

  // Fill form
  await page.fill('#email', '[e-mail]');
  await page.fill('#password', 'secretpassword');

  // Click button
  await page.click('button[type="submit"]');

  // Wait for navigation
  await page.waitForURL('**/dashboard');

  await browser.close();
})();

Extract Data

const { chromium } = require('playwright');

(async () => {
  const browser = await chromium.launch();
  const page = await browser.newPage();

  await page.goto('https://example.com/products');

  // Extract text
  const title = await page.textContent('h1');

  // Extract multiple elements
  const products = await page.$$eval('.product', items =>
    items.map(item => ({
      name: item.querySelector('.name')?.textContent,
      price: item.querySelector('.price')?.textContent
    }))
  );

  console.log(JSON.stringify(products, null, 2));

  await browser.close();
})();

Handle Dialogs & Alerts

page.on('dialog', async dialog => {
  console.log(dialog.message());
  await dialog.accept();
});

Wait Strategies

// Wait for element
await page.waitForSelector('.loaded');

// Wait for specific text
await page.waitForSelector('text=Welcome');

// Wait for network idle
await page.waitForLoadState('networkidle');

// Wait with timeout
await page.waitForSelector('.element', { timeout: 5000 });

Authentication

// Save auth state
const context = await browser.newContext();
await context.storageState({ path: 'auth.json' });

// Load auth state
const context = await browser.newContext({ storageState: 'auth.json' });

Command Line

# Run with specific browser
npx playwright test --project=chromium
npx playwright test --project=firefox
npx playwright test --project=webkit

# Run headed (visible browser)
npx playwright test --headed

# Debug mode
npx playwright test --debug

# Generate code from actions
npx playwright codegen https://example.com

Tips

• Use headless: false to see browser during development
• Use codegen to record actions and generate code
• Use waitForLoadState('networkidle') for dynamic content
• Use page.pause() for debugging
• Screenshots: PNG, JPEG supported

Triggers

browser automation, playwright, web scraping, automate browser, click, fill form, screenshot, web testing