Automation Control Panel Interactive demo In-house build

ScrapeRunner

Mission control for data pipelines - schedule scraping and sync jobs, watch them run live, and get clean data delivered to sheets, databases, or webhooks.

Launch interactive demo
TypeAutomation dashboard
ScopeScraper engine → Scheduler → UI
StackPython · Playwright · FastAPI · React
scraperunner.example/jobs
ScrapeRunner Jobs Schedules Datasets Destinations Proxies

Jobs

4 active · interactive demo - sample data
Runs today36
Success rate98.4% healthy
Rows collected84.2k +6k
Avg run time2m 40s

Scheduled jobs

Competitor prices
every 6h → PostgreSQL		 Running
Listings monitor
hourly → Google Sheets		 Idle · ok
Review tracker
daily 06:00 → webhook		 Retry 1/3
Invoice fetcher
weekly → S3		 Idle · ok

Live log competitor-prices #1383

Rows collected per day last 8 days

FriSatSunMonTueWedThuNow

The idea

Automation you can actually see

Most scraping setups are a cron job and a prayer. ScrapeRunner gives every pipeline a schedule, retries with backoff, health checks, and a live log - so "is it still running?" is never a mystery. We build automations like this responsibly: rate-limited, robots-aware, and within each site's terms.

  • Python
  • Playwright
  • FastAPI
  • Celery
  • PostgreSQL

Set-and-forget schedules

Cron-style scheduling with retries, backoff, and failure alerts.

Clean data out

Validated, deduplicated rows to Sheets, Postgres, S3, or any webhook.

Live observability

Streaming logs and per-run stats - debug from the browser, not SSH.

Polite by design

Rate limits, caching, and robots.txt respect baked into every job.

0
Retries with backoff
0
Untracked silent failures
24/7
Scheduled, unattended

Polite by design

Rate limits and robots.txt are respected on every job - not an afterthought when a site starts blocking us.

Visible, not a black box

Live logs and per-run stats mean you never have to guess whether a job is stuck.

Fails loud

A stuck job pages someone - it doesn't quietly go stale for a week before anyone notices.

Doing something by hand every week?

That's a script. Tell us the boring task and we'll automate it end-to-end.

Start a project
VelvetCart PipelineForge