Scrape smarter. Ship faster.

Free MIT-licensed Python toolkit for permitted web scraping, data cleaning, and automation pipelines.

Everything you need to collect and clean data

Battle-tested utilities, not another tutorial.

πŸ•·οΈ SmartScraper

Configurable scraper with retries, polite delays, same-domain filtering, and instant CSV/JSON export.

🧹 DataCleaner

Normalize text, extract emails and phones, deduplicate records, and clean messy dict lists in one pass.

πŸ” Transformer

Map fields, filter records by predicate, and pivot data for CSV export without writing boilerplate.

🌐 APIHarvester

Paginate through REST/GraphQL endpoints with automatic retry and normalized JSON output.

⚑ TaskRunner

Orchestrate multi-stage pipelines with structured logging, error handling, and JSON run reports.

πŸ“¦ CLI

One-liner commands for common tasks: extract links, text, tables, and emails from any URL.

Clean, readable code

Copy-paste into your project and run.

# pip install -r requirements.txt from src.scraper import SmartScraper from src.cleaner import DataCleaner scraper = SmartScraper("https://example.com", delay_range=(1, 2)) links = scraper.extract_links("https://example.com") emails = DataCleaner.extract_emails(" ".join(links)) scraper.export_json(emails, "emails.json")

Free and open source

Use it under the MIT license. Sponsor ongoing work with USDT on the TON network if it saves you time.

MIT License

Free

Personal and commercial use under the license

  • Full source code
  • MIT license
  • Public issue tracker
  • Direct GitHub download

Pay in USDT on TON network πŸ”— Open in TON wallet
  1. Select USDT in your wallet.
  2. Select the TON network.
  3. Copy the address below and send USDT only.

UQDHA5jEi88JRomsstaA-srnIJyayuK95FsGuXI6_B2Cngbk

No amount is prefilled.

Custom services

Request a written scope and fixed USDT quote before payment on the TON network.

Custom Scraper

Collect permitted public data and deliver clean, structured CSV or JSON.

Data Pipeline

Automate the flow from raw HTML β†’ cleaned CSV/JSON β†’ your database or spreadsheet.

Monitoring Setup

Track permitted price, stock, or content changes with a lightweight scheduled script.

Python Utility

A small CLI, converter, report generator, or API integration built to an acceptance test.

Get in touch

Questions? Custom quote? Just say hello.

Do not include secrets or private data. Payment is requested only after scope and price are confirmed.

Request custom work

GitHub GitHub Profile