Web crawling and scraping
Software that fetches web pages at scale and extracts their content.
Includes: Crawlers, scraping tools and scraping APIs.
For example: Scrapy, Apify, Firecrawl, Crawl4AI.
7 listed products
| Product | What it says it does |
|---|---|
| Terms of Service; Didn’t Read | ToS;DR aims to provide easy-to-understand summaries of Privacy Policies and Terms of Service through a transparent and peer-reviewed… |
| Firecrawl | it's the infrastructure layer that helps AI systems find, read, and act on information across the live web. |
| PowerMapper | Test your whole site and map its structure in one click — for accessibility, quality, and SEO. |
| OutWit Hub | Find, extract and organize all kinds of data and media from online sources. |
| Crawl4AI | Your open-source crawler, now hosted. |
| Googlebot | web crawler used by Google |
| Teleport Pro | internet software (Tennyson Maxwell) |
5 of these are read from their own pages. A product appears where AirStack's category list places it; 7,865 of 13,386 listed products carry no category yet.