
Crawler.sh is a fast, local-first web crawling tool designed for SEO and AEO analysis. It allows developers and marketers to scan entire websites in seconds using a terminal interface or a native desktop application. The tool performs automated SEO checks, extracts structured content as clean Markdown, and enables easy export to formats like JSON, CSV, or Sitemap XML. This makes it ideal for technical audits, content analysis, and building data pipelines from website content.