Archive1

SEO Spider after a crawl of the practice site books.toscrape.com: 3,203 addresses in the Internal tab, with one page selected and the overview on the right.
Project · · 5 min read

SEO Spider: a crawler of my own for technical SEO

Screaming Frog is the model, and I'd have kept using it if it didn't have a bad subscription model – you don't even get to keep an earlier version when the subscription ends. So I built my own crawler for technical SEO with Claude Code, in Rust and for both Windows and macOS.