Project · · 5 min read
SEO Spider: a crawler of my own for technical SEO
Screaming Frog is the model, and I'd have kept using it if it didn't have a bad subscription model – you don't even get to keep an earlier version when the subscription ends. So I built my own crawler for technical SEO with Claude Code, in Rust and for both Windows and macOS.
