Announcing Arachnid: A powerful web scraper for Crystal

I love Crystal and have been using it for years, but one of the things I've felt like was missing for a long time was a good web scraper. So, because I definitely don't have enough personal projects, I decided to start building one myself.

Arachnid is based heavily off of the Spidr Ruby gem, with the main difference currently just being Crystal (and Spidr probably works better at the moment). The whole goal of Arachnid is to provide an easy to use DSL for scraping the web, whether you're looking for html pages, javascript, zip files, images, or anything else.

You can see some examples in the README and more will be coming very soon, as well as full documentation.