crawler

A small Crystal CLI that crawls a site using the crawlberg.cr shard (FFI bindings to xberg-io/crawlberg).

Installation

shards install
lib/crawlberg/scripts/download_ffi.sh   # stages lib/crawlberg/.lib/

./scripts/build.sh              # builds bin/crawler
./bin/crawler https://example.com/

./scripts/spec.sh               # downloads FFI (if needed) + runs specs

Repository

crawler

Owner

Statistic

License

MIT License

Links

Synced at

Sun, 09 Aug 2026 17:47:05 GMT

Languages