Installation

From Source

git clone https://github.com/WyattAu/crawlkit.git
cd crawlkit
cargo build --release

Binary output: target/release/crawlkit

Via cargo install

cargo install crawlkit

Pre-built Binaries

Download from GitHub Releases.

Platform	Architecture	Format
Linux	x86_64	tar.gz
Linux	aarch64	tar.gz
macOS	x86_64	tar.gz
macOS	aarch64	tar.gz
Windows	x86_64	zip

Verify Installation

crawlkit --version

System Requirements

Resource	Minimum	Recommended
OS	Linux, macOS, Windows	–
RAM	64 MB	512 MB (large crawls)
Disk	100 MB	proportional to crawl data
Network	Outbound HTTP/HTTPS	–