gitmyhub

http-client.go

Go ★ 0 updated 13y ago

Building block for web crawler in Go #golang. (Not yet ready) net/http/client enhanced with timeouts, limits and robots.txt support.

No plain-English explanation yet — one is being written right now. Check back in a minute.