gitmyhub

crawler-user-agents

Python ★ 0 updated 7y ago ⑂ fork

Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:

No plain-English explanation yet — one is being written right now. Check back in a minute.