roboxt

PHP ★ 0 updated 11y ago ⑂ fork

simple parser for robots.txt

No plain-English explanation yet — one is being written right now. Check back in a minute.