roboxt

PHP ★ 1 updated 6y ago ⑂ fork

simple parser for robots.txt

No plain-English explanation yet — one is being written right now. Check back in a minute.