robots

Ruby ★ 0 updated 10y ago ⑂ fork

robots.txt parser

No plain-English explanation yet — one is being written right now. Check back in a minute.

Open on GitHub →

Chat with this repo Simplify and Visualize This Repo Scan the safety of this repo Self Host this repo

Made with gitmyhub, a BitVibe Labs product. · Explanations powered by explaingit.

GitHub is a trademark of GitHub, Inc. gitmyhub is independent and not affiliated with or endorsed by GitHub. Public data is shown via the GitHub API. Terms · Privacy