tinyrobotsblock
Go
★ 1
updated 9mo ago
An extremely simple (<50 lines) Traefik middleware that overwrites the robots.txt file and denies crawling from bots.
No plain-English explanation yet — one is being written right now. Check back in a minute.