aduana
C
★ 54
updated 2y ago
Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).
No plain-English explanation yet — one is being written right now. Check back in a minute.