Replying to @Chronotope and @mkramer
Maybe not, but crawling can get a little intense, there's a bunch of ways to get it wrong. By sharing the crawl, you can set up your own index with some filtering params and a lambda. It could lower the barrier to entry.
♥ 1