Tag Archives: crawler

Can I submit my site to be crawled?

Not at this time. We don’t currently accept URL submissions. We discover and add new sites to our index by link-crawling. Our crawler is named ScoutJet. You can see information about ScoutJet here: http://www.scoutjet.com/ Basically you just need to make … Continue reading

Posted in webmasters | Tagged , | Comments Off

What is the name of blekko’s crawler?

Blekko’s crawler is named ScoutJet.

Posted in webmasters | Tagged , | Comments Off

How do I get my site removed from blekko?

You can see information about preventing ScoutJet from crawling all or part of your site here. If you experience a problem with ScoutJet, please let us know at crawler@blekko.com.

Posted in webmasters | Tagged , | Comments Off