want to be observed. Onion web sites are “crawled” and additional on the checklist delivered their “robots.txt” file permits it, and when it is not on their own blacklist of sites with abuse materials. Site operators also can post their own .onion internet sites for indexing.