delorie.com/archives/browse.cgi | search |
> > The internet is served by their own web crawler and by the one of alexa. > Seems to me, that the robots.txt disallows them to enter the wiki. Wouldn't that block Google results from pulling things up from the wiki? I tested this and it seems to be the case. Grabbing text from the wiki I can't get Google to show results from it. I would consider this a problem. ~Joshua
webmaster | delorie software privacy |
Copyright © 2019 by DJ Delorie | Updated Jul 2019 |