You are viewing a single comment's thread from:RE: Google's Bot Imposes a Large Impact on the Performance of SteemYY.comView the full contextView the direct parentjustyy (82)in #witness-category • 2 years ago https://stackoverflow.com/questions/7787264/is-it-possible-to-control-the-crawl-speed-by-robots-txt