smerriman Posted June 10, 2018 Report Share Posted June 10, 2018 http://www.bridgebase.com/robots.txt has /forums/ now blocked from robots. I use Google all of the time to search the forum (site:bridgebase.com/forums/), since the inbuilt forum search is terrible. Now all of the results are gone. Why? 1 Quote Link to comment Share on other sites More sharing options...
hrothgar Posted June 10, 2018 Report Share Posted June 10, 2018 http://www.bridgebase.com/robots.txt has /forums/ now blocked from robots. I use Google all of the time to search the forum (site:bridgebase.com/forums/), since the inbuilt forum search is terrible. Now all of the results are gone. Why? I am guessing GDPR Quote Link to comment Share on other sites More sharing options...
smerriman Posted June 10, 2018 Author Report Share Posted June 10, 2018 There is no conceivable reason for GDPR affecting Google's cache, unless European visitors are 100% blocked from the forums. Quote Link to comment Share on other sites More sharing options...
helene_t Posted June 10, 2018 Report Share Posted June 10, 2018 There is no conceivable reason for GDPR affecting Google's cache, unless European visitors are 100% blocked from the forums.Sometimes, people post cheating accusations directed at named users. They will be edited by mods quickly but there's a risk that the original will be in the cache. Quote Link to comment Share on other sites More sharing options...
smerriman Posted June 11, 2018 Author Report Share Posted June 11, 2018 Sometimes, people post cheating accusations directed at named users. They will be edited by mods quickly but there's a risk that the original will be in the cache.True, but that's not relevant to GDPR (anyone can post anyone else's info on any forum / comment system anywhere, that doesn't put you at fault), and if that was the real reason regardless of GDPR, that seems a bit of an over-reaction compared to the benefits. Quote Link to comment Share on other sites More sharing options...
barmar Posted June 11, 2018 Report Share Posted June 11, 2018 We put the forums in our robots.txt Disallow list a few months ago because we thought the excess load from crawlers was causing errors. We've taken it out, and if problems return we'll investigate other solutions. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.