Google’s John Mueller confirmed that the GoogleProber and the GoogleProducer (which we lined right here) are each legit Googlebot consumer brokers and crawlers. “These are official Google requests with a user-agent particular to the Google Information config in Writer Middle so if they’re blocked the feeds you arrange could not work correctly,” John added.
John did admit there is a matter with one or each of those bots crawling an excessive amount of (both for his website or typically). John mentioned, “We now have discovered a difficulty that affects you the place we’re making too frequent requests and this will probably be fastened shortly.” John additionally mentioned “We’ll additionally work on fixing the damaged info-link.”
Listed below are these tweets for extra context:
Hello @searchliaison @dannysullivan @JohnMu we’re seeing loads of visitors to writer’s websites with a brand new user-agent ‘GoogleProducer; (+https://t.co/5l7Fm3K043) ‘. Our WAF is at the moment blocking it, but it surely’s origin is definitely Google Proxy hosts. Is that this legit visitors? Thanks! pic.twitter.com/twVlVI5gqJ
— Hernán Marsili (@hmarsili) January 31, 2023
Thanks, additionally, from the identical IPs we’ve got determine elevated exercise from GoogleProber UA. pic.twitter.com/J8eN3pRK32
— Hernán Marsili (@hmarsili) February 1, 2023
… We now have discovered a difficulty that affects you the place we’re making too frequent requests and this will probably be fastened shortly. We’ll additionally work on fixing the damaged info-link.
— johnmu is a rating issue and so are you 🐀 (@JohnMu) February 7, 2023
Discussion board dialogue at Twitter.
