Tony Bark@pawb.social to Technology@lemmy.worldEnglish · 5 months agoGoogle Using Generic & Undocumented Google Crawlerwww.seroundtable.comexternal-linkmessage-square3linkfedilinkarrow-up17arrow-down10
arrow-up17arrow-down1external-linkGoogle Using Generic & Undocumented Google Crawlerwww.seroundtable.comTony Bark@pawb.social to Technology@lemmy.worldEnglish · 5 months agomessage-square3linkfedilink
minus-squareKairos@lemmy.todaylinkfedilinkEnglisharrow-up4·5 months ago The crawler user agent is just named “Google,”
Very sneaky.