hylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 2 months agoBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luimagemessage-square79linkfedilinkarrow-up1587arrow-down18file-text
arrow-up1579arrow-down1imageBased on this graph, and this graph alone, guess at what time I completely blocked OpenAI crawlersjlai.luhylobates@jlai.lu to Selfhosted@lemmy.worldEnglish · 2 months agomessage-square79linkfedilinkfile-text
minus-squarepoVoq@slrpnk.netlinkfedilinkEnglisharrow-up7arrow-down2·2 months agoThis is not how things work on the modern web. Did you just wake up from a 20 year coma?
minus-squareFreedomAdvocate@lemmy.net.aulinkfedilinkEnglisharrow-up1·edit-22 months agoWhenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
minus-squarepoVoq@slrpnk.netlinkfedilinkEnglisharrow-up1·2 months agoFor static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching. And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.
This is not how things work on the modern web. Did you just wake up from a 20 year coma?
Whenever you’re browsing even a semi popular website these days there’s probably a 98% chance you’re hitting a cloudflare cached version of it. Have you been asleep the last 10 years?
For static sites, yes. To actually protect dynamic sites against AI crawlers, Cloudflare has to do much more than just caching.
And besides that, Cloudflare is a huge single point of failure and highly privacy invasive.