Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1569arrow-down17cross-posted to: technik
arrow-up1562arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square131fedilinkcross-posted to: technik
minus-squarezod000@lemmy.mllinkfedilinkEnglisharrow-up3·1 month agoI don’t hate all bots, I hate this bot specifically because: they intentionally hide that they are a bot to evade our, and everyone else’s, methods of restricting which bots we allow and how much activity we allow. they do not respect the robots.txt the already mentioned lack of rate limiting
I don’t hate all bots, I hate this bot specifically because: