Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square125fedilinkarrow-up1557arrow-down16cross-posted to: technik
arrow-up1551arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square125fedilinkcross-posted to: technik
minus-squareSparky@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·10 hours agoOut of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.
Out of the 60gb/month of traffic my website gets, 20gb is because of bytedance’s webscraper. I haven’t gotten around to blocking them as bandwidth isn’t an issue but damn do they send a lot of requests.