Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square127fedilinkarrow-up1559arrow-down16cross-posted to: technik
arrow-up1553arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square127fedilinkcross-posted to: technik
minus-squareJackbyDev@programming.devlinkfedilinkEnglisharrow-up1·2 hours agohttps://www.reddit.com/robots.txt
https://www.reddit.com/robots.txt