Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1572arrow-down17cross-posted to: [email protected]
arrow-up1565arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square131fedilinkcross-posted to: [email protected]
minus-squarezod000@lemmy.mllinkfedilinkEnglisharrow-up3·3 months agoI don’t hate all bots, I hate this bot specifically because: they intentionally hide that they are a bot to evade our, and everyone else’s, methods of restricting which bots we allow and how much activity we allow. they do not respect the robots.txt the already mentioned lack of rate limiting
I don’t hate all bots, I hate this bot specifically because: