Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1572arrow-down17cross-posted to: [email protected]
arrow-up1565arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square131fedilinkcross-posted to: [email protected]
minus-squarejagged_circle@feddit.nllinkfedilinkEnglisharrow-up1arrow-down1·2 months agoCaches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-22 months agoNear zero isn’t zero though. And not everyone is using caching.
minus-squarejagged_circle@feddit.nllinkfedilinkEnglisharrow-up1arrow-down1·2 months agoRight, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoNot every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.
Caches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
Near zero isn’t zero though. And not everyone is using caching.
Right, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
Not every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.