I’ve been play around with ollama. Given you download the model, can you trust it isn’t sending telemetry?

  • acockworkorange@mander.xyz
    link
    fedilink
    arrow-up
    9
    ·
    29 days ago

    Containers don’t really slow down apps significantly. It’s not a VM, it’s still a native app running in your kernel, just on a separate memory space and restricted access to hardware.

    • Jack@slrpnk.net
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      29 days ago

      That is true for Linux and maybe Mac, but on windows I think they have a bit more overhead. But again I agree that in most cases it is not significant.

      • acockworkorange@mander.xyz
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        29 days ago

        Is the overhead because of containers or is it because you’re running something that is meant to run on Linux and is using a conversion layer like MinGW ?

        • stink@lemmygrad.ml
          link
          fedilink
          English
          arrow-up
          1
          ·
          29 days ago

          Windows > Windows Subsystem for Linux (WSL) Ubuntu > docker container

          I think WSL 2 actually runs Linux in a virtual environment. I’ve tried getting my own LLM instance running on my windows machine but it’s been such a pain.