Is there any computer program with AI capabilities (the generative ones seen in ChatGPT; onlineText-to-Picture generators, etc.) that is actually standalone? i.e. able to run in a fully offline environment.

As far as I understand, the most popular AI technology rn consists of a bunch of matrix algebra, convolutions and parallel processing of many low-precision floating-point numbers, which works because statistics and absurdly huge datasets. So if any such program existed, how would it even have a reasonable storage size if it needs the dataset?

  • Ziggurat@sh.itjust.works
    29·
    4 months ago

    There is tons of “standalone” software that you can run on your own PC

    • For Text generation, the easiest way is to get GPT4All package which allows you to run text generation model in CPU on your own PC

    • For image generation, you can try to get Easy difusion package which is an easy to use stable diffusion package, then if you like-it, time to try the “comfyUI”

    You can check [email protected] and [email protected] for some more information

    • deranger@sh.itjust.works
      0·
      4 months ago

      I’ve wanted to try these out for shits and giggles - what would I expect with a 3090, is it going to take a long time to make some shitposts?

      • tyler@programming.dev
        0·
        4 months ago

        I did a bunch of image generation on my 3080 and it felt extremely fast. Enough that I was able to set it up as a shared node in one of those image generation nets and it outperformed most other people in the net.