The quantized model you can run locally works decently and they can’t read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
If you’re ready to tinker a bit i can recommend Ollama for the backend and Open web UI for the frontend. They can also both run on the same machine.
The advantage is that you can use your GPU to compute, which is a lot faster.
Pretty sure LM studio is not open source
You’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.
It won’t fuck off even if you ask it how to disable it gives you bullshit answers. Some “AI”.
Yeah first thing I did was ask it how I could dissable it.
At least the new windows copilot told me how to disable it.
I just blocked its user account
Don’t see any option to block it on messenger yet
What happens if you ask it to create Prof Farnsworth saying “Fuck Off”?
Could you then use the AI generated Farnsworth to instruct the AI to Fuck Off?
Where are you guys running into this? I thought for the most part tech people dropped anything associated with meta
Some people are ‘forced’ to use WhatsApp due to it being the messaging platform of choice for a lot of people.
Oh gotcha, I kinda forgot that was under the meta umbrella
For me it’s WhatsApp because it’s the defacto group messaging choice
your defacto group messaging choice
Don’t throw all of us under that bus, please and thanks
