Beep@lemmus.org to Technology@lemmy.worldEnglish · 13 hours agoA “QuitGPT” campaign is urging people to cancel their ChatGPT subscriptions— Backlash against ICE is fueling a broader movement against AI companies’ ties to President Trump.quitgpt.orgexternal-linkmessage-square110fedilinkarrow-up1810arrow-down111
arrow-up1799arrow-down1external-linkA “QuitGPT” campaign is urging people to cancel their ChatGPT subscriptions— Backlash against ICE is fueling a broader movement against AI companies’ ties to President Trump.quitgpt.orgBeep@lemmus.org to Technology@lemmy.worldEnglish · 13 hours agomessage-square110fedilink
minus-squarelexiw@lemmy.worldlinkfedilinkEnglisharrow-up7·11 hours agoYou are playing with ancient stuff that wasn’t even good at release. Try these: A 4b model performing like a 30b model: https://huggingface.co/Nanbeige/Nanbeige4.1-3B Google open source version of Gemini: https://huggingface.co/google/gemma-3-4b-it
minus-squarech00f@lemmy.worldlinkfedilinkEnglisharrow-up1·2 hours ago Well, not off to a great start. To be clear, I think getting an LLM to run locally at all is super cool, but saying “go self hosted” sort of gloms over the fact that getting a local LLM to do anything close to what ChatGPT can do is a very expensive hobby.
minus-squarech00f@lemmy.worldlinkfedilinkEnglisharrow-up1·10 hours agoAny suggestions on how to get these to gguf format? I found a GitHub project that claims to convert, but wondering if there’s a more direct way.
You are playing with ancient stuff that wasn’t even good at release. Try these:
A 4b model performing like a 30b model: https://huggingface.co/Nanbeige/Nanbeige4.1-3B
Google open source version of Gemini: https://huggingface.co/google/gemma-3-4b-it
Well, not off to a great start.
To be clear, I think getting an LLM to run locally at all is super cool, but saying “go self hosted” sort of gloms over the fact that getting a local LLM to do anything close to what ChatGPT can do is a very expensive hobby.
Any suggestions on how to get these to gguf format? I found a GitHub project that claims to convert, but wondering if there’s a more direct way.