The Framework Desktop is a deep disappointment to me. Framework, the company that got into the business with an explicit purpose of building modular and repairable computers, went into a space where that was the norm (desktops), and introduced a PC that was none of those things, at an exorbitant price. When they debuted it, it was marketed specifically as a gaming machine. As much as I want to support them, I cannot reward them for this specific product, as it abandons their fundamental tenets.
Here’s the build. You can see similar builds featured on many YT channels at this point with the new NV10 case and 5060 LP GPU.
Here’s one from ETA Prime
And another from “MRGUI on PC”
This build: ~$1100
Comparable Framework build: ~$1700
I will concede the Framework is still better at a few things:
- Efficiency (I’m not sure that this is to any degree that’s worth being factored in)
- Being that it’s more efficient, it’s also quieter
- Local LLMs (which no one should care about or be using)
- A bit thinner due to not have a dGPU
Because they serve no purpose.
Is that why models on HuggingFace have monthly download counts in the millions?
No, that’s because people are easily duped by unprecedented investments in marketing.
Sounds like you’re coping. Especially since marketing for local LLMs is not a thing.
WTF is a cope? There’s no way anyone actually thinks that marketing for LLMs is not a thing so I can only surmise that your intention is to argue in bad faith or otherwise troll. In which case, goodbye.
Could you provide a single example of marketing for a local LLM?
Do you have any evidence that investment in marketing of LLMs is actually “unprecedented” or trending any differently than marketing as a whole?
I can provide an example of a purpose for a local LLM: offline translation of documents written in a foreign language.
How much impact do you think marketing had on hugging face, considering it’s free?
100% of it, considering HuggingFace wouldn’t exist without LLM marketing.
Hugging face was founded in 2016
LLM marketing didn’t show up on google trends until 2023.
I wonder how hugging face existed for those 7 years in between 🤔
Almost as if researchers and practitioners used LLMs before marketing hype…
It is typical anti-science conspiracy theorist “secret knowledge” mindset. People like OP want to feel like they know something others don’t, so they allow themselves the delusion that, despite no personal expertise or knowledge of the topic, they actually know better than the companies risking billions on AI investments and expert researchers/academics with decades long careers in AI/ML.
They are the same as other science deniers, like anti-vaxxers believing they actually know better than doctors and medical researchers because of an anecodote they read online.
Admittedly, hugging face wasn’t what it currently is in 2016, but the wiki suggests that it changed prior to 2021. Point still stands, as that’s before LLMs even showed up in marketing.
That said, they certainly are painting with a broad brush.
Wow you’re REALLY buttchugging the corporate koolaid…
claiming that working with free, open source, self hosted, privacy-focused local LLMs means you’ve drunk the corporate Kool aid is only further discrediting yourself on this topic…
And you REALLY have totally outsmarted top researchers in AI/ML. Congratulations on knowing better! You should feel special!
Which corporation released local LLMs like OLMo? Oh wait that’s right, it was a non-profit that released OLMo, not a corporation.