The Framework Desktop is a deep disappointment to me. Framework, the company that got into the business with an explicit purpose of building modular and repairable computers, went into a space where that was the norm (desktops), and introduced a PC that was none of those things, at an exorbitant price. When they debuted it, it was marketed specifically as a gaming machine. As much as I want to support them, I cannot reward them for this specific product, as it abandons their fundamental tenets.
Here’s the build. You can see similar builds featured on many YT channels at this point with the new NV10 case and 5060 LP GPU.
Here’s one from ETA Prime
And another from “MRGUI on PC”
This build: ~$1100
Comparable Framework build: ~$1700
I will concede the Framework is still better at a few things:
- Efficiency (I’m not sure that this is to any degree that’s worth being factored in)
- Being that it’s more efficient, it’s also quieter
- Local LLMs (which no one should care about or be using)
- A bit thinner due to not have a dGPU
100% of it, considering HuggingFace wouldn’t exist without LLM marketing.
Hugging face was founded in 2016
LLM marketing didn’t show up on google trends until 2023.
I wonder how hugging face existed for those 7 years in between 🤔
Almost as if researchers and practitioners used LLMs before marketing hype…
It is typical anti-science conspiracy theorist “secret knowledge” mindset. People like OP want to feel like they know something others don’t, so they allow themselves the delusion that, despite no personal expertise or knowledge of the topic, they actually know better than the companies risking billions on AI investments and expert researchers/academics with decades long careers in AI/ML.
They are the same as other science deniers, like anti-vaxxers believing they actually know better than doctors and medical researchers because of an anecodote they read online.
Admittedly, hugging face wasn’t what it currently is in 2016, but the wiki suggests that it changed prior to 2021. Point still stands, as that’s before LLMs even showed up in marketing.
That said, they certainly are painting with a broad brush.
Wow you’re REALLY buttchugging the corporate koolaid…
claiming that working with free, open source, self hosted, privacy-focused local LLMs means you’ve drunk the corporate Kool aid is only further discrediting yourself on this topic…
Right, because FOSS LLMs couldn’t possibly be influenced by the non-FOSS ones. That’s stupid. That wouldn’t make any sense at all…
Okay, so I have a question for you. If we replace “LLMs” with operating systems in that statement, you’d use the same logic to argue that it’s drinking the corporate Kool aid to use linux, because it’s been influenced by non-FOSS operating systems.
Do you see how embarrassing of an argument that is to try and make?
Let’s shine some light on the elephant in the room. How much experience do you actually have with self-hosted LLMs? It’s sounding like 0, in which case I’d speak a lot less authoritatively if that were the case.
It would be embarrassing, if that’s what I had said. But Linux and other operating systems actually serve a purpose. They’re not just bullshit machines.
Before we continue the conversation, I’m going to ask you again, how much experience do you actually have with local LLMs? I’m going to assume you just haven’t found a use for it, and for some reason you have the gall to think that applies to everyone else, without ever touching it yourself.
I’ll provide you a use-case I like. You can connect video feeds from self-hosted FOSS frigate NVR to a locally hosted LLM to provide searchable descriptions of tagged events, for example, you can search your events for “parked blue van”, which was tagged by a local LLM, instead of trying to look through hundreds of events yourself, and without sending your private video feeds to any corporation.
Boom, local AI serves a purpose.
Boom, your earlier argument now reads as “using Linux is drinking the corporate Kool aid”
Are we done here?
And you REALLY have totally outsmarted top researchers in AI/ML. Congratulations on knowing better! You should feel special!
Which corporation released local LLMs like OLMo? Oh wait that’s right, it was a non-profit that released OLMo, not a corporation.
I didn’t outsmart anyone except the stupid people being duped by trillions of dollars in marketing investment from the largest companies on the planet.
So let me understand how the world works, according to you:
Corporations have spent “trillions” of dollars to convince “stupid people” to download and run local LLMs… for free…
Actual facts: OpenAI, the largest player in AI, has raised a total of $59.7 billion in funding over the last 10 years. … “trillions” 🤣
Wrong. I didn’t say anything like that. You are once again intentionally trying to redirect the conversation back to local LLMs when I have done nothing but speak about LLMs in general. More marketing in proprietary LLMs = more adoption in LLMs, local or otherwise. You obviously know this, but once again have no interest in any good faith discussion, so this conversation is pointless.
…
^ this you? Lol.
You want to talk about good faith discussion, as if you’re not literally making things up like “trillions” in “marketing investment” with no evidence or sources. As if you don’t ignore any facts that disrupt your conspiracy theory, like OpenAI has only raised $59.7 billion, and cherry-pick the parts of the discussion that you respond to and the parts you ignore.
Who, exactly, is spending “trillions” of dollars on AI “marketing”? This question requires an answer for your claims to be taken seriously.
Are the companies that are spending billions to develop LLMs the ones pushing the “marketing” or are they the ones being duped by the “marketing”? Or somehow its both at once and they’ve tricked themselves into developing LLMs? Cognitive dissonance.