The Framework Desktop is a deep disappointment to me. Framework, the company that got into the business with an explicit purpose of building modular and repairable computers, went into a space where that was the norm (desktops), and introduced a PC that was none of those things, at an exorbitant price. When they debuted it, it was marketed specifically as a gaming machine. As much as I want to support them, I cannot reward them for this specific product, as it abandons their fundamental tenets.
Here’s the build. You can see similar builds featured on many YT channels at this point with the new NV10 case and 5060 LP GPU.
Here’s one from ETA Prime
And another from “MRGUI on PC”
This build: ~$1100
Comparable Framework build: ~$1700
I will concede the Framework is still better at a few things:
- Efficiency (I’m not sure that this is to any degree that’s worth being factored in)
- Being that it’s more efficient, it’s also quieter
- Local LLMs (which no one should care about or be using)
- A bit thinner due to not have a dGPU
It is typical anti-science conspiracy theorist “secret knowledge” mindset. People like OP want to feel like they know something others don’t, so they allow themselves the delusion that, despite no personal expertise or knowledge of the topic, they actually know better than the companies risking billions on AI investments and expert researchers/academics with decades long careers in AI/ML.
They are the same as other science deniers, like anti-vaxxers believing they actually know better than doctors and medical researchers because of an anecodote they read online.
Admittedly, hugging face wasn’t what it currently is in 2016, but the wiki suggests that it changed prior to 2021. Point still stands, as that’s before LLMs even showed up in marketing.
That said, they certainly are painting with a broad brush.
Wow you’re REALLY buttchugging the corporate koolaid…
claiming that working with free, open source, self hosted, privacy-focused local LLMs means you’ve drunk the corporate Kool aid is only further discrediting yourself on this topic…
Right, because FOSS LLMs couldn’t possibly be influenced by the non-FOSS ones. That’s stupid. That wouldn’t make any sense at all…
Okay, so I have a question for you. If we replace “LLMs” with operating systems in that statement, you’d use the same logic to argue that it’s drinking the corporate Kool aid to use linux, because it’s been influenced by non-FOSS operating systems.
Do you see how embarrassing of an argument that is to try and make?
Let’s shine some light on the elephant in the room. How much experience do you actually have with self-hosted LLMs? It’s sounding like 0, in which case I’d speak a lot less authoritatively if that were the case.
It would be embarrassing, if that’s what I had said. But Linux and other operating systems actually serve a purpose. They’re not just bullshit machines.
Before we continue the conversation, I’m going to ask you again, how much experience do you actually have with local LLMs? I’m going to assume you just haven’t found a use for it, and for some reason you have the gall to think that applies to everyone else, without ever touching it yourself.
I’ll provide you a use-case I like. You can connect video feeds from self-hosted FOSS frigate NVR to a locally hosted LLM to provide searchable descriptions of tagged events, for example, you can search your events for “parked blue van”, which was tagged by a local LLM, instead of trying to look through hundreds of events yourself, and without sending your private video feeds to any corporation.
Boom, local AI serves a purpose.
Boom, your earlier argument now reads as “using Linux is drinking the corporate Kool aid”
Are we done here?
I’m not answering because I don’t keep a log of time spent with LLMs. I can tell you it’s many hours.
Well you know what happens when you assume. I haven’t found a use for it because there aren’t any, other than writing shitty social media posts.
LOOOOOLOL I see the problem here. You think LLM = AI. That’s nothing to do with an LLM, that’s just object detection/recognition.
Yes, I’m glad I was able to clear that up for you!
…it’s literally using ollama to produce textual descriptions of scenes. Maybe my example was too basic. As per the frigate documentation, you can search for “red sedan driving down a residential street on a sunny day”. Object detection will not provide that context. That’s why I added “parked” to blue car - common object detection algorithms like YOLO will only say “blue car” without any context of the scene it belongs in. Hell, I think YOLO itself will only say “car”, IIRC.
Frigate does not provide that capability without LLMs
And you REALLY have totally outsmarted top researchers in AI/ML. Congratulations on knowing better! You should feel special!
Which corporation released local LLMs like OLMo? Oh wait that’s right, it was a non-profit that released OLMo, not a corporation.
I didn’t outsmart anyone except the stupid people being duped by trillions of dollars in marketing investment from the largest companies on the planet.
So let me understand how the world works, according to you:
Corporations have spent “trillions” of dollars to convince “stupid people” to download and run local LLMs… for free…
Actual facts: OpenAI, the largest player in AI, has raised a total of $59.7 billion in funding over the last 10 years. … “trillions” 🤣
Wrong. I didn’t say anything like that. You are once again intentionally trying to redirect the conversation back to local LLMs when I have done nothing but speak about LLMs in general. More marketing in proprietary LLMs = more adoption in LLMs, local or otherwise. You obviously know this, but once again have no interest in any good faith discussion, so this conversation is pointless.
…
^ this you? Lol.
You want to talk about good faith discussion, as if you’re not literally making things up like “trillions” in “marketing investment” with no evidence or sources. As if you don’t ignore any facts that disrupt your conspiracy theory, like OpenAI has only raised $59.7 billion, and cherry-pick the parts of the discussion that you respond to and the parts you ignore.
Who, exactly, is spending “trillions” of dollars on AI “marketing”? This question requires an answer for your claims to be taken seriously.
Are the companies that are spending billions to develop LLMs the ones pushing the “marketing” or are they the ones being duped by the “marketing”? Or somehow its both at once and they’ve tricked themselves into developing LLMs? Cognitive dissonance.