The Framework Desktop is a deep disappointment to me. Framework, the company that got into the business with an explicit purpose of building modular and repairable computers, went into a space where that was the norm (desktops), and introduced a PC that was none of those things, at an exorbitant price. When they debuted it, it was marketed specifically as a gaming machine. As much as I want to support them, I cannot reward them for this specific product, as it abandons their fundamental tenets.
Here’s the build. You can see similar builds featured on many YT channels at this point with the new NV10 case and 5060 LP GPU.
Here’s one from ETA Prime
And another from “MRGUI on PC”
This build: ~$1100
Comparable Framework build: ~$1700
I will concede the Framework is still better at a few things:
- Efficiency (I’m not sure that this is to any degree that’s worth being factored in)
- Being that it’s more efficient, it’s also quieter
- Local LLMs (which no one should care about or be using)
- A bit thinner due to not have a dGPU
Before we continue the conversation, I’m going to ask you again, how much experience do you actually have with local LLMs? I’m going to assume you just haven’t found a use for it, and for some reason you have the gall to think that applies to everyone else, without ever touching it yourself.
I’ll provide you a use-case I like. You can connect video feeds from self-hosted FOSS frigate NVR to a locally hosted LLM to provide searchable descriptions of tagged events, for example, you can search your events for “parked blue van”, which was tagged by a local LLM, instead of trying to look through hundreds of events yourself, and without sending your private video feeds to any corporation.
Boom, local AI serves a purpose.
Boom, your earlier argument now reads as “using Linux is drinking the corporate Kool aid”
Are we done here?
I’m not answering because I don’t keep a log of time spent with LLMs. I can tell you it’s many hours.
Well you know what happens when you assume. I haven’t found a use for it because there aren’t any, other than writing shitty social media posts.
LOOOOOLOL I see the problem here. You think LLM = AI. That’s nothing to do with an LLM, that’s just object detection/recognition.
Yes, I’m glad I was able to clear that up for you!
…it’s literally using ollama to produce textual descriptions of scenes. Maybe my example was too basic. As per the frigate documentation, you can search for “red sedan driving down a residential street on a sunny day”. Object detection will not provide that context. That’s why I added “parked” to blue car - common object detection algorithms like YOLO will only say “blue car” without any context of the scene it belongs in. Hell, I think YOLO itself will only say “car”, IIRC.
Frigate does not provide that capability without LLMs
The only thing Ollama is doing is parsing your natural language into search queries for tags like “red car”, “sedan”, “residential street” etc. You could just as easily do the same thing by just typing in those tags. Like I said, pointless. And probably inaccurate.
No, ollama is using models to provide further context on thumbnails containing tracked objects.. In textual form, that can be searched via semantic embeddings later on.
It blows my mind that you’re trying to speak so authoritatively on something you’ve clearly misunderstood. I’m going to guess you haven’t worked with frigate before?
Are you trying to understand me, or are you just defending yourself at all costs?
Please stop using your alt accounts to continue to harass me after I’ve blocked you. I told you I’m not interested in any bad faith discussions or personal insults.
“local LLMs have no use!”
“Here’s a use”
“No, it’s providing no utility in your example, because it’s doing this.”
“That’s not even how the LLM is being used in my example”
“Please stop harassing me with your alt account”
Okay buddy. Turns out multiple people disagree with your uninformed takes. But I guess for some people it’s easier to think a 2 year old, regularly active account is an alt than it is to acknowledge you were wrong lol.
EDIT: hold the fucking phone. Even if you think I was an alt, are you considering me providing a well documented counterexample to your assertion to be harassment? My guy, if you aren’t informed about something it’s okay to admit it. Everyone’s wrong about a lot of things, what sets people apart is how they react when shown they were wrong. Life will be easier if you ask more questions when talking to strangers.