Everyone here saying confidently “no” hasn’t kept track of science over the last several thousand years. There have been hundreds/thousands of things that have been “that is impossible” that we simply didn’t have the knowledge for to be able to do.

200 years ago you would have been laughed at for thinking man could ever take to the skies, and now flying is a boring tedious thing for us.

75 years ago the idea of carrying a computer in your pocket with thousands of times the sum of the entire compute availability in the world back then would have been scoffed at, and people would have told you it’s impossible. Now we use it to post on forums like this like it’s nothing.

Both are examples of “it’s impossible, the science says so”, but that’s the neat thing about science. We learn new things every day. Our thoughts change, you don’t “believe” in science, you only learn new things.

So is it impossible? I think it’s incredibly small-minded and dare I even say arrogant to say it’s impossible. How do we know what will be discovered tomorrow, or 100 years from now, or 1000 years from now? We have absolutely no idea what will be possible then. With our current technology? Absolutely not. In 400 years? Who knows someone may be standing in line at security and see a meme making fun of us for thinking it was impossible.

If you’re only at 2 nodes, then I think host paths with node selectors are what you should go with. That gets you up and running in the short term, but know that the conversion later to something like Longhorn will be a process. (Creating the volumes, then copying all the data over, ensuring correct user access, etc).

So you have a classic issue of datastorage on kubernetes. By design, kubernetes is node-agnostic, you simply have a pile of compute resources available. By using your external hard drive you’ve introduced something that must be connected to that node, declaring that your pod must run there and only there, because it’s the only place where your external is attached.

So you have some decisions to make.

First, if you want to just get it started, you can do a hostPath volume. In your volumes block you have:

volumes:
  - name: immich-volume
    hostPath:
      path: /mnt/k3s/immich-media # or whatever your path is

The gotcha is that you can only ever run that pod on the node with that drive attached, so you need a selector on the pod spec.
You’ll need to label your node with something like kubectl label $yourNodeName anylabelname=true, like kubectl label $yourNodeName localDisk=true Then you can apply a selector to your pod like:

    spec:
      nodeSelector:
        localDisk=true

This gets you going, but remember you’re limited to one node whenever you want data storage.

For multi-node and true clusters, you need to think about your storage needs. You will have some storage that should be local, like databases and configs. Typically you want those on the local disk attached to the node. Then you may have other media, like large files that are rarely accessed. For this you may want them on a NAS or on a file server. Think about how your data will be laid out, then think about how you may want to grow with it.

For local data like databases/configs, once you are at 3 nodes, your best bet with k3s is Longhorn. It is a HUGE learning curve, and you will screw up multiple times as a warning, but it’s the best option for managing tiny (<10GB) drives that are spread across your nodes. It manages provisioning and making sure that your pods can access the volumes underneath, without you managing nodes specifically. It’s the best way to abstract away not only compute, but also storage.

For larger files like media and linux ISOs, then really the best option is NFS or block storage like MinIO. You’ll want a completely separate data storage layer that hosts large files, and then following a guide like this you can enable mounting of NFS shares directly into your pods. This also abstracts away storage, you don’t care what node your pod is running on, just that it connects to this store and has these files available.

I won’t lie, it’s a huge project. It took about 3 months of tinkering for me to get to a semi-stable state, simply because it’s such a huge jump in infrastructure, but it’s 100% worth it.

I was a hardcore Thomas the tank engine nerd.

And Theodore Tugboat.

Helm has worked well for me, what’s the problem you had?

They have proven over and over that consumer brands aren’t anything to them. They constantly chase flashy buzzwords and quarterly earnings over improving and fixing their longstanding issues

Nextcloud implements webdav, which you can use rclone to mount as a remote.

Also many distros have an online account option which does the same thing

I think it was good, but not memorable. It was… Fine. It was a fun romp, I don’t feel like I wasted it, but I don’t think there needs to be a huge franchise either.

I’m all for fine games. Not everything needs to be red dead levels and they did that with outer worlds. That said, I was shocked when Microsoft wanted 80 bucks for it when the first one was clearly a 40 dollar game

Same as here in the states. Rural people happily eat up that the city is unsafe, and they happily believe they are so much smarter than everyone else for not living in the city and being murdered every other day.

Comment is over a year old dude.

For me it was when I stopped going to church. I didn’t go to Easter service, a very important date to our church, and it caused massive backlash. My mother stayed in bed and cried all day, cancelled all of the dinner plans we had that evening, and told family not to come visit. I eventually went and bought fast food for my brother because she refused to do anything for us that day. It took a very long time for her to get over that one.

Yep, gaming stocks are on sale today because of stupid investors. Happily bought a few

I have no idea why people and companies still trust Google. When I did work on GCP we had mandatory maintenance every 2 months because some core service was changing. Hell I just got a notice last week that they’re shutting down another API.

That poor kid is going to struggle with food for the rest of his life

Lol just watched a video that I agree with, that shows again and again that you can build a big world, but it means nothing if you don’t have the creativity to fill it.

So I’m sure Ubisoft would use this. Super. It’s not going to be able to make the next red dead or cyberpunk.

I used to be a huge turd for years thinking “these plebians liking will Farrell movies are so dumb, it’s a horrible movie with no plot”.

Turns out you can enjoy two different things completely fine in life. I was just being an arrogant fuckwit

Don’t worry I got your back. I haaaaaate working out. Every second of it. It’s miserable, boring, tiring, and gross and sweaty.

However, since I started doing it I hate to admit that I am more energetic in everything else, I move easier, I’m not winded going up stairs, I’m happier, all the tripe they tell you is true.

It’s not 30 minutes because you have to enjoy it, it’s 30 minutes that improve the other 23.5 hours a day

More like the local store suing Walmart for putting them out of business, but only after they pushed away all of their customers with bad ideas and flashy gimmicks

They only did that because they wanted their walled garden to be there too. Tim Sweeney is just butthurt his walled garden isn’t the biggest

I do selfhost my own, and even tried my hand at building something like this myself. It runs pretty well, I’m able to have it integrate with HomeAssistant and kubectl. It can be done with consumer GPUs, I have a 4000 and it runs fine. You don’t get as much context, but it’s about minimizing what the LLM needs to know while calling agents. You have one LLM context that’s running a todo list, you start a new one that is charge of step 1, which spins off more contexts for each subtask, etc. It’s not that each agent needs it’s own GPU, it’s that each agent needs it’s own context.