Does anyone else proudly display the what they self host on their laptop? The hardest part is removing old stickers when you port from one project to another (Trilium and Obsidian for example). People ask me all the time what’s this or that sticker. I’m impressed when they can pick one out on their own.

FOSS source is here.

  • zeezee@slrpnk.net
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    15 hours ago

    you self host your own claude llm? damn and here i thought a 14B deepseek ollama instance was good shit - how did you get access to their proprietary weights?

    • johnnixon@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      9 hours ago

      No, but I refuse to pay my VPS for GPU time so I self host Gemma3:27B with RAG on Ollama over tailnet to make a choose your own adventure medical protocol simulator. I’m sure Claude could give me some context breathing room but not at those token prices. I did see something on pointing Claude Code to your own Ollama server and that would maybe justify the self hosted butthole.