Background: I’ve been writing a new media server like Jellyfin or Plex, and I’m thinking about releasing it as an OSS project. It’s working really well for me already, so I’ve started polishing up the install process, writing getting started docs, stuff like that.

I’m interested in how other folks have set up their media libraries. Especially the technical details around how files are encoded and organized.

My media library currently has about 1,100 movies and just shy of 200 TV shows. I’ve encoded everything as high quality AV1 video with Opus audio, in a WebM container. Subtitles and chapters are in a separate WebVTT file alongside the video. The whole thing is currently about 9TB. With few exceptions, I sourced everything directly from Blu-ray or DVD using MakeMKV. It’s organized pretty close to how Jellyfin wants it.

What about you?

  • some_guy@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 minutes ago

    12.8TB. Mostly uncompressed rips from Blu-rays, some DVDs, some from iTunes Store. Some from the high seas, but not in a long time because the market solved that problem with streaming.

  • Lemmyrick@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 hours ago

    4TB mostly TV, then movies, then a distant third is music. Novice at all, tried remuxing a few things that didn’t work. Everything works on jellyfin android and PC. Android TV jellyfin is frustrating, some things don’t play so well

      • brygphilomena@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        32 minutes ago

        Haha. Thanks. I really didn’t want to pay Netflix or any other streaming service. But it might have been cheaper than hdds and electricity.

        This is something I’ve been building for over 10 years at this point. I’ve gone through so many iterations of servers and storage architecture. I’ve lost my entire TV and movie library multiple times. (I don’t back it up because a. It’s expensive at this scale and b. this data is easy to rebuild over time.)

        It’s been a part of learning about hosting and data management that I’ve brought to/from my work.

  • tuckerm@feddit.online
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    Sometimes I hear about other people’s storage setups and I think, “that is overkill, no one really needs that.” According to this thread, I am quite mistaken about that. 😳

    I have 2,057 songs, taking up a measly 51 GB, on a Funkwhale server. No movies or TV shows.

    That should get a little larger soon. I have about 100 vinyl records that I want to make digital rips of.

  • HiTekRedNek@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    7 hours ago

    cries in broke

    I have 4x3TiB drives in a currently-degraded RAIDZ1 due to a hard drive failure. I have a replacement coming, and my fingers are crossed that I don’t lose another drive beforehand.

  • culpable@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    12 hours ago

    I use Tdarr to transcode everything in VP9 (can play in a browser and doesn’t need transcoding from Jellyfin).

    Audio is AAC 2 channel (I keep the original audio track and add the new AAC). Subs are in SRT.

    Everything is made for play from a browser without issue. I use Infuse on my Apple TV and ether never the web player but when my family watch something form Jellyfin wathever the device no trancode needed.

    TV Shows : 172 | Movies : 394 | 7.2 Tib

    Actually, not all files are transcoded the process is very slow. All files are stored on my NAS (Synology DS918+) with SHR-1 (hybrid RAID with 1 drive fault).

    I use Janitorr, he removes old files when I run low on space. This is why my library is not big.

    Feel free to ask if you have questions.

    Sorry for my English.

    • Spooky Mulder@lemmy.4d2.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 hours ago

      Playing files directly in the browser and avoiding the need for transcoding is exactly what the system I’ve built is designed around, so I get the appeal!

    • HiTekRedNek@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 hours ago

      I tried tdarr, but have issues using more than one node. I may just wind up installing docker on my more powerful desktop specifically for tdarr, instead of on the proxmox server I have without a real gpu. (It’s a Xeon Supermicro board with their onboard VGA)

    • alexcleac@szmer.info
      link
      fedilink
      English
      arrow-up
      4
      ·
      11 hours ago

      Wow, thanks for suggestion of Tdarr — that project indeed looks very nice. What is. your experience using it? Any quirks?

  • remon@ani.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    12 hours ago

    1911 TV shows (65728 episodes)

    2294 Movies

    5051 Albums (66644 songs)

    65.37 TB total.

  • SirMaple__@lemmy.ca
    link
    fedilink
    English
    arrow-up
    31
    ·
    edit-2
    21 hours ago

    My Jellyfin library:

    1,152 - Movies

    552 - Shows

    37, 062 - Episodes

    491 - Albums

    6,558 - Songs

    362 - Music Videos

    14 - Concert Films

    Files are a mix of 1080p and 4K. 264 and 265. Standard and REMUX.

    Total space used is currently 149.90TiB

    • marighost@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      18 hours ago

      Kinda unrelated to OOP, but out of curiosity, what does your storage setup look like? Do you keep stuff reasonably backed up with that much data?

      • SirMaple__@lemmy.ca
        link
        fedilink
        English
        arrow-up
        9
        ·
        edit-2
        9 hours ago

        Ah yes. My storage system is 2 x Supermicro CSE-846 cases. Only one has a CPU and motherboard, the other is acting as a plain Jane JBOD.

        Hard drives I have 21 x 8TB 7200RPM mix of Seagate and Western Digital and 4 x 16TB 7200RPM from Seagate. I use mergerfs and snapraid. Mergerfs presents all the 21 8TB drives as one mount point. Snapraid uses the 4 16TB drives to provide 4 parity drives. Note that snapraid is not live and the parity is only updated after running a “snapraid sync” which I run nightly.

        I only backup my songs and music videos. The rest is easy to get again. I have a script that generates a list of every single file I have each night. So if the day comes it wouldn’t take too long to get back to where I was. The other reason I use mergerfs is if 1 drive dies, I only lose the files on that one drive and not the entire array. The truely important stuff such as tax documents, mortgage details, family pictures, will & estate documents are stored on a 2 x 8TB RAID1 and all backed up nice a safe using Proxmox PBS. The PBS datastore is synced to 2 remote locations as well as to external drives that I keep offline and rotate.

        • Policeshootout@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          Nice write-up. I thought I had a large library (24TB) and my off site backup is starting to get full. I backup everything though but I have long debated on if there’s a point of keeping movies and TV since they’ll likely always be available. Anyway, I never thought of generating a list of files and eliminating the stuff that’s not particularly important. Good idea.

    • Spooky Mulder@lemmy.4d2.org
      link
      fedilink
      English
      arrow-up
      4
      ·
      20 hours ago

      Ahh, I like how you split Concert Films and Music Videos. I’ve been pigeon-holing my Short Films, Mini-Series, and TV Movies into just the two categories: Shows and Movies. Makes way more sense having separate categories.

    • curbstickle@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      21 hours ago

      About the same here, minus the music videos (only a few dozen there for the kids), plus a fitness library, so I’d say it evens out to roughly equal.

      Mostly HEVC but I still have some h.264 floating around that I have no interest in reencoding.

      No AV1 at all until I get a new Intel GPU or newer Intel CPU to handle transcoding it nicely.

      • Spooky Mulder@lemmy.4d2.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        20 hours ago

        There’s some relatively inexpensive NVIDIA cards now with AV1 hardware encoding. I’m on my third round of re-encoding my whole library (HEVC, then VP9, now AV1). For 1080p NTSC, I get about 13x speeds on NVENC AV1, whereas with VP9 I was CPU-bound at around 4x. Definitely worth the upgrade, in case you’re on the fence.

        • TheYang@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          14 hours ago

          You do realize that you lose quality with wach encode, right?

          It’s not AS bad when bitrates are high, but it’s still there.

          • Spooky Mulder@lemmy.4d2.org
            link
            fedilink
            English
            arrow-up
            3
            ·
            13 hours ago

            True.

            When I migrated off of Jellyfin, I re-encoded everything up to that point directly from the Blu-ray rips wherever possible. Because I’d already started culling those for space, I did end up just doing another pass on the first round of encoding for a portion of the library. There’s some noticable degradation on those, and I’ll want to re-rip those at some point.

            Fortunately, I’ve got my process pretty dialed in for ripping and I actually enjoy it, so if I ever have a quality issue, it’s not a huge ordeal to re-rip and encode.

        • curbstickle@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          20 hours ago

          Yeah I just dont have a need with no devices to handle it natively, while the rest of my library can be. Building a new htpc media player for the living room next, new server after that.

          New because I’m using a lenovo tiny as the server, which means either I build a new box completely, or I find the right used workststion tiny/mini/micro that can handle av1. Complete build will do a lot more (well, the t/m/m does too, but not to the extent my big box builds are set up for).