• WesternInfidels@feddit.online
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    12 days ago

    They’re using domain-specific LLMs to compress narrow-domain data. Their text compression LLM was trained on, and then tested on, legal text and medical text.

    There’s no reason one couldn’t apply the domain-specific-compressor idea to a conventional lossless text compressor, essentially moving much of the dictionary from the compressed file to the program itself. I don’t know if anyone’s tried that. I’d like to know how that compares.