TL;DR: My iPhone 16 Pro Max produces garbage output when running MLX LLMs. An iPhone 15 Pro runs the same code perfectly. A MacBook Pro also runs the same code perfectly. The tensor outputs on the 16 show numerical values an order of magnitude wrong. I suspect it points
  • mech@feddit.orgEnglish
    39·
    7 hours ago

    The core functionality is simple:

    Automatically, upon each payment, add the expense to my app
    Update an Apple Watch complication with the % of my monthly budget spent
    Categorize the purchase for later analysis

    Can someone enlighten me? I don’t understand why you need AI for this in the first place.

        • panda_abyss@lemmy.caEnglish
          91·
          5 hours ago

          Yea, but those are all using heaps of proprietary heuristics.

          The beauty of LLMs and one of their most useful tasks is taking unstructured natural language content and converting it into structured machine readable content.

          The core transformer architecture was original designed for translation, and this is basically just a subset of translation.

          This is basically an optimal use case for LLMs.

          • MolochHorridus@lemmy.mlEnglish
            8·
            5 hours ago

            Quite obviously not the optimal use case. “The tensor outputs on the 16 show numerical values an order of magnitude wrong.”

            • JPAKx4@piefed.blahaj.zoneEnglish
              2·
              1 hour ago

              That’s the hardware issue he was talking about, it has no relation to the effectiveness of the usage of the LLM. It sounded to be mostly a project he was doing for fun rather then out of necessity