• ThirdConsul@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 hours ago

    You can obtain token probabilities, so you can give some estimate out-of-band confidence in a response, down to the token level.

    That means literally nothing. You can get wrong answer with 100% token confidence, and correct one with 0.000001% confidence.