[Question][FR] Can we add tokens count?

[s-kostyaev]

I think about something like auto-compaction. Can we somehow add tokens count to the llm results?

[ahyatt]

Yes, this is something we should have. I'm not sure when I'll get to it, but hopefully in the next month.

[ahyatt]

This has now been implemented.

[kitallis]

Hi @ahyatt, apologies for reopening this issue, but I feel like this f5d9061 fix might not be entirely complete. It seems like the :input-tokens and :output-tokens are not being allowed correctly:

llm/llm-provider-utils.el

Line 830 in e00e634

(member key '(:text :tool-uses :tool-results :reasoning)))

As per my understanding, for streaming / multi-round patterns, it'd use llm-provider-utils-final-multi-output-result which would elide those keys.

[ahyatt]

Yes, you are right; this wasn't working for streaming. I have a fix that I'll submit shortly.