changelog : llama-server REST API

[ggerganov]

Overview

This is a list of changes to the public HTTP interface of the llama-server example. Collaborators are encouraged to edit this post in order to reflect important changes to the API that end up merged into the master branch.

If you are building a 3rd party project that relies on llama-server, it is recommended to follow this issue and check it carefully before upgrading to new versions.

See also:

• Changelog for libllama API

Recent API changes (most recent at the top)

version	PR	desc
TBD.	#9459	Add [DONE]\n\n in OAI stream response to match spec
b3721	#9398	Add seed_cur to completion response
b3683	#9308	Environment variable updated
b3599	#9056	Change /health and /slots

For older changes, use:

git log --oneline -p b3599 -- examples/server/README.md

Upcoming API changes

• None

[ngxson]

Not a REST API breaking change, but is server-related: some environment variables are changed in #9308

[slaren]

After #9398, in the completion response seed contains the seed requested by the user, while seed_cur contains the seed used to generate the completion. The values can be different if seed is LLAMA_DEFAULT_SEED (or -1), in which case a random seed is generated and returned in seed_cur.