Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Responses from LLM not being recorded in Chat History DB #1111

Open
jack-vinitsky opened this issue Sep 20, 2024 · 1 comment
Open

Responses from LLM not being recorded in Chat History DB #1111

jack-vinitsky opened this issue Sep 20, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@jack-vinitsky
Copy link

Describe the bug
Currently the chat history is only recording the end user's prompts and not the responses from the LLM. Checking the Cosmos DB database only shows end user prompts.

To Reproduce
Steps to reproduce the behavior:

  1. Create a new chat and note the responses
  2. Start a new chat and then go to chat history.
  3. Click on a prior conversation.
  4. Note that only the end user's prompts are displayed.

Expected behavior
The history of the conversation includes responses from the LLM.

Screenshots
Original Conversation:

image

Conversation Retrieved from Chat History:

image

Configuration: Please provide the following

  • Azure OpenAI model name and version (e.g. 'gpt-35-turbo-16k, version 0613'): gpt-4o
  • Is chat history enabled? - Yes
  • Are you using data? If so, what data source? (e.g. Azure AI Search, Azure CosmosDB Mongo vCore, etc) - Azure AI Search

Additional context
This is only happening on one of the 5 instances of this chatbot that we are running although this one is the most recent update that we have deployed (as of pull request #1073)

@jack-vinitsky jack-vinitsky added the bug Something isn't working label Sep 20, 2024
@dmytroHexagon
Copy link

dmytroHexagon commented Sep 20, 2024

Faced the same issue, also not present in the associated cosmos db

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants